00000001:02000400:1.0F:1789366483.098642:0:2960:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg223-server.virtnet: executing set_hostid 00000001:02000400:1.0:1789366490.802360:0:3162:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg223-server.virtnet: executing load_modules_local 00000001:01000000:3.0F:1789366491.590164:0:3203:0:(lnet-crypto.c:360:cfs_crypto_performance_test()) Crypto hash algorithm adler32 speed = 1363 MB/s 00000001:01000000:3.0:1789366491.840105:0:3203:0:(lnet-crypto.c:360:cfs_crypto_performance_test()) Crypto hash algorithm crc32 speed = 1751 MB/s 00000001:01000000:3.0:1789366492.089808:0:3203:0:(lnet-crypto.c:360:cfs_crypto_performance_test()) Crypto hash algorithm crc32c speed = 10515 MB/s 00000020:02000000:0.0F:1789366492.361057:0:3253:0:(class_obd.c:771:obdclass_init()) Lustre: Build Version: 2.17.58_6_ge9bcf18 00000400:02000000:3.0:1789366492.694067:0:3268:0:(api-ni.c:2828:lnet_startup_lndni()) Added LNI 192.168.202.123@tcp [8/256/0/180] 00008000:02000000:2.0F:1789366494.898574:0:3418:0:(echo_client.c:2575:obdecho_init()) Echo OBD driver; http://www.lustre.org/ 00000001:02000400:1.0:1789366513.144568:0:5221:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg223-server.virtnet: executing load_modules_local 00000020:01000004:1.0:1789366516.577400:0:5797:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:1.0:1789366516.577405:0:5797:0:(obd_mount.c:926:lmd_print()) device: lustre-mdt1/mdt1 00000080:01200004:1.0:1789366516.577540:0:5797:0:(super25.c:131:lustre_fill_super()) VFS Op: sb 000000007986c6c2 00000080:02000400:1.0:1789366516.577550:0:5797:0:(super25.c:149:lustre_fill_super()) lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' 00000020:01000004:1.0:1789366516.581132:0:5797:0:(tgt_mount.c:2506:osd_start()) Attempting to start lustre-MDT0000, type=osd-zfs, lsifl=200065, mountfl=0 00000020:01000004:1.0:1789366516.581146:0:5797:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-zfs) 00000020:00000080:1.0:1789366516.581182:0:5797:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (00000000d551432e) 00000020:00000080:1.0:1789366516.581199:0:5797:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-zfs with refcount 2 00100000:10000000:3.0:1789366516.590711:0:5797:0:(scrub.c:230:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:3.0:1789366516.591011:0:5797:0:(scrub.c:230:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:3.0:1789366516.602966:0:5797:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:3.0:1789366516.602998:0:5797:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:3.0:1789366516.603019:0:5797:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:3.0:1789366516.603071:0:5797:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:3.0:1789366516.603095:0:5797:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:3.0:1789366516.603386:0:5797:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:3.0:1789366516.603393:0:5797:0:(osd_handler.c:1574:osd_obd_connect()) connect #0 00000020:00000080:3.0:1789366516.603403:0:5797:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x8da3486b955f2d4a 00000020:01000004:3.0:1789366516.603410:0:5797:0:(tgt_mount.c:2591:server_fill_super()) Found service lustre-MDT0000 on device lustre-mdt1/mdt1 00000020:01000000:3.0:1789366516.603415:0:5797:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:3.0:1789366516.603419:0:5797:0:(tgt_mount.c:101:server_register_mount()) register mount 000000007986c6c2 from MGS 00000020:01000004:3.0:1789366516.603423:0:5797:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:3.0:1789366516.603438:0:5797:0:(genops.c:413:class_newdev()) Allocate new device MGS (000000008f009b54) 00000020:00000080:3.0:1789366516.603448:0:5797:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:3.0:1789366516.603552:0:5797:0:(tgt_mount.c:153:server_get_mount()) get mount 000000007986c6c2 from MGS, refs=2 00080000:01000000:3.0:1789366516.603558:0:5797:0:(osd_handler.c:1574:osd_obd_connect()) connect #1 00000020:00000080:3.0:1789366516.603562:0:5797:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x8da3486b955f2d58 00000100:00100000:3.0:1789366516.603641:0:5797:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:3.0:1789366516.603770:0:5797:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:3.0:1789366516.603774:0:5797:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:3.0:1789366516.604194:0:5797:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:3.0:1789366516.604202:0:5797:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:3.0:1789366516.604810:0:5797:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1789366516.604974:0:5797:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:3.0:1789366516.604979:0:5797:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:3.0:1789366516.606277:0:5797:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:3.0:1789366516.606285:0:5797:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:3.0:1789366516.606511:0:5797:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:3.0:1789366516.606516:0:5797:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:0.0:1789366516.606958:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789366516.606961:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789366516.606962:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789366516.607094:0:5805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789366516.607096:0:5805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789366516.607097:0:5805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789366516.607427:0:5797:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:0.0:1789366516.609833:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:01000000:3.0:1789366516.856819:0:5797:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip512 speed = 6951 MB/s 00000001:01000000:3.0:1789366517.106770:0:5797:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip4K speed = 7943 MB/s 00000001:01000000:3.0:1789366517.357050:0:5797:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc512 speed = 1500 MB/s 00000001:01000000:3.0:1789366517.606964:0:5797:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc4K speed = 1863 MB/s 00080000:10000000:3.0:1789366517.611178:0:5797:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000040:01000000:3.0:1789366517.618907:0:5797:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 20000000:01000000:3.0:1789366517.618920:0:5797:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:3.0:1789366517.618922:0:5797:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 10000000:01000000:1.0:1789366517.619379:0:5807:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:3.0:1789366517.619407:0:5797:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:3.0:1789366517.619476:0:5797:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000040:00080000:3.0:1789366517.619673:0:5797:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:3.0:1789366517.619698:0:5797:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:3.0:1789366517.620107:0:5797:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1789366517.620333:0:5797:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:3.0:1789366517.620339:0:5797:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:0.0:1789366517.620823:0:5797:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:0.0:1789366517.620831:0:5797:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:1.0:1789366517.621037:0:5797:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:1.0:1789366517.621045:0:5797:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000100:00080000:0.0:1789366517.621382:0:5812:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 00000020:00000080:1.0:1789366517.621443:0:5797:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:1.0:1789366517.621481:0:5797:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.202.123@tcp' 00000020:01000004:1.0:1789366517.621483:0:5797:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:1.0:1789366517.621528:0:5797:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.202.123@tcp (typ=mgc) 00000020:00000080:1.0:1789366517.621539:0:5797:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.202.123@tcp (0000000065441edf) 00000020:00000080:1.0:1789366517.621554:0:5797:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:1.0:1789366517.621635:0:5797:0:(ldlm_lib.c:102:import_set_conn()) imp 00000000c606c397@MGC192.168.202.123@tcp: add connection 192.168.202.123@tcp at head 00010000:00010000:1.0:1789366517.621856:0:5797:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.202.123@tcp-0 is initialized 00000040:01000000:1.0:1789366517.621864:0:5797:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.123@tcp ctxt 1 is initialized 10000000:01000000:0.0:1789366517.622377:0:5813:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:0.0:1789366517.622417:0:5797:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.202.123@tcp (uuid 8cde4528-5832-4854-a387-4adacc3dd0ab) 00000020:00000080:0.0:1789366517.622435:0:5797:0:(genops.c:1385:class_connect()) connect: client 8cde4528-5832-4854-a387-4adacc3dd0ab, cookie 0x8da3486b955f2d66 00000100:00080000:0.0:1789366517.622445:0:5797:0:(import.c:545:import_select_connection()) MGC192.168.202.123@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1789366517.622451:0:5797:0:(import.c:666:import_select_connection()) MGC192.168.202.123@tcp: import 00000000c606c397 using connection 192.168.202.123@tcp/0@lo 00000100:00100000:0.0:1789366517.622502:0:5797:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@000000008cfef116 x1876286758715520/t0(0) o250->MGC192.168.202.123@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1789366517.622521:0:5797:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import 8cde4528-5832-4854-a387-4adacc3dd0ab->MGS 00000020:01000004:0.0:1789366517.622538:0:5797:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:0.0:1789366517.622542:0:5797:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:0.0:1789366517.622555:0:5797:0:(genops.c:413:class_newdev()) Allocate new device MDS (000000004fb0bcc0) 00000020:00000080:0.0:1789366517.622572:0:5797:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:1.0:1789366517.622666:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000008cfef116 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8cde4528-5832-4854-a387-4adacc3dd0ab:3283:1876286758715520:0@lo:250: 00000100:00100000:1.0:1789366517.622774:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789366517.622806:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286758715520 00000100:00100000:3.0:1789366517.622815:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286758715520 00000100:00100000:3.0:1789366517.622851:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789366517.622857:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000deb394d1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3283:x1876286758715520:12345-0@lo:250: 00010000:00080000:3.0:1789366517.622880:0:5808:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from 8cde4528-5832-4854-a387-4adacc3dd0ab@0@lo t0 exp 0000000000000000 cur 93 last 0 00000020:00000080:3.0:1789366517.622899:0:5808:0:(genops.c:1385:class_connect()) connect: client 8cde4528-5832-4854-a387-4adacc3dd0ab, cookie 0x8da3486b955f2d74 00000100:00080000:3.0:1789366517.623025:0:5808:0:(import.c:65:import_set_state_nolock()) 00000000648c34bc : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789366517.623093:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000deb394d1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8cde4528-5832-4854-a387-4adacc3dd0ab+5:3283:x1876286758715520:12345-0@lo:250: Request processed in 235us (318us total) trans 0 rc 0/0 00000100:00100000:3.0:1789366517.623100:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789366517.623123:0:3283:0:(client.c:3126:ptlrpc_free_committed()) MGC192.168.202.123@tcp: committing for last_committed 0 gen 1 00000100:00080000:1.0:1789366517.623130:0:3283:0:(import.c:1177:ptlrpc_connect_interpret()) MGC192.168.202.123@tcp: connect to target with instance 0 00000100:00080000:1.0:1789366517.623135:0:3283:0:(import.c:1001:ptlrpc_connect_set_flags()) MGC192.168.202.123@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:1.0:1789366517.623151:0:3283:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:1.0:1789366517.623164:0:3283:0:(import.c:65:import_set_state_nolock()) 00000000c606c397 MGS: changing import state from CONNECTING to FULL 10000000:01000000:1.0:1789366517.623167:0:3283:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:1.0:1789366517.623176:0:3283:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:1.0:1789366517.623187:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000008cfef116 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8cde4528-5832-4854-a387-4adacc3dd0ab:3283:1876286758715520:0@lo:250: 00010000:00010000:0.0:1789366517.623833:0:5805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789366517.628447:0:5797:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1789366517.628657:0:5797:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:0.0:1789366517.628661:0:5797:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:0.0:1789366517.629234:0:5797:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:0.0:1789366517.629242:0:5797:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:0.0:1789366517.629573:0:5797:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:0.0:1789366517.629579:0:5797:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:0.0:1789366517.630182:0:5797:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1789366517.630295:0:5797:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:0.0:1789366517.630301:0:5797:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:0.0:1789366517.630623:0:5797:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:0.0:1789366517.630628:0:5797:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:0.0:1789366517.650166:0:5797:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1789366517.650354:0:5797:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:0.0:1789366517.650360:0:5797:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:0.0:1789366517.651190:0:5797:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:0.0:1789366517.651196:0:5797:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:0.0:1789366517.651809:0:5797:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1789366517.651954:0:5797:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:0.0:1789366517.651959:0:5797:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:0.0:1789366517.652286:0:5797:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:0.0:1789366517.652300:0:5797:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:0.0:1789366517.652960:0:5797:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1789366517.653100:0:5797:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:0.0:1789366517.653105:0:5797:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:0.0:1789366517.653423:0:5797:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:0.0:1789366517.653429:0:5797:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:0.0:1789366517.654085:0:5797:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1789366517.654205:0:5797:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:0.0:1789366517.654209:0:5797:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:0.0:1789366517.654843:0:5797:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:0.0:1789366517.654850:0:5797:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:0.0:1789366517.668037:0:5797:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1789366517.668250:0:5797:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:0.0:1789366517.668256:0:5797:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:0.0:1789366517.669772:0:5797:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:0.0:1789366517.669779:0:5797:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:0.0:1789366517.670193:0:5797:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:0.0:1789366517.670202:0:5797:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:0.0:1789366517.671133:0:5797:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:0.0:1789366517.671152:0:5797:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-mdt1/mdt1 10000000:01000000:0.0:1789366517.671157:0:5797:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.123@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:0.0:1789366517.671276:0:5797:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.123@tcp ctxt 0 is initialized 00000020:01000004:0.0:1789366517.671307:0:5797:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.202.123@tcp, index=0000, flags=0x20065 00000020:01000004:0.0:1789366517.671310:0:5797:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1789366517.671311:0:5797:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1789366517.671312:0:5797:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789366517.671313:0:5797:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789366517.671314:0:5797:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789366517.671315:0:5797:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789366517.671316:0:5797:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1789366517.671317:0:5797:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1789366517.671317:0:5797:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1789366517.671318:0:5797:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1789366517.671319:0:5797:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789366517.671320:0:5797:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1789366517.671321:0:5797:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020065 00000020:01000004:0.0:1789366517.671323:0:5797:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1789366517.671323:0:5797:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1789366517.671324:0:5797:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789366517.671324:0:5797:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789366517.671325:0:5797:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789366517.671326:0:5797:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789366517.671326:0:5797:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1789366517.671327:0:5797:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1789366517.671327:0:5797:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1789366517.671328:0:5797:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1789366517.671328:0:5797:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789366517.671329:0:5797:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1789366517.671356:0:5797:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:0.0:1789366517.671367:0:5797:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000dff04edc pname:cluuid:pid:xid:nid:opc:job mount.lustre:8cde4528-5832-4854-a387-4adacc3dd0ab:5797:1876286758715648:0@lo:253: 00000100:00100000:0.0:1789366517.671419:0:5797:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789366517.671469:0:5797:0:(client.c:2716:ptlrpc_set_wait()) set 0000000095a031cd going to sleep for 11 seconds 00000100:00100000:1.0:1789366517.671487:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286758715648 00000100:00100000:1.0:1789366517.671495:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286758715648 00000100:00100000:1.0:1789366517.671534:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789366517.671542:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c80f7b29 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8cde4528-5832-4854-a387-4adacc3dd0ab+5:5797:x1876286758715648:12345-0@lo:253: 20000000:01000000:1.0:1789366517.671577:0:5811:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1789366517.671580:0:5811:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 10000000:01000000:3.0:1789366517.671797:0:5831:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:1.0:1789366517.671816:0:5811:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 00000040:00080000:1.0:1789366517.672074:0:5811:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789366517.672787:0:5832:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 1 20000000:01000000:1.0:1789366517.672883:0:5811:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1789366517.672887:0:5811:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-MDT0000, index=0 20000000:01000000:1.0:1789366517.672891:0:5811:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-MDT0000 to 0 20000000:01000000:1.0:1789366517.672894:0:5811:0:(mgs_llog.c:3612:mgs_write_log_mdt()) writing new mdt lustre-MDT0000 20000000:01000000:1.0:1789366517.672906:0:5811:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-MDT0000-mdtlov) log for lustre-MDT0000 00000040:00080000:1.0:1789366517.673028:0:5811:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789366517.673194:0:5811:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 20000000:01000000:1.0:1789366517.673206:0:5811:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf001 lov lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:1.0:1789366517.673251:0:5811:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 136 off8552 00000040:00080000:1.0:1789366517.673294:0:5811:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 176 off8728 00000040:00080000:1.0:1789366517.673328:0:5811:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8952 00000040:00080000:1.0:1789366517.673408:0:5811:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9176 20000000:01000000:1.0:1789366517.673417:0:5811:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf001 mdt lustre-MDT0000_UUID (null) (null) 00000040:00080000:1.0:1789366517.673492:0:5811:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9296 20000000:01000000:1.0:1789366517.673502:0:5811:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-MDT0000 lustre-MDT0000-mdtlov (null) (null) 00000040:00080000:1.0:1789366517.673538:0:5811:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 112 off9408 20000000:01000000:1.0:1789366517.673545:0:5811:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf003 lustre-MDT0000_UUID 0 lustre-MDT0000-mdtlov f 00000040:00080000:1.0:1789366517.673575:0:5811:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 160 off9568 00000040:00080000:1.0:1789366517.673604:0:5811:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9792 00000040:00080000:1.0:1789366517.673621:0:5811:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:1.0:1789366517.673624:0:5811:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-clilov) log for lustre-client 00000040:00080000:1.0:1789366517.673631:0:5811:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789366517.673799:0:5811:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 20000000:01000000:1.0:1789366517.673807:0:5811:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf001 lov lustre-clilov_UUID (null) (null) 00000040:00080000:1.0:1789366517.673841:0:5811:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 120 off8536 00000040:00080000:1.0:1789366517.673867:0:5811:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 168 off8704 00000040:00080000:1.0:1789366517.673893:0:5811:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].4, 224 off8928 20000000:01000000:1.0:1789366517.673900:0:5811:0:(mgs_llog.c:3129:mgs_write_log_lmv()) Writing lmv(lustre-clilmv) log for lustre-client 00000040:00080000:1.0:1789366517.673941:0:5811:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].5, 224 off9152 20000000:01000000:1.0:1789366517.673946:0:5811:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf001 lmv lustre-clilmv_UUID (null) (null) 00000040:00080000:1.0:1789366517.673969:0:5811:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].6, 120 off9272 00000040:00080000:1.0:1789366517.673987:0:5811:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].7, 168 off9440 00000040:00080000:1.0:1789366517.674004:0:5811:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].8, 224 off9664 20000000:01000000:1.0:1789366517.674010:0:5811:0:(mgs_llog.c:3094:mgs_write_log_mount_opt()) Writing mount options log for lustre-client 00000040:00080000:1.0:1789366517.674096:0:5811:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].9, 224 off9888 20000000:01000000:1.0:1789366517.674106:0:5811:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-client lustre-clilov lustre-clilmv (null) 00000040:00080000:1.0:1789366517.674138:0:5811:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].10, 120 off10008 00000040:00080000:1.0:1789366517.674171:0:5811:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].11, 224 off10232 00000040:00080000:1.0:1789366517.674291:0:5811:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 20000000:01000000:1.0:1789366517.674331:0:5811:0:(mgs_llog.c:3309:mgs_write_log_mdc_to_lmv()) adding mdc for lustre-MDT0000 to log lustre-client:lmv(lustre-clilmv) 20000000:01000000:1.0:1789366517.674338:0:5811:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre-MDT0000/add mdc fl=4 00000040:00080000:3.0:1789366517.674634:0:5833:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 00000040:00080000:1.0:1789366517.674796:0:5811:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].12, 224 off10456 20000000:01000000:1.0:1789366517.674810:0:5811:0:(mgs_llog.c:3355:mgs_write_log_mdc_to_lmv()) add nid 192.168.202.123@tcp for mdt 20000000:01000000:1.0:1789366517.674812:0:5811:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.202.123@tcp (null) (null) (null) 00000040:00080000:1.0:1789366517.674846:0:5811:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].13, 88 off10544 20000000:01000000:1.0:1789366517.674853:0:5811:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf001 mdc lustre-clilmv_UUID (null) (null) 00000040:00080000:1.0:1789366517.674880:0:5811:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].14, 128 off10672 20000000:01000000:1.0:1789366517.674886:0:5811:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf003 lustre-MDT0000_UUID 192.168.202.123@tcp (null) (null) 00000040:00080000:1.0:1789366517.674929:0:5811:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].15, 144 off10816 20000000:01000000:1.0:1789366517.674939:0:5811:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf014 lustre-MDT0000_UUID 0 1 lustre-MDT0000-mdc_UUID 00000040:00080000:1.0:1789366517.674967:0:5811:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].16, 160 off10976 00000040:00080000:1.0:1789366517.674998:0:5811:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].17, 224 off11200 20000000:01000000:1.0:1789366517.675054:0:5811:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' sys.timeout=20 ', param: 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:1.0:1789366517.675062:0:5811:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:1.0:1789366517.675067:0:5811:0:(mgs_llog.c:5072:mgs_write_log_param()) mdt param identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity 20000000:01000000:1.0:1789366517.675071:0:5811:0:(mgs_llog.c:1379:mgs_modify_param()) modify lustre-MDT0000/lustre-MDT0000/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity del=0 00000040:00080000:2.0:1789366517.675353:0:5834:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 10 count 10 20000000:02000000:1.0:1789366517.675403:0:5811:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 00000040:00080000:1.0:1789366517.679000:0:5811:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 224 off10016 00000040:00080000:1.0:1789366517.679049:0:5811:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 160 off10176 00000040:00080000:1.0:1789366517.679100:0:5811:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10400 20000000:01000000:1.0:1789366517.679115:0:5811:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'sys.timeout=20' 20000000:01000000:1.0:1789366517.679118:0:5811:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:1.0:1789366517.679120:0:5811:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:1.0:1789366517.679132:0:5811:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:1.0:1789366517.679134:0:5811:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:1.0:1789366517.679161:0:5811:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:1.0:1789366517.679163:0:5811:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 00000040:00080000:3.0:1789366517.679525:0:5835:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 18 count 18 00000040:00080000:1.0:1789366517.679700:0:5811:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].18, 224 off11424 00000040:00080000:1.0:1789366517.679764:0:5811:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].19, 80 off11504 00000040:00080000:1.0:1789366517.679805:0:5811:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].20, 224 off11728 20000000:01000000:1.0:1789366517.679817:0:5811:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:1.0:1789366517.679819:0:5811:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 00000040:00080000:2.0:1789366517.680070:0:5836:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 13 count 13 00000040:00080000:1.0:1789366517.680188:0:5811:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 224 off10624 00000040:00080000:1.0:1789366517.680225:0:5811:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 80 off10704 00000040:00080000:1.0:1789366517.680274:0:5811:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 224 off10928 00000020:00000080:1.0:1789366517.680287:0:5811:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1789366517.680289:0:5811:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 100 to 20 10000000:01000000:1.0:1789366517.680295:0:5811:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:1.0:1789366517.680314:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000202a59de/0x8da3486b955f2d7b lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366517.680329:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000202a59de/0x8da3486b955f2d7b lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366517.680349:0:5811:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000202a59de/0x8da3486b955f2d7b lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366517.680355:0:5811:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000202a59de/0x8da3486b955f2d7b lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366517.680362:0:5811:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000202a59de/0x8da3486b955f2d7b lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366517.680368:0:5811:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000202a59de/0x8da3486b955f2d7b lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366517.680373:0:5811:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000202a59de already unused, calling callback (00000000da35d65f) 00010000:00010000:1.0:1789366517.680376:0:5811:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000202a59de/0x8da3486b955f2d7b lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366517.680383:0:5811:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000202a59de/0x8da3486b955f2d7b lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366517.680394:0:5811:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000202a59de/0x8da3486b955f2d7b lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366517.680402:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000202a59de/0x8da3486b955f2d7b lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366517.680407:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000202a59de/0x8da3486b955f2d7b lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1789366517.680423:0:5811:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:3.0:1789366517.756214:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c80f7b29 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8cde4528-5832-4854-a387-4adacc3dd0ab+5:5797:x1876286758715648:12345-0@lo:253: Request processed in 84666us (84786us total) trans 0 rc 0/0 00000100:00100000:3.0:1789366517.756231:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789366517.756252:0:5797:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000dff04edc pname:cluuid:pid:xid:nid:opc:job mount.lustre:8cde4528-5832-4854-a387-4adacc3dd0ab:5797:1876286758715648:0@lo:253: 10000000:01000000:0.0:1789366517.756273:0:5797:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:0.0:1789366517.756275:0:5797:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1789366517.756276:0:5797:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1789366517.756277:0:5797:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789366517.756278:0:5797:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-MDT0000_UUID 00000020:01000004:0.0:1789366517.756279:0:5797:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789366517.756285:0:5797:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789366517.756286:0:5797:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1789366517.756287:0:5797:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1789366517.756288:0:5797:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:0.0:1789366517.756289:0:5797:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789366517.756289:0:5797:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1789366517.756306:0:5797:0:(tgt_mount.c:101:server_register_mount()) register mount 000000007986c6c2 from lustre-MDT0000 10000000:01000000:0.0:1789366517.756341:0:5797:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:0.0:1789366517.756343:0:5797:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:0.0:1789366517.756346:0:5797:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff963882f5cd40 10000000:01000000:0.0:1789366517.756350:0:5797:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1789366517.756355:0:5797:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff963882f5cd40 from 1 10000000:01000000:0.0:1789366517.756357:0:5797:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1789366517.756385:0:5797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.123@tcp lock: 00000000abbd3006/0x8da3486b955f2d82 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366517.756394:0:5797:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.123@tcp lock: 00000000abbd3006/0x8da3486b955f2d82 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366517.756400:0:5797:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.123@tcp lock: 00000000abbd3006/0x8da3486b955f2d82 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789366517.756418:0:5797:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000dff04edc pname:cluuid:pid:xid:nid:opc:job mount.lustre:8cde4528-5832-4854-a387-4adacc3dd0ab:5797:1876286758715776:0@lo:101: 00000100:00100000:0.0:1789366517.756476:0:5797:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789366517.756524:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286758715776 00000100:00100000:3.0:1789366517.756531:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286758715776 00000100:00100000:0.0:1789366517.756537:0:5797:0:(client.c:2716:ptlrpc_set_wait()) set 00000000d3623e49 going to sleep for 11 seconds 00000100:00100000:3.0:1789366517.756583:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789366517.756594:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000008569335a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8cde4528-5832-4854-a387-4adacc3dd0ab+5:5797:x1876286758715776:12345-0@lo:101: 00010000:00010000:3.0:1789366517.756607:0:5810:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789366517.756620:0:5810:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000007d2ed126/0x8da3486b955f2d89 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x8da3486b955f2d82 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366517.756641:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000007d2ed126/0x8da3486b955f2d89 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8da3486b955f2d82 expref: 6 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366517.756651:0:5810:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000007d2ed126/0x8da3486b955f2d89 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8da3486b955f2d82 expref: 6 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366517.756660:0:5810:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000007d2ed126, rc 0) 00000100:00100000:3.0:1789366517.756692:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000008569335a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8cde4528-5832-4854-a387-4adacc3dd0ab+6:5797:x1876286758715776:12345-0@lo:101: Request processed in 102us (216us total) trans 0 rc 0/0 00000100:00100000:3.0:1789366517.756698:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1789366517.756745:0:5797:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000dff04edc pname:cluuid:pid:xid:nid:opc:job mount.lustre:8cde4528-5832-4854-a387-4adacc3dd0ab:5797:1876286758715776:0@lo:101: 00010000:00010000:0.0:1789366517.756759:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.123@tcp lock: 00000000abbd3006/0x8da3486b955f2d82 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8da3486b955f2d89 expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366517.756767:0:5797:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.123@tcp lock: 00000000abbd3006/0x8da3486b955f2d82 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x8da3486b955f2d89 expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789366517.756826:0:5797:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000dff04edc pname:cluuid:pid:xid:nid:opc:job mount.lustre:8cde4528-5832-4854-a387-4adacc3dd0ab:5797:1876286758715904:0@lo:501: 00000100:00100000:0.0:1789366517.756850:0:5797:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789366517.756874:0:5797:0:(client.c:2716:ptlrpc_set_wait()) set 00000000d3623e49 going to sleep for 11 seconds 00000100:00100000:3.0:1789366517.756894:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286758715904 00000100:00100000:3.0:1789366517.756899:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286758715904 00000100:00100000:3.0:1789366517.756924:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1789366517.756930:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000296bde87 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8cde4528-5832-4854-a387-4adacc3dd0ab+6:5797:x1876286758715904:12345-0@lo:501: 00000100:00100000:3.0:1789366517.757118:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000296bde87 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8cde4528-5832-4854-a387-4adacc3dd0ab+6:5797:x1876286758715904:12345-0@lo:501: Request processed in 188us (266us total) trans 0 rc -2/-2 00000100:00100000:3.0:1789366517.757131:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1789366517.757145:0:5797:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000dff04edc pname:cluuid:pid:xid:nid:opc:job mount.lustre:8cde4528-5832-4854-a387-4adacc3dd0ab:5797:1876286758715904:0@lo:501: 10000000:01000000:0.0:1789366517.757171:0:5797:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.123@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1789366517.757184:0:5797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.123@tcp lock: 00000000abbd3006/0x8da3486b955f2d82 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8da3486b955f2d89 expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366517.757191:0:5797:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.123@tcp lock: 00000000abbd3006/0x8da3486b955f2d82 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8da3486b955f2d89 expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789366517.757197:0:5797:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff963884956000 10000000:01000000:0.0:1789366517.757201:0:5797:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1789366517.757205:0:5797:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff963884956000 10000000:01000000:0.0:1789366517.757208:0:5797:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:0.0:1789366517.757211:0:5797:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff963884956000 from 1 10000000:01000000:0.0:1789366517.757213:0:5797:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:0.0:1789366517.757226:0:5797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.123@tcp lock: 00000000dd131aef/0x8da3486b955f2d90 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366517.757232:0:5797:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.123@tcp lock: 00000000dd131aef/0x8da3486b955f2d90 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366517.757238:0:5797:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.123@tcp lock: 00000000dd131aef/0x8da3486b955f2d90 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789366517.757248:0:5797:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000dff04edc pname:cluuid:pid:xid:nid:opc:job mount.lustre:8cde4528-5832-4854-a387-4adacc3dd0ab:5797:1876286758716032:0@lo:101: 00000100:00100000:0.0:1789366517.757278:0:5797:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789366517.757295:0:5797:0:(client.c:2716:ptlrpc_set_wait()) set 00000000d3623e49 going to sleep for 11 seconds 00000100:00100000:3.0:1789366517.757320:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286758716032 00000100:00100000:3.0:1789366517.757325:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286758716032 00000100:00100000:3.0:1789366517.757364:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1789366517.757372:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000002fb3df47 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8cde4528-5832-4854-a387-4adacc3dd0ab+6:5797:x1876286758716032:12345-0@lo:101: 00010000:00010000:3.0:1789366517.757379:0:5810:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789366517.757387:0:5810:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000d1e6088a/0x8da3486b955f2d97 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x8da3486b955f2d90 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366517.757399:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000d1e6088a/0x8da3486b955f2d97 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8da3486b955f2d90 expref: 7 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366517.757407:0:5810:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000d1e6088a/0x8da3486b955f2d97 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8da3486b955f2d90 expref: 7 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366517.757413:0:5810:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000d1e6088a, rc 0) 00000100:00100000:3.0:1789366517.757473:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000002fb3df47 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8cde4528-5832-4854-a387-4adacc3dd0ab+7:5797:x1876286758716032:12345-0@lo:101: Request processed in 103us (194us total) trans 0 rc 0/0 00000100:00100000:3.0:1789366517.757478:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1789366517.757509:0:5797:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000dff04edc pname:cluuid:pid:xid:nid:opc:job mount.lustre:8cde4528-5832-4854-a387-4adacc3dd0ab:5797:1876286758716032:0@lo:101: 00010000:00010000:0.0:1789366517.757520:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.123@tcp lock: 00000000dd131aef/0x8da3486b955f2d90 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8da3486b955f2d97 expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366517.757527:0:5797:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.123@tcp lock: 00000000dd131aef/0x8da3486b955f2d90 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x8da3486b955f2d97 expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789366517.757534:0:5797:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.123@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:0.0:1789366517.757544:0:5797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.123@tcp lock: 00000000dd131aef/0x8da3486b955f2d90 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8da3486b955f2d97 expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366517.757548:0:5797:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.123@tcp lock: 00000000dd131aef/0x8da3486b955f2d90 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8da3486b955f2d97 expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789366517.757551:0:5797:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:0.0:1789366517.757554:0:5797:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1789366517.757556:0:5797:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff963884956000 10000000:01000000:0.0:1789366517.757558:0:5797:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:0.0:1789366517.757559:0:5797:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:0.0:1789366517.757561:0:5797:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:0.0:1789366517.757571:0:5797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.123@tcp lock: 00000000525fbea8/0x8da3486b955f2d9e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366517.757576:0:5797:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.123@tcp lock: 00000000525fbea8/0x8da3486b955f2d9e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366517.757582:0:5797:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.123@tcp lock: 00000000525fbea8/0x8da3486b955f2d9e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789366517.757598:0:5797:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000dff04edc pname:cluuid:pid:xid:nid:opc:job mount.lustre:8cde4528-5832-4854-a387-4adacc3dd0ab:5797:1876286758716160:0@lo:101: 00000100:00100000:0.0:1789366517.757627:0:5797:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789366517.757645:0:5797:0:(client.c:2716:ptlrpc_set_wait()) set 00000000d3623e49 going to sleep for 11 seconds 00000100:00100000:3.0:1789366517.757669:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286758716160 00000100:00100000:3.0:1789366517.757674:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286758716160 00000100:00100000:3.0:1789366517.757700:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1789366517.757706:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000cc5be55a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8cde4528-5832-4854-a387-4adacc3dd0ab+7:5797:x1876286758716160:12345-0@lo:101: 00010000:00010000:3.0:1789366517.757712:0:5811:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789366517.757738:0:5811:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000f88dcc59/0x8da3486b955f2da5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x8da3486b955f2d9e expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366517.757750:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000f88dcc59/0x8da3486b955f2da5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8da3486b955f2d9e expref: 8 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366517.757764:0:5811:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000f88dcc59/0x8da3486b955f2da5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8da3486b955f2d9e expref: 8 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366517.757769:0:5811:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000f88dcc59, rc 0) 00000100:00100000:3.0:1789366517.757798:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000cc5be55a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8cde4528-5832-4854-a387-4adacc3dd0ab+8:5797:x1876286758716160:12345-0@lo:101: Request processed in 94us (174us total) trans 0 rc 0/0 00000100:00100000:3.0:1789366517.757810:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1789366517.757842:0:5797:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000dff04edc pname:cluuid:pid:xid:nid:opc:job mount.lustre:8cde4528-5832-4854-a387-4adacc3dd0ab:5797:1876286758716160:0@lo:101: 00010000:00010000:0.0:1789366517.757850:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.123@tcp lock: 00000000525fbea8/0x8da3486b955f2d9e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8da3486b955f2da5 expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366517.757855:0:5797:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.123@tcp lock: 00000000525fbea8/0x8da3486b955f2d9e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x8da3486b955f2da5 expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789366517.757891:0:5797:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000dff04edc pname:cluuid:pid:xid:nid:opc:job mount.lustre:8cde4528-5832-4854-a387-4adacc3dd0ab:5797:1876286758716288:0@lo:501: 00000100:00100000:0.0:1789366517.757914:0:5797:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789366517.757940:0:5797:0:(client.c:2716:ptlrpc_set_wait()) set 00000000d3623e49 going to sleep for 11 seconds 00000100:00100000:3.0:1789366517.757943:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286758716288 00000100:00100000:3.0:1789366517.757948:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286758716288 00000100:00100000:3.0:1789366517.757975:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1789366517.757979:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000023a7e038 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8cde4528-5832-4854-a387-4adacc3dd0ab+8:5797:x1876286758716288:12345-0@lo:501: 00000100:00100000:3.0:1789366517.758113:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000023a7e038 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8cde4528-5832-4854-a387-4adacc3dd0ab+9:5797:x1876286758716288:12345-0@lo:501: Request processed in 134us (199us total) trans 0 rc 0/0 00000100:00100000:3.0:1789366517.758119:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1789366517.758148:0:5797:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000dff04edc pname:cluuid:pid:xid:nid:opc:job mount.lustre:8cde4528-5832-4854-a387-4adacc3dd0ab:5797:1876286758716288:0@lo:501: 00000100:00100000:0.0:1789366517.758174:0:5797:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000dff04edc pname:cluuid:pid:xid:nid:opc:job mount.lustre:8cde4528-5832-4854-a387-4adacc3dd0ab:5797:1876286758716416:0@lo:503: 00000100:00100000:0.0:1789366517.758210:0:5797:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789366517.758225:0:5797:0:(client.c:2716:ptlrpc_set_wait()) set 00000000d3623e49 going to sleep for 11 seconds 00000100:00100000:3.0:1789366517.758234:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286758716416 00000100:00100000:3.0:1789366517.758239:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286758716416 00000100:00100000:3.0:1789366517.758262:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1789366517.758266:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000005ae9843e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8cde4528-5832-4854-a387-4adacc3dd0ab+9:5797:x1876286758716416:12345-0@lo:503: 00000100:00100000:3.0:1789366517.758397:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000005ae9843e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8cde4528-5832-4854-a387-4adacc3dd0ab+9:5797:x1876286758716416:12345-0@lo:503: Request processed in 130us (187us total) trans 0 rc 0/0 00000100:00100000:3.0:1789366517.758401:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1789366517.758450:0:5797:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000dff04edc pname:cluuid:pid:xid:nid:opc:job mount.lustre:8cde4528-5832-4854-a387-4adacc3dd0ab:5797:1876286758716416:0@lo:503: 00000100:00100000:3.0:1789366517.758773:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000320aca5b pname:cluuid:pid:xid:nid:opc:job llog_process_th:8cde4528-5832-4854-a387-4adacc3dd0ab:5838:1876286758716544:0@lo:502: 00000100:00100000:3.0:1789366517.758809:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789366517.758836:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set 00000000a60c318d going to sleep for 11 seconds 00000100:00100000:0.0:1789366517.758844:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286758716544 00000100:00100000:0.0:1789366517.758850:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286758716544 00000100:00100000:0.0:1789366517.758883:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1789366517.758890:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b0687d0c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8cde4528-5832-4854-a387-4adacc3dd0ab+9:5838:x1876286758716544:12345-0@lo:502: 00000100:00100000:0.0:1789366517.759039:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b0687d0c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8cde4528-5832-4854-a387-4adacc3dd0ab+9:5838:x1876286758716544:12345-0@lo:502: Request processed in 148us (229us total) trans 0 rc 0/0 00000100:00100000:3.0:1789366517.759053:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000320aca5b pname:cluuid:pid:xid:nid:opc:job llog_process_th:8cde4528-5832-4854-a387-4adacc3dd0ab:5838:1876286758716544:0@lo:502: 00000100:00100000:0.0:1789366517.759054:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000020:01000000:3.0:1789366517.759089:0:5838:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789366517.759106:0:5838:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789366517.759108:0:5838:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:3.0:1789366517.759113:0:5838:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:3.0:1789366517.759115:0:5838:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1789366517.759126:0:5838:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (00000000bc3f4933) 00000020:00000080:3.0:1789366517.759142:0:5838:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:3.0:1789366517.759146:0:5838:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:3.0:1789366517.759211:0:5838:0:(osd_handler.c:1574:osd_obd_connect()) connect #2 00000020:00000080:3.0:1789366517.759217:0:5838:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x8da3486b955f2db3 00000020:00000080:3.0:1789366517.759444:0:5838:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:3.0:1789366517.759448:0:5838:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789366517.759465:0:5838:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789366517.759467:0:5838:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:3.0:1789366517.759470:0:5838:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789366517.759474:0:5838:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789366517.759475:0:5838:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:3.0:1789366517.759478:0:5838:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1789366517.759484:0:5838:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (00000000499973f7) 00000020:00000080:3.0:1789366517.759494:0:5838:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:3.0:1789366517.759498:0:5838:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:3.0:1789366517.759500:0:5838:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:3.0:1789366517.759502:0:5838:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:3.0:1789366517.759507:0:5838:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1789366517.759538:0:5838:0:(tgt_mount.c:153:server_get_mount()) get mount 000000007986c6c2 from lustre-MDT0000, refs=3 00000020:00000080:3.0:1789366517.759546:0:5838:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (000000003796bdfa) 00000020:00000080:3.0:1789366517.759551:0:5838:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:3.0:1789366517.759597:0:5838:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:3.0:1789366517.759602:0:5838:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x8da3486b955f2dc8 00000020:00000080:3.0:1789366517.759677:0:5838:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:3.0:1789366517.759681:0:5838:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:3.0:1789366517.759685:0:5838:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0x8da3486b955f2dcf 00080000:01000000:3.0:1789366517.759687:0:5838:0:(osd_handler.c:1574:osd_obd_connect()) connect #3 00000020:00000080:3.0:1789366517.759689:0:5838:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x8da3486b955f2dd6 00080000:10000000:3.0:1789366517.759964:0:5838:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/8/3) registered 40000000:02000000:3.0:1789366517.760084:0:5838:0:(fid_handler.c:560:seq_server_init()) ctl-lustre-MDT0000: No data found on store. Initialize space. 40000000:02000000:3.0:1789366517.762488:0:5838:0:(fid_handler.c:560:seq_server_init()) srv-lustre-MDT0000: No data found on store. Initialize space. 00010000:00010000:3.0:1789366517.802763:0:5838:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:02000400:3.0:1789366517.803050:0:5838:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-MDT0000: new disk, initializing 00000001:00000004:3.0:1789366517.804686:0:5838:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 0 00000001:00080000:3.0:1789366517.804885:0:5838:0:(tgt_lastrcvd.c:240:tgt_reply_header_write()) lustre-MDT0000: write reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:3.0:1789366517.817893:0:5838:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (0000000075596662) 00000020:00000080:3.0:1789366517.817918:0:5838:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:3.0:1789366517.817995:0:5838:0:(osd_handler.c:1574:osd_obd_connect()) connect #4 00000020:00000080:3.0:1789366517.818003:0:5838:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x8da3486b955f2de4 00000020:00000080:3.0:1789366517.818382:0:5838:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00080000:10000000:3.0:1789366517.819967:0:5838:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/8/4) registered 00080000:10000000:3.0:1789366517.838338:0:5838:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/8/4) registered 00080000:10000000:3.0:1789366517.849913:0:5838:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/8/4) registered 00080000:10000000:3.0:1789366517.863037:0:5838:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/8/4) registered 00080000:10000000:3.0:1789366517.876043:0:5838:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/8/4) registered 00080000:10000000:1.0:1789366517.887396:0:5838:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/8/4) registered 00000020:00000080:0.0:1789366517.895492:0:5838:0:(genops.c:1385:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0x8da3486b955f2deb 00000020:00000080:0.0:1789366517.895787:0:5838:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:0.0:1789366517.895796:0:5838:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789366517.895802:0:5838:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789366517.895804:0:5838:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:0.0:1789366517.895806:0:5838:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789366517.895812:0:5838:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789366517.895813:0:5838:0:(obd_config.c:1563:class_process_config()) marker 8 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:0.0:1789366517.895816:0:5838:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:0.0:1789366517.895838:0:5838:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:0.0:1789366517.895846:0:5838:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789366517.895847:0:5838:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789366517.895848:0:5838:0:(obd_config.c:1563:class_process_config()) marker 8 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:0.0:1789366517.895850:0:5838:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789366517.895851:0:5838:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789366517.895852:0:5838:0:(obd_config.c:1563:class_process_config()) marker 10 (0x1) lustre sys.timeout 00000020:00000080:0.0:1789366517.895853:0:5838:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1789366517.895854:0:5838:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:0.0:1789366517.895887:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000dff04edc pname:cluuid:pid:xid:nid:opc:job llog_process_th:8cde4528-5832-4854-a387-4adacc3dd0ab:5838:1876286758716672:0@lo:502: 00000100:00100000:0.0:1789366517.895944:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789366517.895979:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286758716672 00000100:00100000:3.0:1789366517.895987:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286758716672 00000100:00100000:0.0:1789366517.895996:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set 0000000075720fc8 going to sleep for 11 seconds 00000100:00100000:3.0:1789366517.896023:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1789366517.896032:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000008cfdbb16 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8cde4528-5832-4854-a387-4adacc3dd0ab+9:5838:x1876286758716672:12345-0@lo:502: 00000100:00100000:3.0:1789366517.896232:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000008cfdbb16 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8cde4528-5832-4854-a387-4adacc3dd0ab+9:5838:x1876286758716672:12345-0@lo:502: Request processed in 202us (287us total) trans 0 rc 0/0 00000100:00100000:3.0:1789366517.896240:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1789366517.896265:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000dff04edc pname:cluuid:pid:xid:nid:opc:job llog_process_th:8cde4528-5832-4854-a387-4adacc3dd0ab:5838:1876286758716672:0@lo:502: 00000020:01000000:0.0:1789366517.896289:0:5838:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789366517.896292:0:5838:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789366517.896294:0:5838:0:(obd_config.c:1563:class_process_config()) marker 10 (0x2) lustre sys.timeout 00000040:00080000:0.0:1789366517.896296:0:5838:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 16 count 16 00000020:01000000:2.0:1789366517.896381:0:5797:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-15 (rc=0) 10000000:01000000:2.0:1789366517.896400:0:5797:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.123@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:2.0:1789366517.896421:0:5797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.123@tcp lock: 00000000525fbea8/0x8da3486b955f2d9e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8da3486b955f2da5 expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366517.896430:0:5797:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.123@tcp lock: 00000000525fbea8/0x8da3486b955f2d9e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8da3486b955f2da5 expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789366517.896435:0:5797:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff963884956000 from 1 10000000:01000000:2.0:1789366517.896437:0:5797:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1789366517.896475:0:5797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.123@tcp lock: 0000000075487c5f/0x8da3486b955f2df2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366517.896481:0:5797:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.123@tcp lock: 0000000075487c5f/0x8da3486b955f2df2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366517.896486:0:5797:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.123@tcp lock: 0000000075487c5f/0x8da3486b955f2df2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789366517.896494:0:5797:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000050206809 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8cde4528-5832-4854-a387-4adacc3dd0ab:5797:1876286758716800:0@lo:101: 00000100:00100000:2.0:1789366517.896515:0:5797:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789366517.896527:0:5797:0:(client.c:2716:ptlrpc_set_wait()) set 00000000fc4ea499 going to sleep for 11 seconds 00000100:00100000:0.0:1789366517.896542:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286758716800 00000100:00100000:0.0:1789366517.896546:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286758716800 00000100:00100000:0.0:1789366517.896570:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1789366517.896585:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000006e6797b2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8cde4528-5832-4854-a387-4adacc3dd0ab+9:5797:x1876286758716800:12345-0@lo:101: 00010000:00010000:0.0:1789366517.896594:0:5810:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789366517.896605:0:5810:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000000ad3983e/0x8da3486b955f2df9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x8da3486b955f2df2 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366517.896622:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000000ad3983e/0x8da3486b955f2df9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8da3486b955f2df2 expref: 10 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366517.896631:0:5810:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000000ad3983e/0x8da3486b955f2df9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8da3486b955f2df2 expref: 10 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366517.896639:0:5810:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000000ad3983e, rc 0) 00000100:00100000:0.0:1789366517.896668:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000006e6797b2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8cde4528-5832-4854-a387-4adacc3dd0ab+10:5797:x1876286758716800:12345-0@lo:101: Request processed in 87us (152us total) trans 0 rc 0/0 00000100:00100000:0.0:1789366517.896672:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1789366517.896709:0:5797:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000050206809 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8cde4528-5832-4854-a387-4adacc3dd0ab:5797:1876286758716800:0@lo:101: 00010000:00010000:2.0:1789366517.896740:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.123@tcp lock: 0000000075487c5f/0x8da3486b955f2df2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8da3486b955f2df9 expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366517.896749:0:5797:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.123@tcp lock: 0000000075487c5f/0x8da3486b955f2df2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x8da3486b955f2df9 expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789366517.897196:0:5797:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000050206809 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8cde4528-5832-4854-a387-4adacc3dd0ab:5797:1876286758716928:0@lo:256: 00000100:00100000:2.0:1789366517.897227:0:5797:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789366517.897250:0:5797:0:(client.c:2716:ptlrpc_set_wait()) set 00000000fc4ea499 going to sleep for 11 seconds 00000100:00100000:3.0:1789366517.897277:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286758716928 00000100:00100000:3.0:1789366517.897282:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286758716928 00000100:00100000:3.0:1789366517.897315:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1789366517.897321:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000023af342d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8cde4528-5832-4854-a387-4adacc3dd0ab+10:5797:x1876286758716928:12345-0@lo:256: 20000000:01000000:3.0:1789366517.897336:0:5811:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:3.0:1789366517.897347:0:5811:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:3.0:1789366517.897419:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000023af342d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8cde4528-5832-4854-a387-4adacc3dd0ab+10:5797:x1876286758716928:12345-0@lo:256: Request processed in 98us (191us total) trans 0 rc 0/0 00000100:00100000:2.0:1789366517.897427:0:5797:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000050206809 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8cde4528-5832-4854-a387-4adacc3dd0ab:5797:1876286758716928:0@lo:256: 00000100:00100000:3.0:1789366517.897428:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 10000000:01000000:2.0:1789366517.897937:0:5797:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.123@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1789366517.897952:0:5797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.123@tcp lock: 0000000075487c5f/0x8da3486b955f2df2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8da3486b955f2df9 expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366517.897960:0:5797:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.123@tcp lock: 0000000075487c5f/0x8da3486b955f2df2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8da3486b955f2df9 expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789366517.897967:0:5797:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff963884956000 from 1 10000000:01000000:2.0:1789366517.897969:0:5797:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1789366517.897985:0:5797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.123@tcp lock: 000000001e88c36b/0x8da3486b955f2e00 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366517.897992:0:5797:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.123@tcp lock: 000000001e88c36b/0x8da3486b955f2e00 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366517.897997:0:5797:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.123@tcp lock: 000000001e88c36b/0x8da3486b955f2e00 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789366517.898005:0:5797:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000050206809 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8cde4528-5832-4854-a387-4adacc3dd0ab:5797:1876286758717056:0@lo:101: 00000100:00100000:2.0:1789366517.898023:0:5797:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789366517.898045:0:5797:0:(client.c:2716:ptlrpc_set_wait()) set 00000000fc4ea499 going to sleep for 11 seconds 00000100:00100000:0.0:1789366517.898053:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286758717056 00000100:00100000:0.0:1789366517.898057:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286758717056 00000100:00100000:0.0:1789366517.898082:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1789366517.898087:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000102fddc4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8cde4528-5832-4854-a387-4adacc3dd0ab+10:5797:x1876286758717056:12345-0@lo:101: 00010000:00010000:0.0:1789366517.898094:0:5810:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789366517.898102:0:5810:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000b10b48f6/0x8da3486b955f2e07 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x8da3486b955f2e00 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366517.898114:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000b10b48f6/0x8da3486b955f2e07 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8da3486b955f2e00 expref: 11 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366517.898122:0:5810:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000b10b48f6/0x8da3486b955f2e07 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8da3486b955f2e00 expref: 11 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366517.898128:0:5810:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000b10b48f6, rc 0) 00000100:00100000:0.0:1789366517.898167:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000102fddc4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8cde4528-5832-4854-a387-4adacc3dd0ab+11:5797:x1876286758717056:12345-0@lo:101: Request processed in 80us (142us total) trans 0 rc 0/0 00000100:00100000:0.0:1789366517.898173:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1789366517.898192:0:5797:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000050206809 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8cde4528-5832-4854-a387-4adacc3dd0ab:5797:1876286758717056:0@lo:101: 00010000:00010000:2.0:1789366517.898202:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.123@tcp lock: 000000001e88c36b/0x8da3486b955f2e00 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8da3486b955f2e07 expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366517.898212:0:5797:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.123@tcp lock: 000000001e88c36b/0x8da3486b955f2e00 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x8da3486b955f2e07 expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789366517.898241:0:5797:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000050206809 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8cde4528-5832-4854-a387-4adacc3dd0ab:5797:1876286758717184:0@lo:501: 00000100:00100000:2.0:1789366517.898257:0:5797:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789366517.898272:0:5797:0:(client.c:2716:ptlrpc_set_wait()) set 00000000fc4ea499 going to sleep for 11 seconds 00000100:00100000:3.0:1789366517.898294:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286758717184 00000100:00100000:3.0:1789366517.898298:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286758717184 00000100:00100000:3.0:1789366517.898326:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1789366517.898331:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000033ee2e1f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8cde4528-5832-4854-a387-4adacc3dd0ab+11:5797:x1876286758717184:12345-0@lo:501: 00000100:00100000:3.0:1789366517.898820:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000033ee2e1f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8cde4528-5832-4854-a387-4adacc3dd0ab+11:5797:x1876286758717184:12345-0@lo:501: Request processed in 488us (561us total) trans 0 rc 0/0 00000100:00100000:3.0:1789366517.898827:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1789366517.898871:0:5797:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000050206809 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8cde4528-5832-4854-a387-4adacc3dd0ab:5797:1876286758717184:0@lo:501: 00000100:00100000:2.0:1789366517.898901:0:5797:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000050206809 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8cde4528-5832-4854-a387-4adacc3dd0ab:5797:1876286758717312:0@lo:503: 00000100:00100000:2.0:1789366517.898936:0:5797:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789366517.898960:0:5797:0:(client.c:2716:ptlrpc_set_wait()) set 00000000fc4ea499 going to sleep for 11 seconds 00000100:00100000:0.0:1789366517.898969:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286758717312 00000100:00100000:0.0:1789366517.898974:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286758717312 00000100:00100000:0.0:1789366517.899011:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1789366517.899017:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000005340385c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8cde4528-5832-4854-a387-4adacc3dd0ab+11:5797:x1876286758717312:12345-0@lo:503: 00000040:00080000:0.0:1789366517.899048:0:5810:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1789366517.899079:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000005340385c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8cde4528-5832-4854-a387-4adacc3dd0ab+11:5797:x1876286758717312:12345-0@lo:503: Request processed in 64us (144us total) trans 0 rc 0/0 00000100:00100000:0.0:1789366517.899084:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1789366517.899112:0:5797:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000050206809 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8cde4528-5832-4854-a387-4adacc3dd0ab:5797:1876286758717312:0@lo:503: 00000040:00080000:3.0:1789366517.899913:0:5842:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 1 00000020:01000000:2.0:1789366517.899968:0:5797:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-0 (rc=0) 10000000:01000000:2.0:1789366517.899984:0:5797:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.123@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1789366517.899992:0:5797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.123@tcp lock: 000000001e88c36b/0x8da3486b955f2e00 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8da3486b955f2e07 expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366517.899998:0:5797:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.123@tcp lock: 000000001e88c36b/0x8da3486b955f2e00 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8da3486b955f2e07 expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789366517.900023:0:5797:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1789366517.900025:0:5797:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff963884956000 10000000:01000000:2.0:1789366517.900027:0:5797:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff963884956000 10000000:01000000:2.0:1789366517.900030:0:5797:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1789366517.900032:0:5797:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff963884956000 from 1 10000000:01000000:2.0:1789366517.900034:0:5797:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1789366517.900044:0:5797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.123@tcp lock: 000000008652970c/0x8da3486b955f2e0e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366517.900053:0:5797:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.123@tcp lock: 000000008652970c/0x8da3486b955f2e0e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366517.900060:0:5797:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.123@tcp lock: 000000008652970c/0x8da3486b955f2e0e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789366517.900072:0:5797:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000050206809 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8cde4528-5832-4854-a387-4adacc3dd0ab:5797:1876286758717440:0@lo:101: 00000100:00100000:2.0:1789366517.900095:0:5797:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789366517.900118:0:5797:0:(client.c:2716:ptlrpc_set_wait()) set 00000000bcb56206 going to sleep for 11 seconds 00000100:00100000:3.0:1789366517.900129:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286758717440 00000100:00100000:3.0:1789366517.900136:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286758717440 00000100:00100000:3.0:1789366517.900163:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1789366517.900169:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e1c94c54 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8cde4528-5832-4854-a387-4adacc3dd0ab+11:5797:x1876286758717440:12345-0@lo:101: 00010000:00010000:3.0:1789366517.900177:0:5811:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789366517.900187:0:5811:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000069c6f4e7/0x8da3486b955f2e15 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x8da3486b955f2e0e expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366517.900201:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000069c6f4e7/0x8da3486b955f2e15 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8da3486b955f2e0e expref: 12 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366517.900209:0:5811:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000069c6f4e7/0x8da3486b955f2e15 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8da3486b955f2e0e expref: 12 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366517.900216:0:5811:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000069c6f4e7, rc 0) 00000100:00100000:3.0:1789366517.900250:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e1c94c54 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8cde4528-5832-4854-a387-4adacc3dd0ab+12:5797:x1876286758717440:12345-0@lo:101: Request processed in 81us (154us total) trans 0 rc 0/0 00000100:00100000:3.0:1789366517.900265:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1789366517.900267:0:5797:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000050206809 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8cde4528-5832-4854-a387-4adacc3dd0ab:5797:1876286758717440:0@lo:101: 00010000:00010000:2.0:1789366517.900278:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.123@tcp lock: 000000008652970c/0x8da3486b955f2e0e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x8da3486b955f2e15 expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366517.900283:0:5797:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.123@tcp lock: 000000008652970c/0x8da3486b955f2e0e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x8da3486b955f2e15 expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789366517.900307:0:5797:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000050206809 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8cde4528-5832-4854-a387-4adacc3dd0ab:5797:1876286758717568:0@lo:501: 00000100:00100000:2.0:1789366517.900323:0:5797:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789366517.900334:0:5797:0:(client.c:2716:ptlrpc_set_wait()) set 00000000bcb56206 going to sleep for 11 seconds 00000100:00100000:3.0:1789366517.900345:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286758717568 00000100:00100000:3.0:1789366517.900350:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286758717568 00000100:00100000:3.0:1789366517.900376:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1789366517.900382:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c8823d9a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8cde4528-5832-4854-a387-4adacc3dd0ab+12:5797:x1876286758717568:12345-0@lo:501: 00000100:00100000:3.0:1789366517.900528:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c8823d9a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8cde4528-5832-4854-a387-4adacc3dd0ab+12:5797:x1876286758717568:12345-0@lo:501: Request processed in 146us (203us total) trans 0 rc 0/0 00000100:00100000:3.0:1789366517.900536:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1789366517.900550:0:5797:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000050206809 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8cde4528-5832-4854-a387-4adacc3dd0ab:5797:1876286758717568:0@lo:501: 00000100:00100000:2.0:1789366517.900569:0:5797:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000050206809 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8cde4528-5832-4854-a387-4adacc3dd0ab:5797:1876286758717696:0@lo:503: 00000100:00100000:2.0:1789366517.900591:0:5797:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789366517.900601:0:5797:0:(client.c:2716:ptlrpc_set_wait()) set 00000000bcb56206 going to sleep for 11 seconds 00000100:00100000:3.0:1789366517.900611:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286758717696 00000100:00100000:3.0:1789366517.900617:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286758717696 00000100:00100000:3.0:1789366517.900643:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1789366517.900649:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000009568e665 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8cde4528-5832-4854-a387-4adacc3dd0ab+12:5797:x1876286758717696:12345-0@lo:503: 00000100:00100000:3.0:1789366517.900889:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000009568e665 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8cde4528-5832-4854-a387-4adacc3dd0ab+12:5797:x1876286758717696:12345-0@lo:503: Request processed in 239us (296us total) trans 0 rc 0/0 00000100:00100000:3.0:1789366517.900896:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1789366517.900920:0:5797:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000050206809 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8cde4528-5832-4854-a387-4adacc3dd0ab:5797:1876286758717696:0@lo:503: 00000100:00100000:2.0:1789366517.901109:0:5843:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000050206809 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8cde4528-5832-4854-a387-4adacc3dd0ab:5843:1876286758717824:0@lo:502: 00000100:00100000:2.0:1789366517.901141:0:5843:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789366517.901164:0:5843:0:(client.c:2716:ptlrpc_set_wait()) set 00000000a9d27f64 going to sleep for 11 seconds 00000100:00100000:3.0:1789366517.901174:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286758717824 00000100:00100000:3.0:1789366517.901179:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286758717824 00000100:00100000:3.0:1789366517.901204:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1789366517.901209:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000009a4d808f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8cde4528-5832-4854-a387-4adacc3dd0ab+12:5843:x1876286758717824:12345-0@lo:502: 00000100:00100000:3.0:1789366517.901376:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000009a4d808f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8cde4528-5832-4854-a387-4adacc3dd0ab+12:5843:x1876286758717824:12345-0@lo:502: Request processed in 167us (235us total) trans 0 rc 0/0 00000100:00100000:3.0:1789366517.901383:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1789366517.901405:0:5843:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000050206809 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8cde4528-5832-4854-a387-4adacc3dd0ab:5843:1876286758717824:0@lo:502: 00000020:01000004:2.0:1789366517.901468:0:5843:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:2.0:1789366517.901485:0:5843:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (0000000087f54b7b) 00000020:00000080:2.0:1789366517.901496:0:5843:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type lwp with refcount 2 00000020:01000004:2.0:1789366517.901553:0:5843:0:(tgt_mount.c:153:server_get_mount()) get mount 000000007986c6c2 from lustre-MDT0000, refs=4 00000020:01000004:2.0:1789366517.901556:0:5843:0:(tgt_mount.c:187:server_put_mount()) put mount 000000007986c6c2 from lustre-MDT0000, refs=4 00000020:01000004:2.0:1789366517.901557:0:5843:0:(obd_mount.c:710:lustre_put_lsi()) put 000000007986c6c2 4 00010000:00080000:2.0:1789366517.901577:0:5843:0:(ldlm_lib.c:102:import_set_conn()) imp 0000000027c6a049@lustre-MDT0000-lwp-MDT0000: add connection 192.168.202.123@tcp at head 00010000:00010000:2.0:1789366517.902991:0:5843:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-1 is initialized 00000020:00000080:2.0:1789366517.903171:0:5843:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:2.0:1789366517.903194:0:5843:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1789366517.903203:0:5843:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0x8da3486b955f2e23 00000100:00080000:2.0:1789366517.903210:0:5843:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1789366517.903217:0:5843:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 0000000027c6a049 using connection 192.168.202.123@tcp/0@lo 00000100:00100000:2.0:1789366517.903241:0:5843:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@0000000050206809 x1876286758717952/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1789366517.903264:0:5843:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:1.0:1789366517.903308:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000050206809 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3283:1876286758717952:0@lo:38: 00000100:00100000:1.0:1789366517.903373:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789366517.903406:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286758717952 00000100:00100000:2.0:1789366517.903412:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286758717952 00000100:00100000:2.0:1789366517.903441:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789366517.903447:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000005639dbdc pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3283:x1876286758717952:12345-0@lo:38: 00000100:00100000:2.0:1789366517.903513:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000005639dbdc pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3283:x1876286758717952:12345-0@lo:38: Request processed in 65us (142us total) trans 0 rc -11/-11 00000100:00100000:2.0:1789366517.903520:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789366517.903544:0:3283:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1789366517.903552:0:3283:0:(import.c:65:import_set_state_nolock()) 0000000027c6a049 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1789366517.903556:0:3283:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:1.0:1789366517.903561:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000050206809 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3283:1876286758717952:0@lo:38: 00000100:00100000:2.0:1789366517.903594:0:5843:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000008c20fb6a pname:cluuid:pid:xid:nid:opc:job llog_process_th:8cde4528-5832-4854-a387-4adacc3dd0ab:5843:1876286758718080:0@lo:502: 00000100:00100000:2.0:1789366517.903667:0:5843:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789366517.903688:0:5843:0:(client.c:2716:ptlrpc_set_wait()) set 000000007827f08a going to sleep for 11 seconds 00000100:00100000:3.0:1789366517.903707:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286758718080 00000100:00100000:3.0:1789366517.903712:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286758718080 00000100:00100000:3.0:1789366517.903758:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1789366517.903763:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000009e8cd30d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8cde4528-5832-4854-a387-4adacc3dd0ab+12:5843:x1876286758718080:12345-0@lo:502: 00000100:00100000:3.0:1789366517.903953:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000009e8cd30d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8cde4528-5832-4854-a387-4adacc3dd0ab+12:5843:x1876286758718080:12345-0@lo:502: Request processed in 190us (286us total) trans 0 rc 0/0 00000100:00100000:3.0:1789366517.903960:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1789366517.903990:0:5843:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000008c20fb6a pname:cluuid:pid:xid:nid:opc:job llog_process_th:8cde4528-5832-4854-a387-4adacc3dd0ab:5843:1876286758718080:0@lo:502: 00000040:00080000:2.0:1789366517.904013:0:5843:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 21 count 21 00000020:01000000:1.0:1789366517.904081:0:5797:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-20 (rc=0) 10000000:01000000:1.0:1789366517.904099:0:5797:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.123@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1789366517.904114:0:5797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.123@tcp lock: 000000008652970c/0x8da3486b955f2e0e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x8da3486b955f2e15 expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366517.904124:0:5797:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.123@tcp lock: 000000008652970c/0x8da3486b955f2e0e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x8da3486b955f2e15 expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1789366517.904165:0:5797:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1789366517.904167:0:5797:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1789366517.904169:0:5797:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789366517.904170:0:5797:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789366517.904171:0:5797:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789366517.904173:0:5797:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789366517.904174:0:5797:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1789366517.904176:0:5797:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1789366517.904178:0:5797:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1789366517.904179:0:5797:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1789366517.904181:0:5797:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789366517.904183:0:5797:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1789366517.904186:0:5797:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020065 00000020:01000004:1.0:1789366517.904188:0:5797:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1789366517.904189:0:5797:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1789366517.904190:0:5797:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789366517.904191:0:5797:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789366517.904193:0:5797:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789366517.904194:0:5797:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789366517.904195:0:5797:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1789366517.904196:0:5797:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1789366517.904203:0:5797:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1789366517.904204:0:5797:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1789366517.904205:0:5797:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789366517.904205:0:5797:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1789366517.904219:0:5797:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:1.0:1789366517.904228:0:5797:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000004d3f2795 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8cde4528-5832-4854-a387-4adacc3dd0ab:5797:1876286758718208:0@lo:253: 00000100:00100000:1.0:1789366517.904264:0:5797:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789366517.904291:0:5797:0:(client.c:2716:ptlrpc_set_wait()) set 000000001783c054 going to sleep for 11 seconds 00000100:00100000:3.0:1789366517.904306:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286758718208 00000100:00100000:3.0:1789366517.904312:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286758718208 00000100:00100000:3.0:1789366517.904349:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1789366517.904357:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000006e739a20 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8cde4528-5832-4854-a387-4adacc3dd0ab+12:5797:x1876286758718208:12345-0@lo:253: 20000000:01000000:3.0:1789366517.904374:0:5808:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:3.0:1789366517.904384:0:5808:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:0.0:1789366517.915237:0:5808:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1789366517.915252:0:5808:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:3.0:1789366517.915261:0:5831:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1789366517.915267:0:5831:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1789366517.915284:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000361878ce/0x8da3486b955f2e2a lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366517.915301:0:5831:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 000000000ad3983e/0x8da3486b955f2df9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8da3486b955f2df2 expref: 12 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366517.915309:0:5831:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 00000000361878ce/0x8da3486b955f2e2a lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366517.915348:0:5831:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 000000000ad3983e/0x8da3486b955f2df9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x8da3486b955f2df2 expref: 12 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366517.915364:0:5831:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 000000000ad3983e/0x8da3486b955f2df9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x8da3486b955f2df2 expref: 12 pid: 5810 timeout: 243 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789366517.915379:0:5831:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000320aca5b pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5831:1876286758718336:0@lo:104: 00000100:00100000:3.0:1789366517.915444:0:5831:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789366517.915522:0:5831:0:(client.c:2716:ptlrpc_set_wait()) set 00000000940118fd going to sleep for 11 seconds 00000100:00100000:1.0:1789366517.915526:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286758718336 00000100:00100000:1.0:1789366517.915535:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286758718336 00000100:00100000:1.0:1789366517.915597:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789366517.915607:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000005a494b34 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8cde4528-5832-4854-a387-4adacc3dd0ab+3:5831:x1876286758718336:12345-0@lo:104: 00010000:00010000:1.0:1789366517.915618:0:5799:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.123@tcp lock: 0000000075487c5f/0x8da3486b955f2df2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x8da3486b955f2df9 expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366517.915679:0:5799:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1789366517.915684:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000005a494b34 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8cde4528-5832-4854-a387-4adacc3dd0ab+3:5831:x1876286758718336:12345-0@lo:104: Request processed in 81us (242us total) trans 0 rc 0/0 00000100:00100000:1.0:1789366517.915692:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789366517.915745:0:5831:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000320aca5b pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5831:1876286758718336:0@lo:104: 00010000:00010000:1.0:1789366517.915764:0:5831:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 00000000361878ce/0x8da3486b955f2e2a lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366517.915871:0:5804:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789366517.915877:0:5804:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.123@tcp lock: 0000000075487c5f/0x8da3486b955f2df2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x8da3486b955f2df9 expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366517.915885:0:5804:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000075487c5f already unused, calling callback (00000000dd0fdea0) 10000000:00010000:0.0:1789366517.915888:0:5804:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.123@tcp lock: 0000000075487c5f/0x8da3486b955f2df2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x8da3486b955f2df9 expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366517.915895:0:5804:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.123@tcp lock: 0000000075487c5f/0x8da3486b955f2df2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x8da3486b955f2df9 expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789366517.915901:0:5804:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.123@tcp lock: 0000000075487c5f/0x8da3486b955f2df2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x8da3486b955f2df9 expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789366517.915907:0:5804:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1789366517.915932:0:5804:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.123@tcp lock: 0000000075487c5f/0x8da3486b955f2df2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8da3486b955f2df9 expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366517.915948:0:5804:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789366517.915972:0:5804:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.123@tcp lock: 0000000075487c5f/0x8da3486b955f2df2 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8da3486b955f2df9 expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366517.915979:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.123@tcp lock: 0000000075487c5f/0x8da3486b955f2df2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8da3486b955f2df9 expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366517.915994:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789366517.915996:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789366517.915997:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789366517.916022:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000dff04edc pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8cde4528-5832-4854-a387-4adacc3dd0ab:3285:1876286758718464:0@lo:103: 00000100:00100000:3.0:1789366517.916064:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789366517.916162:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286758718464 00000100:00100000:0.0:1789366517.916167:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286758718464 00010000:00010000:0.0:1789366517.916184:0:5801:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 000000000ad3983e/0x8da3486b955f2df9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8da3486b955f2df2 expref: 13 pid: 5810 timeout: 243 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789366517.916210:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789366517.916218:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000000d74d654 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8cde4528-5832-4854-a387-4adacc3dd0ab+13:3285:x1876286758718464:12345-0@lo:103: 00010000:00010000:0.0:1789366517.916229:0:5801:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789366517.916233:0:5801:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 000000000ad3983e/0x8da3486b955f2df9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8da3486b955f2df2 expref: 13 pid: 5810 timeout: 243 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366517.916243:0:5801:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 000000000ad3983e/0x8da3486b955f2df9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x8da3486b955f2df2 expref: 13 pid: 5810 timeout: 243 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366517.916253:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000000ad3983e/0x8da3486b955f2df9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x8da3486b955f2df2 expref: 13 pid: 5810 timeout: 243 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366517.916264:0:5801:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 00000000361878ce/0x8da3486b955f2e2a lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366517.916282:0:5801:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000361878ce/0x8da3486b955f2e2a lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1789366517.916293:0:5801:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001027306s 00010000:00010000:0.0:1789366517.916296:0:5801:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000361878ce/0x8da3486b955f2e2a lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366517.916302:0:5801:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000361878ce/0x8da3486b955f2e2a lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366517.916308:0:5801:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000361878ce/0x8da3486b955f2e2a lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366517.916313:0:5801:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000361878ce/0x8da3486b955f2e2a lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366517.916318:0:5801:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000361878ce already unused, calling callback (00000000da35d65f) 00010000:00010000:0.0:1789366517.916322:0:5801:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000361878ce/0x8da3486b955f2e2a lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366517.916328:0:5801:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000361878ce/0x8da3486b955f2e2a lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366517.916344:0:5801:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000361878ce/0x8da3486b955f2e2a lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366517.916353:0:5801:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789366517.916365:0:5831:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 00000000361878ce/0x8da3486b955f2e2a lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366517.916374:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000361878ce/0x8da3486b955f2e2a lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366517.916379:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000361878ce/0x8da3486b955f2e2a lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789366517.916392:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000000d74d654 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8cde4528-5832-4854-a387-4adacc3dd0ab+12:3285:x1876286758718464:12345-0@lo:103: Request processed in 175us (328us total) trans 0 rc 0/0 00000100:00100000:0.0:1789366517.916402:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789366517.916479:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000dff04edc pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8cde4528-5832-4854-a387-4adacc3dd0ab:3285:1876286758718464:0@lo:103: 00000100:00100000:0.0:1789366517.918540:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000006e739a20 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8cde4528-5832-4854-a387-4adacc3dd0ab+11:5797:x1876286758718208:12345-0@lo:253: Request processed in 14181us (14273us total) trans 0 rc 0/0 00000100:00100000:1.0:1789366517.918563:0:5797:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000004d3f2795 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8cde4528-5832-4854-a387-4adacc3dd0ab:5797:1876286758718208:0@lo:253: 00000100:00100000:0.0:1789366517.918566:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 10000000:01000000:1.0:1789366517.918575:0:5797:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:1.0:1789366517.918578:0:5797:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1789366517.918580:0:5797:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1789366517.918581:0:5797:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789366517.918582:0:5797:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789366517.918583:0:5797:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789366517.918584:0:5797:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789366517.918585:0:5797:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1789366517.918587:0:5797:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1789366517.918588:0:5797:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1789366517.918589:0:5797:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1789366517.918590:0:5797:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789366517.918591:0:5797:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1789366517.918602:0:5797:0:(tgt_mount.c:2698:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:1.0:1789366517.921657:0:5797:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/8/4) registered 00080000:10000000:1.0:1789366517.922029:0:5797:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:1.0:1789366517.922169:0:5797:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00080000:10000000:1.0:1789366517.922312:0:5797:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:1.0:1789366517.922506:0:5797:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/8/4) registered 00080000:10000000:1.0:1789366517.922641:0:5797:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00080000:10000000:0.0:1789366517.923145:0:5797:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/8/4) registered 00080000:10000000:0.0:1789366517.923351:0:5797:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8/1) registered 00080000:10000000:0.0:1789366517.923542:0:5797:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/8/4) registered 00080000:10000000:0.0:1789366517.923692:0:5797:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8/1) registered 00080000:10000000:0.0:1789366517.923898:0:5797:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xf:0x0] (8/8/4) registered 00080000:10000000:0.0:1789366517.924018:0:5797:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8/1) registered 40000000:02000000:1.0:1789366517.935911:0:5797:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt 00000020:00080000:1.0:1789366517.949461:0:5848:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 0 00000020:00080000:1.0:1789366517.949466:0:5848:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000040:01000000:0.0:1789366517.949473:0:5797:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000040:01000000:0.0:1789366517.949674:0:5849:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:1.0:1789366517.952235:0:5797:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:1.0:1789366517.952558:0:5797:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:1.0:1789366517.953006:0:5797:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:1.0:1789366517.953048:0:5797:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:1.0:1789366517.953205:0:5797:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789366517.954181:0:5797:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:1.0:1789366517.954802:0:5797:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:1.0:1789366517.954840:0:5797:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:1.0:1789366517.955010:0:5797:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:1.0:1789366517.955163:0:5797:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x11:0x0] (8/8/4) registered 00100000:10000000:1.0:1789366517.956712:0:5797:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_00: rc = 0 00100000:10000000:1.0:1789366517.956900:0:5797:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_01: rc = 0 00100000:10000000:1.0:1789366517.957137:0:5797:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_02: rc = 0 00100000:10000000:1.0:1789366517.957361:0:5797:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_03: rc = 0 00100000:10000000:1.0:1789366517.957620:0:5797:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_04: rc = 0 00100000:10000000:1.0:1789366517.957856:0:5797:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_05: rc = 0 00100000:10000000:1.0:1789366517.958119:0:5797:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_06: rc = 0 00100000:10000000:1.0:1789366517.958215:0:5797:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_07: rc = 0 00100000:10000000:1.0:1789366517.958464:0:5797:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_08: rc = 0 00100000:10000000:1.0:1789366517.958704:0:5797:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_09: rc = 0 00100000:10000000:1.0:1789366517.958990:0:5797:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_10: rc = 0 00100000:10000000:1.0:1789366517.959221:0:5797:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_11: rc = 0 00100000:10000000:1.0:1789366517.959466:0:5797:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_12: rc = 0 00100000:10000000:1.0:1789366517.959704:0:5797:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_13: rc = 0 00100000:10000000:1.0:1789366517.959944:0:5797:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_14: rc = 0 00100000:10000000:1.0:1789366517.960208:0:5797:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_15: rc = 0 00100000:10000000:1.0:1789366517.960633:0:5797:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_00: rc = 0 00100000:10000000:1.0:1789366517.960881:0:5797:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_01: rc = 0 00100000:10000000:1.0:1789366517.961122:0:5797:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_02: rc = 0 00100000:10000000:1.0:1789366517.961434:0:5797:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_03: rc = 0 00100000:10000000:1.0:1789366517.961679:0:5797:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_04: rc = 0 00100000:10000000:1.0:1789366517.961896:0:5797:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_05: rc = 0 00100000:10000000:1.0:1789366517.962101:0:5797:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_06: rc = 0 00100000:10000000:1.0:1789366517.962289:0:5797:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_07: rc = 0 00100000:10000000:1.0:1789366517.962542:0:5797:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_08: rc = 0 00000040:00080000:0.0:1789366517.962632:0:5849:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00100000:10000000:1.0:1789366517.962686:0:5797:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_09: rc = 0 00100000:10000000:1.0:1789366517.962867:0:5797:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_10: rc = 0 00100000:10000000:1.0:1789366517.963182:0:5797:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_11: rc = 0 00100000:10000000:1.0:1789366517.963349:0:5797:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_12: rc = 0 00100000:10000000:1.0:1789366517.963571:0:5797:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_13: rc = 0 00100000:10000000:1.0:1789366517.963810:0:5797:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_14: rc = 0 00100000:10000000:1.0:1789366517.964060:0:5797:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_15: rc = 0 00000001:00000004:1.0:1789366517.964362:0:5797:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000040:00080000:3.0:1789366517.979569:0:5849:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:3.0:1789366517.979621:0:5849:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00080000:3.0:1789366517.979624:0:5849:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00000001:00080000:3.0:1789366517.987335:0:5797:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:3.0:1789366517.987370:0:5797:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffa15081c6b988 00100000:10000000:3.0:1789366517.987377:0:5797:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:3.0:1789366517.987690:0:5797:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1789366517.987706:0:5797:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.123@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1789366517.987767:0:5797:0:(tgt_mount.c:2464:server_fill_super_common()) Server sb, dev=45 00000080:00000004:3.0:1789366517.987792:0:5797:0:(super25.c:182:lustre_fill_super()) lustre-mdt1/mdt1: Mount complete 00010000:00010000:0.0:1789366518.647930:0:5805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1789366519.427393:0:6091:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg223-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:2.0:1789366519.674226:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789366520.696135:0:5805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789366521.719886:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1789366521.933657:0:6292:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffe97819f80 20000000:00000080:0.0:1789366521.933676:0:6292:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9638bfe6a000 uarg=0000000000000000 20000000:01000000:0.0:1789366521.933871:0:6292:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:0.0:1789366521.933967:0:6292:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:0.0:1789366521.933972:0:6292:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:0.0:1789366521.934188:0:6292:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:02000000:0.0:1789366521.934199:0:6292:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Modifying parameter general.debug_raw_pointers=Y in log params 00000040:00080000:0.0:1789366521.936622:0:6292:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1789366521.936926:0:6292:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:0.0:1789366521.936990:0:6292:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 112 off8528 00000040:00080000:0.0:1789366521.937033:0:6292:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 224 off8752 10000000:01000000:0.0:1789366521.937048:0:6292:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1789366521.937066:0:6292:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000b9a93f2d/0x8da3486b955f2e31 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366521.937099:0:6292:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000b10b48f6/0x8da3486b955f2e07 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8da3486b955f2e00 expref: 10 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366521.937108:0:6292:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 00000000b9a93f2d/0x8da3486b955f2e31 lrc: 4/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366521.937153:0:6292:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000b10b48f6/0x8da3486b955f2e07 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x8da3486b955f2e00 expref: 10 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366521.937165:0:6292:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000b10b48f6/0x8da3486b955f2e07 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x8da3486b955f2e00 expref: 10 pid: 5810 timeout: 247 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789366521.937178:0:6292:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000190b1ba6 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:6292:1876286758718592:0@lo:104: 00000100:00100000:0.0:1789366521.937244:0:6292:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789366521.937293:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286758718592 00000100:00100000:0.0:1789366521.937299:0:6292:0:(client.c:2716:ptlrpc_set_wait()) set 0000000051c9317f going to sleep for 11 seconds 00000100:00100000:1.0:1789366521.937302:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286758718592 00000100:00100000:1.0:1789366521.937373:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789366521.937385:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000039397632 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8cde4528-5832-4854-a387-4adacc3dd0ab+3:6292:x1876286758718592:12345-0@lo:104: 00010000:00010000:1.0:1789366521.937399:0:5799:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.123@tcp lock: 000000001e88c36b/0x8da3486b955f2e00 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x8da3486b955f2e07 expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366521.937489:0:5799:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1789366521.937495:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000039397632 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8cde4528-5832-4854-a387-4adacc3dd0ab+3:6292:x1876286758718592:12345-0@lo:104: Request processed in 114us (251us total) trans 0 rc 0/0 00000100:00100000:1.0:1789366521.937503:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789366521.937517:0:6292:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000190b1ba6 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:6292:1876286758718592:0@lo:104: 00010000:00010000:2.0:1789366521.937529:0:5805:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789366521.937537:0:5805:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.123@tcp lock: 000000001e88c36b/0x8da3486b955f2e00 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x8da3486b955f2e07 expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366521.937542:0:6292:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 00000000b9a93f2d/0x8da3486b955f2e31 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366521.937551:0:5805:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000001e88c36b already unused, calling callback (00000000dd0fdea0) 10000000:00010000:2.0:1789366521.937555:0:5805:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.123@tcp lock: 000000001e88c36b/0x8da3486b955f2e00 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x8da3486b955f2e07 expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366521.937569:0:5805:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.123@tcp lock: 000000001e88c36b/0x8da3486b955f2e00 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x8da3486b955f2e07 expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789366521.937578:0:5805:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.123@tcp lock: 000000001e88c36b/0x8da3486b955f2e00 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x8da3486b955f2e07 expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789366521.937584:0:5805:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1789366521.937633:0:5805:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.123@tcp lock: 000000001e88c36b/0x8da3486b955f2e00 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8da3486b955f2e07 expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366521.937641:0:5805:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789366521.937667:0:5805:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.123@tcp lock: 000000001e88c36b/0x8da3486b955f2e00 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8da3486b955f2e07 expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366521.937687:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.123@tcp lock: 000000001e88c36b/0x8da3486b955f2e00 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8da3486b955f2e07 expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366521.937705:0:5805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789366521.937707:0:5805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789366521.937708:0:5805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789366521.937998:0:3286:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000008c20fb6a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8cde4528-5832-4854-a387-4adacc3dd0ab:3286:1876286758718720:0@lo:103: 00000100:00100000:0.0:1789366521.938027:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789366521.938075:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286758718720 00000100:00100000:2.0:1789366521.938081:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286758718720 00010000:00010000:2.0:1789366521.938104:0:5803:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000b10b48f6/0x8da3486b955f2e07 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8da3486b955f2e00 expref: 11 pid: 5810 timeout: 247 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789366521.938143:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789366521.938149:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000190b1ba6 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8cde4528-5832-4854-a387-4adacc3dd0ab+11:3286:x1876286758718720:12345-0@lo:103: 00010000:00010000:2.0:1789366521.938159:0:5803:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789366521.938163:0:5803:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000b10b48f6/0x8da3486b955f2e07 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8da3486b955f2e00 expref: 11 pid: 5810 timeout: 247 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366521.938171:0:5803:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000b10b48f6/0x8da3486b955f2e07 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x8da3486b955f2e00 expref: 11 pid: 5810 timeout: 247 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366521.938180:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000b10b48f6/0x8da3486b955f2e07 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x8da3486b955f2e00 expref: 11 pid: 5810 timeout: 247 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366521.938191:0:5803:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 00000000b9a93f2d/0x8da3486b955f2e31 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366521.938196:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000b9a93f2d/0x8da3486b955f2e31 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366521.938213:0:5803:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000b9a93f2d/0x8da3486b955f2e31 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366521.938218:0:5803:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000b9a93f2d/0x8da3486b955f2e31 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366521.938222:0:5803:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000b9a93f2d/0x8da3486b955f2e31 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366521.938225:0:5803:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000b9a93f2d/0x8da3486b955f2e31 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366521.938228:0:5803:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000b9a93f2d already unused, calling callback (00000000da35d65f) 00010000:00010000:2.0:1789366521.938230:0:5803:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000b9a93f2d/0x8da3486b955f2e31 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366521.938234:0:5803:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000b9a93f2d/0x8da3486b955f2e31 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366521.938244:0:5803:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000b9a93f2d/0x8da3486b955f2e31 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366521.938250:0:5803:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789366521.938263:0:6292:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 00000000b9a93f2d/0x8da3486b955f2e31 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366521.938273:0:6292:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000b9a93f2d/0x8da3486b955f2e31 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789366521.938280:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000190b1ba6 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8cde4528-5832-4854-a387-4adacc3dd0ab+10:3286:x1876286758718720:12345-0@lo:103: Request processed in 130us (251us total) trans 0 rc 0/0 00010000:00010000:0.0:1789366521.938284:0:6292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000b9a93f2d/0x8da3486b955f2e31 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789366521.938289:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789366521.938322:0:3286:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000008c20fb6a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8cde4528-5832-4854-a387-4adacc3dd0ab:3286:1876286758718720:0@lo:103: 00010000:00010000:1.0:1789366522.743968:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1789366523.319838:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:2.0:1789366523.319846:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1789366523.319849:0:8:0:(import.c:65:import_set_state_nolock()) 0000000027c6a049 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1789366523.319872:0:8:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 0000000027c6a049 using connection 192.168.202.123@tcp/0@lo 00000100:00100000:2.0:1789366523.319896:0:8:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@000000005d8cf577 x1876286758718976/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1789366523.319933:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000005d8cf577 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3283:1876286758718976:0@lo:38: 00000100:00100000:0.0:1789366523.320005:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789366523.320028:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286758718976 00000100:00100000:2.0:1789366523.320035:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286758718976 00000100:00100000:2.0:1789366523.320069:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789366523.320074:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000003a1a3807 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3283:x1876286758718976:12345-0@lo:38: 00010000:00080000:2.0:1789366523.320092:0:5817:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 98 last 0 00000020:00000080:2.0:1789366523.320156:0:5817:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0x8da3486b955f2e38 00000004:00100000:2.0:1789366523.320184:0:5817:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00100000:3.0:1789366523.320279:0:3287:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000000ada1676 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8cde4528-5832-4854-a387-4adacc3dd0ab:3287:1876286758718848:0@lo:400: 00000100:00080000:2.0:1789366523.320279:0:5817:0:(import.c:65:import_set_state_nolock()) 00000000ca12f113 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789366523.320340:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000003a1a3807 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3283:x1876286758718976:12345-0@lo:38: Request processed in 265us (335us total) trans 0 rc 0/0 00010000:00080000:0.0:1789366523.320355:0:3283:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@000000005d8cf577 x1876286758718976/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789366533 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789366523.320360:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789366523.320371:0:3287:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1789366523.320379:0:3283:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 1 00000100:00080000:0.0:1789366523.320387:0:3283:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:0.0:1789366523.320393:0:3283:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1789366523.320395:0:3283:0:(import.c:65:import_set_state_nolock()) 0000000027c6a049 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1789366523.320413:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000005d8cf577 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3283:1876286758718976:0@lo:38: 00000100:00100000:1.0:1789366523.320422:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286758718848 00000100:00100000:1.0:1789366523.320428:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286758718848 00000100:00100000:1.0:1789366523.320458:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1789366523.320463:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000004f51da3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8cde4528-5832-4854-a387-4adacc3dd0ab+10:3287:x1876286758718848:12345-0@lo:400: 00000100:00100000:1.0:1789366523.320496:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000004f51da3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8cde4528-5832-4854-a387-4adacc3dd0ab+10:3287:x1876286758718848:12345-0@lo:400: Request processed in 34us (132us total) trans 0 rc 0/0 00000100:00100000:1.0:1789366523.320506:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1789366523.320514:0:3287:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000000ada1676 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8cde4528-5832-4854-a387-4adacc3dd0ab:3287:1876286758718848:0@lo:400: 00010000:00010000:0.0:1789366523.768233:0:5805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1789366524.113158:0:6656:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1789366524.113163:0:6656:0:(obd_mount.c:926:lmd_print()) device: lustre-ost1/ost1 00000080:01200004:2.0:1789366524.113284:0:6656:0:(super25.c:131:lustre_fill_super()) VFS Op: sb 0000000050a47bde 00000020:01000004:2.0:1789366524.113297:0:6656:0:(tgt_mount.c:2506:osd_start()) Attempting to start lustre-OST0000, type=osd-zfs, lsifl=200062, mountfl=0 00000020:01000004:2.0:1789366524.113307:0:6656:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-zfs) 00000020:00000080:2.0:1789366524.113318:0:6656:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (000000001a046692) 00000020:00000080:2.0:1789366524.113330:0:6656:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osd-zfs with refcount 2 00100000:10000000:2.0:1789366524.125004:0:6656:0:(scrub.c:230:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00100000:10000000:2.0:1789366524.125229:0:6656:0:(scrub.c:230:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00100000:10000000:2.0:1789366524.137670:0:6656:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:2.0:1789366524.141120:0:6656:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:2.0:1789366524.141153:0:6656:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:2.0:1789366524.141222:0:6656:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:2.0:1789366524.141252:0:6656:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:2.0:1789366524.141583:0:6656:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:2.0:1789366524.141595:0:6656:0:(osd_handler.c:1574:osd_obd_connect()) connect #0 00000020:00000080:2.0:1789366524.141604:0:6656:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x8da3486b955f2e46 00000020:01000004:2.0:1789366524.141611:0:6656:0:(tgt_mount.c:2591:server_fill_super()) Found service lustre-OST0000 on device lustre-ost1/ost1 00000020:01000004:2.0:1789366524.141630:0:6656:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.202.123@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1789366524.141633:0:6656:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.202.123@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1789366524.141638:0:6656:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-OST0000 00000020:01000004:2.0:1789366524.141643:0:6656:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:2.0:1789366524.141652:0:6656:0:(genops.c:413:class_newdev()) Allocate new device OSS (000000009b5b3a6b) 00000020:00000080:2.0:1789366524.141662:0:6656:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type ost with refcount 2 00000100:00100000:2.0:1789366524.144470:0:6656:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789366524.144645:0:6656:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:2.0:1789366524.144651:0:6656:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:3.0:1789366524.145199:0:6656:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:3.0:1789366524.145208:0:6656:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:2.0:1789366524.145445:0:6656:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:2.0:1789366524.145452:0:6656:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:3.0:1789366524.147586:0:6656:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1789366524.147705:0:6656:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:3.0:1789366524.147711:0:6656:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:2.0:1789366524.148242:0:6656:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:2.0:1789366524.148249:0:6656:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:3.0:1789366524.161203:0:6656:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1789366524.161431:0:6656:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:3.0:1789366524.161437:0:6656:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:2.0:1789366524.162041:0:6656:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:2.0:1789366524.162050:0:6656:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:3.0:1789366524.163148:0:6656:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:3.0:1789366524.163156:0:6656:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:2.0:1789366524.164539:0:6656:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789366524.164695:0:6656:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:2.0:1789366524.164698:0:6656:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:3.0:1789366524.165120:0:6656:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:3.0:1789366524.165199:0:6656:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:2.0:1789366524.191109:0:6656:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789366524.191284:0:6656:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:2.0:1789366524.191290:0:6656:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:3.0:1789366524.192560:0:6656:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:3.0:1789366524.192568:0:6656:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:2.0:1789366524.192954:0:6656:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:2.0:1789366524.192977:0:6656:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost1/ost1 10000000:01000000:2.0:1789366524.192983:0:6656:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.123@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:2.0:1789366524.205894:0:6656:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.123@tcp ctxt 0 is initialized 00000020:01000004:2.0:1789366524.205928:0:6656:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.202.123@tcp, index=0000, flags=0x20062 00000020:01000004:2.0:1789366524.205932:0:6656:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1789366524.205934:0:6656:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1789366524.205935:0:6656:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789366524.205936:0:6656:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789366524.205937:0:6656:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789366524.205938:0:6656:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789366524.205939:0:6656:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1789366524.205940:0:6656:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1789366524.205942:0:6656:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1789366524.205943:0:6656:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789366524.205944:0:6656:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1789366524.205947:0:6656:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020062 00000020:01000004:2.0:1789366524.205950:0:6656:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1789366524.205951:0:6656:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1789366524.205952:0:6656:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789366524.205953:0:6656:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789366524.205954:0:6656:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789366524.205955:0:6656:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789366524.205956:0:6656:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1789366524.205956:0:6656:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1789366524.205958:0:6656:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1789366524.205959:0:6656:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789366524.205960:0:6656:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1789366524.205986:0:6656:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:2.0:1789366524.206004:0:6656:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000000ada1676 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8cde4528-5832-4854-a387-4adacc3dd0ab:6656:1876286758719104:0@lo:253: 00000100:00100000:2.0:1789366524.206067:0:6656:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789366524.206110:0:6656:0:(client.c:2716:ptlrpc_set_wait()) set 000000009d2a3b74 going to sleep for 11 seconds 00000100:00100000:0.0:1789366524.206130:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286758719104 00000100:00100000:0.0:1789366524.206149:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286758719104 00000100:00100000:0.0:1789366524.206195:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1789366524.206216:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b316a848 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8cde4528-5832-4854-a387-4adacc3dd0ab+10:6656:x1876286758719104:12345-0@lo:253: 20000000:01000000:0.0:1789366524.206255:0:5808:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:0.0:1789366524.206259:0:5808:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0000, index=0 20000000:01000000:0.0:1789366524.206264:0:5808:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0000 to 0 20000000:01000000:0.0:1789366524.206267:0:5808:0:(mgs_llog.c:3862:mgs_write_log_ost()) writing new ost lustre-OST0000 00000040:00080000:0.0:1789366524.207572:0:5808:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1789366524.207951:0:5808:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 20000000:01000000:0.0:1789366524.207974:0:5808:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf001 obdfilter lustre-OST0000_UUID (null) (null) 00000040:00080000:0.0:1789366524.208022:0:5808:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 128 off8544 20000000:01000000:0.0:1789366524.208029:0:5808:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf003 dev type f (null) 00000040:00080000:0.0:1789366524.208081:0:5808:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 112 off8656 00000040:00080000:0.0:1789366524.208140:0:5808:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8880 00000040:00080000:0.0:1789366524.208734:0:5808:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 224 off11152 20000000:01000000:0.0:1789366524.208752:0:5808:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.202.123@tcp 20000000:01000000:0.0:1789366524.208758:0:5808:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.202.123@tcp (null) (null) (null) 00000040:00080000:0.0:1789366524.208811:0:5808:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 88 off11240 20000000:01000000:0.0:1789366524.208819:0:5808:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:0.0:1789366524.208898:0:5808:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 144 off11384 20000000:01000000:0.0:1789366524.208905:0:5808:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf003 lustre-OST0000_UUID 192.168.202.123@tcp (null) (null) 00000040:00080000:0.0:1789366524.208965:0:5808:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 152 off11536 20000000:01000000:0.0:1789366524.208974:0:5808:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:0.0:1789366524.209016:0:5808:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 136 off11672 00000040:00080000:0.0:1789366524.209095:0:5808:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11896 00000040:00080000:0.0:1789366524.210182:0:5808:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].21, 224 off11952 20000000:01000000:0.0:1789366524.210197:0:5808:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.202.123@tcp 20000000:01000000:0.0:1789366524.210198:0:5808:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.202.123@tcp (null) (null) (null) 00000040:00080000:0.0:1789366524.210227:0:5808:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].22, 88 off12040 20000000:01000000:0.0:1789366524.210234:0:5808:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:0.0:1789366524.210273:0:5808:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].23, 128 off12168 20000000:01000000:0.0:1789366524.210280:0:5808:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf003 lustre-OST0000_UUID 192.168.202.123@tcp (null) (null) 00000040:00080000:0.0:1789366524.210316:0:5808:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].24, 144 off12312 20000000:01000000:0.0:1789366524.210323:0:5808:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:0.0:1789366524.210350:0:5808:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].25, 128 off12440 00000040:00080000:0.0:1789366524.210380:0:5808:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].26, 224 off12664 20000000:01000000:0.0:1789366524.210407:0:5808:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' sys.timeout=20 ', param: 'autodegrade=on' 20000000:01000000:0.0:1789366524.210410:0:5808:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'autodegrade=on' 20000000:01000000:0.0:1789366524.210416:0:5808:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'sys.timeout=20' 20000000:01000000:0.0:1789366524.210418:0:5808:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:0.0:1789366524.210420:0:5808:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:0.0:1789366524.210430:0:5808:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:0.0:1789366524.210433:0:5808:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:0.0:1789366524.210463:0:5808:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:0.0:1789366524.210465:0:5808:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:2.0:1789366524.211902:0:6671:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 18 marker 9 1->4: lustre sys.timeout 20000000:01000000:2.0:1789366524.211961:0:6671:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 20 marker 9 2->4: lustre sys.timeout 00000040:00080000:2.0:1789366524.212014:0:6671:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 27 count 27 00000040:00080000:0.0:1789366524.212219:0:5808:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].27, 224 off12888 00000040:00080000:0.0:1789366524.212256:0:5808:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].28, 80 off12968 00000040:00080000:0.0:1789366524.212283:0:5808:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].29, 224 off13192 20000000:01000000:0.0:1789366524.212299:0:5808:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:0.0:1789366524.212301:0:5808:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:0.0:1789366524.212665:0:6672:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 13 marker 10 1->4: lustre sys.timeout 20000000:01000000:0.0:1789366524.212703:0:6672:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 15 marker 10 2->4: lustre sys.timeout 00000040:00080000:0.0:1789366524.212775:0:6672:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 22 count 22 00000040:00080000:3.0:1789366524.212951:0:5808:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 224 off12120 00000040:00080000:3.0:1789366524.212990:0:5808:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 80 off12200 00000040:00080000:3.0:1789366524.213031:0:5808:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 224 off12424 20000000:01000000:3.0:1789366524.213045:0:5808:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:3.0:1789366524.213046:0:5808:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 00000040:00080000:2.0:1789366524.213285:0:6673:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 5 count 5 00000040:00080000:3.0:1789366524.213454:0:5808:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 224 off9104 00000040:00080000:3.0:1789366524.213488:0:5808:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 80 off9184 00000040:00080000:3.0:1789366524.213530:0:5808:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9408 10000000:01000000:3.0:1789366524.213541:0:5808:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:3.0:1789366524.213555:0:5808:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000c90867d0/0x8da3486b955f2e54 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366524.213567:0:5808:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 000000007d2ed126/0x8da3486b955f2d89 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8da3486b955f2d82 expref: 10 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366524.213572:0:5808:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000f88dcc59/0x8da3486b955f2da5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8da3486b955f2d9e expref: 10 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366524.213575:0:5808:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 0000000069c6f4e7/0x8da3486b955f2e15 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8da3486b955f2e0e expref: 10 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366524.213579:0:5808:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 00000000c90867d0/0x8da3486b955f2e54 lrc: 6/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366524.213606:0:5808:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 0000000069c6f4e7/0x8da3486b955f2e15 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x8da3486b955f2e0e expref: 10 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366524.213615:0:5808:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 0000000069c6f4e7/0x8da3486b955f2e15 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x8da3486b955f2e0e expref: 10 pid: 5811 timeout: 249 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789366524.213623:0:5808:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000c1da0666 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5808:1876286758719232:0@lo:104: 00000100:00100000:3.0:1789366524.213673:0:5808:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789366524.213715:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286758719232 00010000:00010000:3.0:1789366524.213737:0:5808:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000f88dcc59/0x8da3486b955f2da5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x8da3486b955f2d9e expref: 10 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789366524.213742:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286758719232 00010000:00010000:3.0:1789366524.213754:0:5808:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000f88dcc59/0x8da3486b955f2da5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x8da3486b955f2d9e expref: 10 pid: 5811 timeout: 249 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789366524.213764:0:5808:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000045e3af7b pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5808:1876286758719360:0@lo:104: 00000100:00100000:3.0:1789366524.213792:0:5808:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789366524.213795:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1789366524.213804:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000048677b5b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8cde4528-5832-4854-a387-4adacc3dd0ab+3:5808:x1876286758719232:12345-0@lo:104: 00010000:00010000:0.0:1789366524.213817:0:5800:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.123@tcp lock: 000000008652970c/0x8da3486b955f2e0e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x8da3486b955f2e15 expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366524.213825:0:5808:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 000000007d2ed126/0x8da3486b955f2d89 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x8da3486b955f2d82 expref: 10 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789366524.213825:0:5799:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 2 min 2 max 56 00010000:00010000:3.0:1789366524.213840:0:5808:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 000000007d2ed126/0x8da3486b955f2d89 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x8da3486b955f2d82 expref: 10 pid: 5810 timeout: 249 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789366524.213840:0:5799:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_002' 00000100:00100000:3.0:1789366524.213852:0:5808:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000057b62108 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5808:1876286758719488:0@lo:104: 00000100:00100000:3.0:1789366524.213882:0:5808:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789366524.213882:0:5800:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1789366524.213891:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000048677b5b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8cde4528-5832-4854-a387-4adacc3dd0ab+3:5808:x1876286758719232:12345-0@lo:104: Request processed in 88us (217us total) trans 0 rc 0/0 00000100:00100000:0.0:1789366524.213898:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789366524.213900:0:5808:0:(client.c:2716:ptlrpc_set_wait()) set 00000000149f1062 going to sleep for 11 seconds 00010000:00010000:1.0:1789366524.213908:0:5804:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789366524.213915:0:5804:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.123@tcp lock: 000000008652970c/0x8da3486b955f2e0e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x8da3486b955f2e15 expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789366524.213917:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286758719360 00000100:00100000:0.0:1789366524.213921:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286758719360 00000100:00100000:3.0:1789366524.213925:0:5808:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000c1da0666 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5808:1876286758719232:0@lo:104: 00010000:00010000:1.0:1789366524.213928:0:5804:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000008652970c already unused, calling callback (00000000dd0fdea0) 00000100:00100000:0.0:1789366524.213940:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286758719488 00000100:00100000:0.0:1789366524.213944:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286758719488 10000000:00010000:1.0:1789366524.213946:0:5804:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.123@tcp lock: 000000008652970c/0x8da3486b955f2e0e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x8da3486b955f2e15 expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366524.213956:0:5804:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.123@tcp lock: 000000008652970c/0x8da3486b955f2e0e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x8da3486b955f2e15 expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789366524.213958:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1789366524.213966:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000007a525a7d pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8cde4528-5832-4854-a387-4adacc3dd0ab+4:5808:x1876286758719360:12345-0@lo:104: 10000000:00010000:1.0:1789366524.213971:0:5804:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.123@tcp lock: 000000008652970c/0x8da3486b955f2e0e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x8da3486b955f2e15 expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366524.213974:0:5800:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.123@tcp lock: 00000000525fbea8/0x8da3486b955f2d9e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x8da3486b955f2da5 expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789366524.213987:0:5804:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1789366524.214021:0:5800:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1789366524.214027:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000007a525a7d pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8cde4528-5832-4854-a387-4adacc3dd0ab+4:5808:x1876286758719360:12345-0@lo:104: Request processed in 62us (235us total) trans 0 rc 0/0 00010000:00010000:1.0:1789366524.214032:0:5804:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.123@tcp lock: 000000008652970c/0x8da3486b955f2e0e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8da3486b955f2e15 expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789366524.214035:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00010000:1.0:1789366524.214044:0:5804:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:0.0:1789366524.214056:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1789366524.214069:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000345f1a99 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8cde4528-5832-4854-a387-4adacc3dd0ab+3:5808:x1876286758719488:12345-0@lo:104: 00010000:00010000:1.0:1789366524.214071:0:5804:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.123@tcp lock: 000000008652970c/0x8da3486b955f2e0e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8da3486b955f2e15 expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366524.214077:0:5800:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.123@tcp lock: 00000000abbd3006/0x8da3486b955f2d82 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x8da3486b955f2d89 expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789366524.214081:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000004d3f2795 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8cde4528-5832-4854-a387-4adacc3dd0ab:3284:1876286758719616:0@lo:103: 00010000:00010000:1.0:1789366524.214082:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.123@tcp lock: 000000008652970c/0x8da3486b955f2e0e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8da3486b955f2e15 expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366524.214107:0:5804:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789366524.214110:0:5804:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.123@tcp lock: 00000000525fbea8/0x8da3486b955f2d9e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x8da3486b955f2da5 expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366524.214121:0:5800:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1789366524.214126:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000345f1a99 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8cde4528-5832-4854-a387-4adacc3dd0ab+3:5808:x1876286758719488:12345-0@lo:104: Request processed in 59us (245us total) trans 0 rc 0/0 00000100:00100000:0.0:1789366524.214138:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1789366524.214144:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789366524.214144:0:5804:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000525fbea8 already unused, calling callback (00000000dd0fdea0) 10000000:00010000:1.0:1789366524.214149:0:5804:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.123@tcp lock: 00000000525fbea8/0x8da3486b955f2d9e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x8da3486b955f2da5 expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366524.214156:0:5804:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.123@tcp lock: 00000000525fbea8/0x8da3486b955f2d9e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x8da3486b955f2da5 expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789366524.214162:0:5804:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.123@tcp lock: 00000000525fbea8/0x8da3486b955f2d9e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x8da3486b955f2da5 expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789366524.214168:0:5804:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:0.0:1789366524.214173:0:5808:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000045e3af7b pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5808:1876286758719360:0@lo:104: 00000100:00100000:3.0:1789366524.214178:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286758719616 00000100:00100000:3.0:1789366524.214184:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286758719616 00000100:00100000:0.0:1789366524.214187:0:5808:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000057b62108 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5808:1876286758719488:0@lo:104: 00010000:00010000:1.0:1789366524.214194:0:5804:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.123@tcp lock: 00000000525fbea8/0x8da3486b955f2d9e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8da3486b955f2da5 expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366524.214202:0:5804:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789366524.214208:0:5801:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 0000000069c6f4e7/0x8da3486b955f2e15 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8da3486b955f2e0e expref: 11 pid: 5811 timeout: 249 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366524.214210:0:5804:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.123@tcp lock: 00000000525fbea8/0x8da3486b955f2d9e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8da3486b955f2da5 expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366524.214213:0:5808:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 00000000c90867d0/0x8da3486b955f2e54 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366524.214233:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.123@tcp lock: 00000000525fbea8/0x8da3486b955f2d9e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8da3486b955f2da5 expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366524.214242:0:5805:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789366524.214250:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789366524.214251:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00010000:00010000:1.0:1789366524.214253:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789366524.214255:0:3284:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00010000:00010000:1.0:1789366524.214256:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789366524.214263:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000004dcc62d3 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8cde4528-5832-4854-a387-4adacc3dd0ab+11:3284:x1876286758719616:12345-0@lo:103: 00000100:00100000:2.0:1789366524.214266:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000ca5ba8fd pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8cde4528-5832-4854-a387-4adacc3dd0ab:3284:1876286758719744:0@lo:103: 00010000:00010000:3.0:1789366524.214275:0:5801:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789366524.214280:0:5801:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 0000000069c6f4e7/0x8da3486b955f2e15 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8da3486b955f2e0e expref: 11 pid: 5811 timeout: 249 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366524.214290:0:5801:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 0000000069c6f4e7/0x8da3486b955f2e15 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x8da3486b955f2e0e expref: 11 pid: 5811 timeout: 249 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366524.214311:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000069c6f4e7/0x8da3486b955f2e15 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x8da3486b955f2e0e expref: 11 pid: 5811 timeout: 249 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366524.214324:0:5801:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789366524.214326:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789366524.214358:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000004dcc62d3 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8cde4528-5832-4854-a387-4adacc3dd0ab+10:3284:x1876286758719616:12345-0@lo:103: Request processed in 99us (218us total) trans 0 rc 0/0 00000100:00100000:3.0:1789366524.214365:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789366524.214377:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286758719744 00000100:00100000:3.0:1789366524.214379:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286758719744 00010000:00010000:3.0:1789366524.214389:0:5801:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000f88dcc59/0x8da3486b955f2da5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8da3486b955f2d9e expref: 10 pid: 5811 timeout: 249 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789366524.214420:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789366524.214427:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f25bf0dd pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8cde4528-5832-4854-a387-4adacc3dd0ab+10:3284:x1876286758719744:12345-0@lo:103: 00010000:00010000:1.0:1789366524.214434:0:5803:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789366524.214437:0:5803:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000f88dcc59/0x8da3486b955f2da5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8da3486b955f2d9e expref: 10 pid: 5811 timeout: 249 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366524.214447:0:5803:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000f88dcc59/0x8da3486b955f2da5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x8da3486b955f2d9e expref: 10 pid: 5811 timeout: 249 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366524.214454:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000f88dcc59/0x8da3486b955f2da5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x8da3486b955f2d9e expref: 10 pid: 5811 timeout: 249 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366524.214467:0:5803:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789366524.214483:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000004d3f2795 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8cde4528-5832-4854-a387-4adacc3dd0ab:3284:1876286758719616:0@lo:103: 00000100:00100000:1.0:1789366524.214494:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f25bf0dd pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8cde4528-5832-4854-a387-4adacc3dd0ab+9:3284:x1876286758719744:12345-0@lo:103: Request processed in 66us (167us total) trans 0 rc 0/0 00000100:00100000:1.0:1789366524.214502:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1789366524.214521:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000ca5ba8fd pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8cde4528-5832-4854-a387-4adacc3dd0ab:3284:1876286758719744:0@lo:103: 00010000:00010000:0.0:1789366524.214537:0:6675:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789366524.214540:0:6675:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789366524.214542:0:6675:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789366524.214548:0:5805:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.123@tcp lock: 00000000abbd3006/0x8da3486b955f2d82 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x8da3486b955f2d89 expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366524.214556:0:5805:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000abbd3006 already unused, calling callback (00000000dd0fdea0) 10000000:00010000:3.0:1789366524.214559:0:5805:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.123@tcp lock: 00000000abbd3006/0x8da3486b955f2d82 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x8da3486b955f2d89 expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366524.214565:0:5805:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.123@tcp lock: 00000000abbd3006/0x8da3486b955f2d82 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x8da3486b955f2d89 expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789366524.214570:0:5805:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.123@tcp lock: 00000000abbd3006/0x8da3486b955f2d82 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x8da3486b955f2d89 expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789366524.214575:0:5805:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1789366524.214595:0:5805:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.123@tcp lock: 00000000abbd3006/0x8da3486b955f2d82 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8da3486b955f2d89 expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366524.214601:0:5805:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789366524.214633:0:5805:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.123@tcp lock: 00000000abbd3006/0x8da3486b955f2d82 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8da3486b955f2d89 expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366524.214638:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.123@tcp lock: 00000000abbd3006/0x8da3486b955f2d82 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8da3486b955f2d89 expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366524.214653:0:5805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789366524.214655:0:5805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789366524.214656:0:5805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789366524.214692:0:3287:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789366524.214701:0:3287:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000975eaf2a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8cde4528-5832-4854-a387-4adacc3dd0ab:3287:1876286758719872:0@lo:103: 00000100:00100000:2.0:1789366524.214783:0:3287:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789366524.214852:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286758719872 00000100:00100000:3.0:1789366524.214856:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286758719872 00010000:00010000:3.0:1789366524.214868:0:5801:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 000000007d2ed126/0x8da3486b955f2d89 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8da3486b955f2d82 expref: 9 pid: 5810 timeout: 249 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789366524.214890:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1789366524.214898:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000088406469 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8cde4528-5832-4854-a387-4adacc3dd0ab+9:3287:x1876286758719872:12345-0@lo:103: 00010000:00010000:3.0:1789366524.214905:0:5801:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789366524.214908:0:5801:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 000000007d2ed126/0x8da3486b955f2d89 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8da3486b955f2d82 expref: 9 pid: 5810 timeout: 249 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366524.214917:0:5801:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 000000007d2ed126/0x8da3486b955f2d89 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x8da3486b955f2d82 expref: 9 pid: 5810 timeout: 249 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366524.214925:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000007d2ed126/0x8da3486b955f2d89 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x8da3486b955f2d82 expref: 9 pid: 5810 timeout: 249 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366524.214936:0:5801:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 00000000c90867d0/0x8da3486b955f2e54 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366524.214943:0:5801:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000c90867d0/0x8da3486b955f2e54 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366524.214963:0:5801:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000c90867d0/0x8da3486b955f2e54 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366524.214967:0:5801:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000c90867d0/0x8da3486b955f2e54 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366524.214971:0:5801:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000c90867d0/0x8da3486b955f2e54 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366524.214974:0:5801:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000c90867d0/0x8da3486b955f2e54 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366524.214977:0:5801:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000c90867d0 already unused, calling callback (00000000da35d65f) 00010000:00010000:3.0:1789366524.214979:0:5801:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000c90867d0/0x8da3486b955f2e54 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366524.214982:0:5801:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000c90867d0/0x8da3486b955f2e54 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366524.214992:0:5801:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000c90867d0/0x8da3486b955f2e54 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366524.214999:0:5801:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789366524.214999:0:5808:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 00000000c90867d0/0x8da3486b955f2e54 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366524.215007:0:5808:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000c90867d0/0x8da3486b955f2e54 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366524.215011:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000c90867d0/0x8da3486b955f2e54 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1789366524.215028:0:5808:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:3.0:1789366524.215056:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000088406469 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8cde4528-5832-4854-a387-4adacc3dd0ab+8:3287:x1876286758719872:12345-0@lo:103: Request processed in 159us (272us total) trans 0 rc 0/0 00000100:00100000:3.0:1789366524.215064:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1789366524.215111:0:3287:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000975eaf2a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8cde4528-5832-4854-a387-4adacc3dd0ab:3287:1876286758719872:0@lo:103: 00000100:00100000:3.0:1789366524.228211:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b316a848 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8cde4528-5832-4854-a387-4adacc3dd0ab+7:6656:x1876286758719104:12345-0@lo:253: Request processed in 22003us (22137us total) trans 0 rc 0/0 00000100:00100000:3.0:1789366524.228227:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1789366524.228233:0:6656:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000000ada1676 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8cde4528-5832-4854-a387-4adacc3dd0ab:6656:1876286758719104:0@lo:253: 10000000:01000000:2.0:1789366524.228252:0:6656:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:2.0:1789366524.228256:0:6656:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1789366524.228258:0:6656:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1789366524.228259:0:6656:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789366524.228261:0:6656:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0000_UUID 00000020:01000004:2.0:1789366524.228262:0:6656:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789366524.228263:0:6656:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789366524.228265:0:6656:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1789366524.228266:0:6656:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:2.0:1789366524.228268:0:6656:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789366524.228269:0:6656:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1789366524.228289:0:6656:0:(tgt_mount.c:101:server_register_mount()) register mount 0000000050a47bde from lustre-OST0000 10000000:01000000:2.0:1789366524.228310:0:6656:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:2.0:1789366524.228313:0:6656:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:2.0:1789366524.228319:0:6656:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff963882f5cd40 local copy 10000000:01000000:2.0:1789366524.228323:0:6656:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1789366524.228352:0:6656:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.123@tcp lock: 00000000c2b34f52/0x8da3486b955f2e5b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366524.228359:0:6656:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.202.123@tcp lock: 00000000c2b34f52/0x8da3486b955f2e5b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366524.228379:0:6656:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.123@tcp lock: 00000000c2b34f52/0x8da3486b955f2e5b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789366524.228425:0:6656:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000000ada1676 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8cde4528-5832-4854-a387-4adacc3dd0ab:6656:1876286758720000:0@lo:101: 00000100:00100000:2.0:1789366524.228466:0:6656:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789366524.228510:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286758720000 00000100:00100000:2.0:1789366524.228518:0:6656:0:(client.c:2716:ptlrpc_set_wait()) set 000000005be532ae going to sleep for 11 seconds 00000100:00100000:1.0:1789366524.228518:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286758720000 00000100:00100000:1.0:1789366524.228567:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1789366524.228575:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b2f01923 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8cde4528-5832-4854-a387-4adacc3dd0ab+7:6656:x1876286758720000:12345-0@lo:101: 00010000:00010000:1.0:1789366524.228587:0:5811:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789366524.228600:0:5811:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000419790f2/0x8da3486b955f2e62 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x8da3486b955f2e5b expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366524.228628:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000419790f2/0x8da3486b955f2e62 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8da3486b955f2e5b expref: 8 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366524.228644:0:5811:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000419790f2/0x8da3486b955f2e62 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8da3486b955f2e5b expref: 8 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366524.228653:0:5811:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000419790f2, rc 0) 00000100:00100000:1.0:1789366524.228692:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b2f01923 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8cde4528-5832-4854-a387-4adacc3dd0ab+8:6656:x1876286758720000:12345-0@lo:101: Request processed in 119us (227us total) trans 0 rc 0/0 00000100:00100000:1.0:1789366524.228699:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1789366524.229036:0:6656:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000000ada1676 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8cde4528-5832-4854-a387-4adacc3dd0ab:6656:1876286758720000:0@lo:101: 00010000:00010000:3.0:1789366524.229057:0:6656:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.123@tcp lock: 00000000c2b34f52/0x8da3486b955f2e5b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x8da3486b955f2e62 expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366524.229067:0:6656:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.123@tcp lock: 00000000c2b34f52/0x8da3486b955f2e5b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x8da3486b955f2e62 expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789366524.229156:0:6656:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000064efa592 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8cde4528-5832-4854-a387-4adacc3dd0ab:6656:1876286758720128:0@lo:501: 00000100:00100000:3.0:1789366524.229187:0:6656:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789366524.229217:0:6656:0:(client.c:2716:ptlrpc_set_wait()) set 00000000eab7bc5b going to sleep for 11 seconds 00000100:00100000:1.0:1789366524.229227:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286758720128 00000100:00100000:1.0:1789366524.229233:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286758720128 00000100:00100000:1.0:1789366524.229260:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1789366524.229266:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000007a97faa4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8cde4528-5832-4854-a387-4adacc3dd0ab+8:6656:x1876286758720128:12345-0@lo:501: 00000100:00100000:1.0:1789366524.229894:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000007a97faa4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8cde4528-5832-4854-a387-4adacc3dd0ab+8:6656:x1876286758720128:12345-0@lo:501: Request processed in 628us (707us total) trans 0 rc -2/-2 00000100:00100000:1.0:1789366524.229903:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1789366524.229917:0:6656:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000064efa592 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8cde4528-5832-4854-a387-4adacc3dd0ab:6656:1876286758720128:0@lo:501: 10000000:01000000:3.0:1789366524.229935:0:6656:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.202.123@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:3.0:1789366524.229962:0:6656:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.202.123@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:3.0:1789366524.229966:0:6656:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.123@tcp lock: 00000000c2b34f52/0x8da3486b955f2e5b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x8da3486b955f2e62 expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366524.229974:0:6656:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.123@tcp lock: 00000000c2b34f52/0x8da3486b955f2e5b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x8da3486b955f2e62 expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366524.229980:0:6656:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.123@tcp lock: 00000000c2b34f52/0x8da3486b955f2e5b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x8da3486b955f2e62 expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366524.230000:0:6656:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1789366524.230015:0:6656:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff963885b46000 10000000:01000000:3.0:1789366524.230020:0:6656:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1789366524.230025:0:6656:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff963882f5cd40 10000000:01000000:3.0:1789366524.230027:0:6656:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:1.0:1789366524.230028:0:5804:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 10000000:01000000:3.0:1789366524.230032:0:6656:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff963882f5cd40 from 1 00010000:00010000:1.0:1789366524.230034:0:5804:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.123@tcp lock: 00000000c2b34f52/0x8da3486b955f2e5b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0x8da3486b955f2e62 expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789366524.230037:0:6656:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:1.0:1789366524.230044:0:5804:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000c2b34f52 already unused, calling callback (00000000dd0fdea0) 10000000:00010000:1.0:1789366524.230047:0:5804:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.123@tcp lock: 00000000c2b34f52/0x8da3486b955f2e5b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0x8da3486b955f2e62 expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366524.230056:0:5804:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.123@tcp lock: 00000000c2b34f52/0x8da3486b955f2e5b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x8400000000 nid: local remote: 0x8da3486b955f2e62 expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366524.230058:0:6656:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.123@tcp lock: 000000007d2ed126/0x8da3486b955f2e69 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789366524.230063:0:5804:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.123@tcp lock: 00000000c2b34f52/0x8da3486b955f2e5b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x9400000000 nid: local remote: 0x8da3486b955f2e62 expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366524.230096:0:6656:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.123@tcp lock: 000000007d2ed126/0x8da3486b955f2e69 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789366524.230096:0:5804:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1789366524.230107:0:6656:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.123@tcp lock: 000000007d2ed126/0x8da3486b955f2e69 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366524.230114:0:5804:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.123@tcp lock: 00000000c2b34f52/0x8da3486b955f2e5b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0x8da3486b955f2e62 expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366524.230120:0:5804:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:3.0:1789366524.230121:0:6656:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000064efa592 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8cde4528-5832-4854-a387-4adacc3dd0ab:6656:1876286758720256:0@lo:101: 00010000:00010000:1.0:1789366524.230141:0:5804:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.123@tcp lock: 00000000c2b34f52/0x8da3486b955f2e5b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0x8da3486b955f2e62 expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789366524.230154:0:6656:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789366524.230158:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.123@tcp lock: 00000000c2b34f52/0x8da3486b955f2e5b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0x8da3486b955f2e62 expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789366524.230174:0:3286:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00010000:00010000:1.0:1789366524.230175:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789366524.230177:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789366524.230180:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789366524.230184:0:6656:0:(client.c:2716:ptlrpc_set_wait()) set 0000000028fffb7f going to sleep for 11 seconds 00000100:00100000:0.0:1789366524.230191:0:3286:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000000f91aab3 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8cde4528-5832-4854-a387-4adacc3dd0ab:3286:1876286758720384:0@lo:103: 00000100:00100000:0.0:1789366524.230221:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789366524.230252:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286758720384 00000100:00100000:1.0:1789366524.230257:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286758720384 00000100:00100000:2.0:1789366524.230280:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286758720256 00000100:00100000:2.0:1789366524.230286:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286758720256 00000100:00100000:1.0:1789366524.230291:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789366524.230299:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000052889da0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8cde4528-5832-4854-a387-4adacc3dd0ab+9:3286:x1876286758720384:12345-0@lo:103: 00010000:00010000:1.0:1789366524.230310:0:5803:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789366524.230321:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000419790f2/0x8da3486b955f2e62 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x8da3486b955f2e5b expref: 9 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366524.230334:0:5803:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789366524.230358:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1789366524.230369:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000005d5d5b46 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8cde4528-5832-4854-a387-4adacc3dd0ab+8:6656:x1876286758720256:12345-0@lo:101: 00000100:00100000:1.0:1789366524.230376:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000052889da0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8cde4528-5832-4854-a387-4adacc3dd0ab+8:3286:x1876286758720384:12345-0@lo:103: Request processed in 77us (152us total) trans 0 rc 0/0 00010000:00010000:2.0:1789366524.230381:0:5810:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1789366524.230385:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789366524.230390:0:3286:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000000f91aab3 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8cde4528-5832-4854-a387-4adacc3dd0ab:3286:1876286758720384:0@lo:103: 00010000:00010000:2.0:1789366524.230402:0:5810:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000075487c5f/0x8da3486b955f2e70 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x8da3486b955f2e69 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366524.230427:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000075487c5f/0x8da3486b955f2e70 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8da3486b955f2e69 expref: 8 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366524.230436:0:5810:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000075487c5f/0x8da3486b955f2e70 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8da3486b955f2e69 expref: 8 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366524.230443:0:5810:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000075487c5f, rc 0) 00000100:00100000:2.0:1789366524.230473:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000005d5d5b46 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8cde4528-5832-4854-a387-4adacc3dd0ab+8:6656:x1876286758720256:12345-0@lo:101: Request processed in 108us (323us total) trans 0 rc 0/0 00000100:00100000:2.0:1789366524.230479:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1789366524.230500:0:6656:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000064efa592 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8cde4528-5832-4854-a387-4adacc3dd0ab:6656:1876286758720256:0@lo:101: 00010000:00010000:3.0:1789366524.230511:0:6656:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.123@tcp lock: 000000007d2ed126/0x8da3486b955f2e69 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8da3486b955f2e70 expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366524.230519:0:6656:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.123@tcp lock: 000000007d2ed126/0x8da3486b955f2e69 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x8da3486b955f2e70 expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789366524.230531:0:6656:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.123@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:3.0:1789366524.230542:0:6656:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.123@tcp lock: 000000007d2ed126/0x8da3486b955f2e69 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8da3486b955f2e70 expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366524.230546:0:6656:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.123@tcp lock: 000000007d2ed126/0x8da3486b955f2e69 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8da3486b955f2e70 expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789366524.230551:0:6656:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:3.0:1789366524.230553:0:6656:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1789366524.230556:0:6656:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:3.0:1789366524.230557:0:6656:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:3.0:1789366524.230567:0:6656:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.123@tcp lock: 0000000069c6f4e7/0x8da3486b955f2e77 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366524.230574:0:6656:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.123@tcp lock: 0000000069c6f4e7/0x8da3486b955f2e77 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366524.230578:0:6656:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.123@tcp lock: 0000000069c6f4e7/0x8da3486b955f2e77 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789366524.230586:0:6656:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000064efa592 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8cde4528-5832-4854-a387-4adacc3dd0ab:6656:1876286758720512:0@lo:101: 00000100:00100000:3.0:1789366524.230608:0:6656:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789366524.230623:0:6656:0:(client.c:2716:ptlrpc_set_wait()) set 0000000028fffb7f going to sleep for 11 seconds 00000100:00100000:1.0:1789366524.230625:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286758720512 00000100:00100000:1.0:1789366524.230630:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286758720512 00000100:00100000:1.0:1789366524.230649:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1789366524.230659:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a47353ca pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8cde4528-5832-4854-a387-4adacc3dd0ab+8:6656:x1876286758720512:12345-0@lo:101: 00010000:00010000:1.0:1789366524.230665:0:5808:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789366524.230671:0:5808:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000001f76138e/0x8da3486b955f2e7e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x8da3486b955f2e77 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366524.230688:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000001f76138e/0x8da3486b955f2e7e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8da3486b955f2e77 expref: 9 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366524.230696:0:5808:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000001f76138e/0x8da3486b955f2e7e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8da3486b955f2e77 expref: 9 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366524.230702:0:5808:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000001f76138e, rc 0) 00000100:00100000:1.0:1789366524.230754:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a47353ca pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8cde4528-5832-4854-a387-4adacc3dd0ab+9:6656:x1876286758720512:12345-0@lo:101: Request processed in 94us (145us total) trans 0 rc 0/0 00000100:00100000:1.0:1789366524.230760:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1789366524.230777:0:6656:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000064efa592 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8cde4528-5832-4854-a387-4adacc3dd0ab:6656:1876286758720512:0@lo:101: 00010000:00010000:3.0:1789366524.230788:0:6656:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.123@tcp lock: 0000000069c6f4e7/0x8da3486b955f2e77 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8da3486b955f2e7e expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366524.230795:0:6656:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.123@tcp lock: 0000000069c6f4e7/0x8da3486b955f2e77 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x8da3486b955f2e7e expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789366524.230836:0:6656:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000064efa592 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8cde4528-5832-4854-a387-4adacc3dd0ab:6656:1876286758720640:0@lo:501: 00000100:00100000:3.0:1789366524.230853:0:6656:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789366524.230873:0:6656:0:(client.c:2716:ptlrpc_set_wait()) set 0000000028fffb7f going to sleep for 11 seconds 00000100:00100000:2.0:1789366524.230888:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286758720640 00000100:00100000:2.0:1789366524.230891:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286758720640 00000100:00100000:2.0:1789366524.230912:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1789366524.230917:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000004d72572c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8cde4528-5832-4854-a387-4adacc3dd0ab+9:6656:x1876286758720640:12345-0@lo:501: 00000100:00100000:3.0:1789366524.231094:0:6656:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000064efa592 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8cde4528-5832-4854-a387-4adacc3dd0ab:6656:1876286758720640:0@lo:501: 00000100:00100000:3.0:1789366524.231118:0:6656:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000064efa592 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8cde4528-5832-4854-a387-4adacc3dd0ab:6656:1876286758720768:0@lo:503: 00000100:00100000:2.0:1789366524.231129:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000004d72572c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8cde4528-5832-4854-a387-4adacc3dd0ab+9:6656:x1876286758720640:12345-0@lo:501: Request processed in 154us (217us total) trans 0 rc 0/0 00000100:00100000:2.0:1789366524.231135:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1789366524.231152:0:6656:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789366524.231170:0:6656:0:(client.c:2716:ptlrpc_set_wait()) set 0000000028fffb7f going to sleep for 11 seconds 00000100:00100000:1.0:1789366524.231191:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286758720768 00000100:00100000:1.0:1789366524.231196:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286758720768 00000100:00100000:1.0:1789366524.231222:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1789366524.231228:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b0e832c5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8cde4528-5832-4854-a387-4adacc3dd0ab+9:6656:x1876286758720768:12345-0@lo:503: 00000100:00100000:1.0:1789366524.231356:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b0e832c5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8cde4528-5832-4854-a387-4adacc3dd0ab+9:6656:x1876286758720768:12345-0@lo:503: Request processed in 128us (202us total) trans 0 rc 0/0 00000100:00100000:3.0:1789366524.231367:0:6656:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000064efa592 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8cde4528-5832-4854-a387-4adacc3dd0ab:6656:1876286758720768:0@lo:503: 00000100:00100000:1.0:1789366524.231367:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000040:00080000:3.0:1789366524.231597:0:6656:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1789366524.231657:0:6656:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000064efa592 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8cde4528-5832-4854-a387-4adacc3dd0ab:6656:1876286758720896:0@lo:502: 00000100:00100000:3.0:1789366524.231678:0:6656:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789366524.231693:0:6656:0:(client.c:2716:ptlrpc_set_wait()) set 0000000028fffb7f going to sleep for 11 seconds 00000100:00100000:2.0:1789366524.231712:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286758720896 00000100:00100000:2.0:1789366524.231740:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286758720896 00000100:00100000:2.0:1789366524.231764:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1789366524.231771:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000009f68e29e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8cde4528-5832-4854-a387-4adacc3dd0ab+9:6656:x1876286758720896:12345-0@lo:502: 00000100:00100000:2.0:1789366524.231883:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000009f68e29e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8cde4528-5832-4854-a387-4adacc3dd0ab+9:6656:x1876286758720896:12345-0@lo:502: Request processed in 114us (204us total) trans 0 rc 0/0 00000100:00100000:2.0:1789366524.231890:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1789366524.231893:0:6656:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000064efa592 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8cde4528-5832-4854-a387-4adacc3dd0ab:6656:1876286758720896:0@lo:502: 00000040:00080000:3.0:1789366524.232037:0:6656:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:3.0:1789366524.232065:0:6656:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:3.0:1789366524.232092:0:6656:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:3.0:1789366524.232136:0:6656:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:3.0:1789366524.232158:0:6656:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:3.0:1789366524.232173:0:6656:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:3.0:1789366524.232186:0:6656:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000064efa592 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8cde4528-5832-4854-a387-4adacc3dd0ab:6656:1876286758721024:0@lo:502: 00000100:00100000:3.0:1789366524.232207:0:6656:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789366524.232226:0:6656:0:(client.c:2716:ptlrpc_set_wait()) set 0000000028fffb7f going to sleep for 11 seconds 00000100:00100000:1.0:1789366524.232251:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286758721024 00000100:00100000:1.0:1789366524.232256:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286758721024 00000100:00100000:1.0:1789366524.232283:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1789366524.232356:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000cffe7961 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8cde4528-5832-4854-a387-4adacc3dd0ab+9:6656:x1876286758721024:12345-0@lo:502: 00000100:00100000:1.0:1789366524.232489:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000cffe7961 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8cde4528-5832-4854-a387-4adacc3dd0ab+9:6656:x1876286758721024:12345-0@lo:502: Request processed in 135us (279us total) trans 0 rc 0/0 00000100:00100000:3.0:1789366524.232502:0:6656:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000064efa592 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8cde4528-5832-4854-a387-4adacc3dd0ab:6656:1876286758721024:0@lo:502: 00000100:00100000:1.0:1789366524.232513:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000040:00080000:3.0:1789366524.232569:0:6656:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:3.0:1789366524.232574:0:6656:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 7 count 8 00000020:01000000:3.0:1789366524.232914:0:6676:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1789366524.232921:0:6676:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-ost1/ost1 00000020:00000080:3.0:1789366524.232925:0:6676:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789366524.232927:0:6676:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-OST0000 add ost 00000020:00000080:3.0:1789366524.232930:0:6676:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1789366524.232939:0:6676:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (00000000d81ad0b5) 00000020:00000080:3.0:1789366524.232957:0:6676:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type obdfilter with refcount 2 00000020:00000080:3.0:1789366524.232961:0:6676:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1789366524.233025:0:6676:0:(tgt_mount.c:153:server_get_mount()) get mount 0000000050a47bde from lustre-OST0000, refs=2 00080000:01000000:3.0:1789366524.233030:0:6676:0:(osd_handler.c:1574:osd_obd_connect()) connect #1 00000020:00000080:3.0:1789366524.233036:0:6676:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x8da3486b955f2e8c 00010000:00010000:3.0:1789366524.235601:0:6676:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-2 is initialized 00000001:02000400:3.0:1789366524.235919:0:6676:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0000: new disk, initializing 00000001:00000004:3.0:1789366524.237100:0:6676:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 0 40000000:02000000:3.0:1789366524.237230:0:6676:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0000: No data found on store. Initialize space. 00080000:10000000:3.0:1789366524.240462:0:6676:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000001:0x3:0x0] (8/8/3) registered 00080000:10000000:3.0:1789366524.240964:0:6676:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000020:00000080:3.0:1789366524.241832:0:6676:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:3.0:1789366524.241840:0:6676:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789366524.241844:0:6676:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789366524.241846:0:6676:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-OST0000 add ost 00000020:01000000:3.0:1789366524.241850:0:6676:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789366524.241854:0:6676:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789366524.241855:0:6676:0:(obd_config.c:1563:class_process_config()) marker 16 (0x1) lustre sys.timeout 00000020:00000080:3.0:1789366524.241858:0:6676:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1789366524.241859:0:6676:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1789366524.241908:0:6676:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789366524.241911:0:6676:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789366524.241912:0:6676:0:(obd_config.c:1563:class_process_config()) marker 16 (0x2) lustre sys.timeout 00000040:00080000:3.0:1789366524.241915:0:6676:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:2.0:1789366524.241996:0:6656:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-7 (rc=0) 10000000:01000000:2.0:1789366524.242024:0:6656:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.123@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:2.0:1789366524.242048:0:6656:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.123@tcp lock: 0000000069c6f4e7/0x8da3486b955f2e77 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8da3486b955f2e7e expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366524.242067:0:6656:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.123@tcp lock: 0000000069c6f4e7/0x8da3486b955f2e77 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8da3486b955f2e7e expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789366524.242076:0:6656:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff963885b46000 from 1 10000000:01000000:2.0:1789366524.242079:0:6656:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1789366524.242117:0:6656:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.123@tcp lock: 0000000094852893/0x8da3486b955f2e93 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366524.242124:0:6656:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.123@tcp lock: 0000000094852893/0x8da3486b955f2e93 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366524.242135:0:6656:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.123@tcp lock: 0000000094852893/0x8da3486b955f2e93 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789366524.242169:0:6656:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000019d36dc2 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8cde4528-5832-4854-a387-4adacc3dd0ab:6656:1876286758721152:0@lo:101: 00000100:00100000:2.0:1789366524.242252:0:6656:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789366524.242320:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286758721152 00000100:00100000:2.0:1789366524.242324:0:6656:0:(client.c:2716:ptlrpc_set_wait()) set 00000000475dc4f3 going to sleep for 11 seconds 00000100:00100000:3.0:1789366524.242333:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286758721152 00000100:00100000:3.0:1789366524.242380:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1789366524.242388:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000008adad8df pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8cde4528-5832-4854-a387-4adacc3dd0ab+9:6656:x1876286758721152:12345-0@lo:101: 00010000:00010000:3.0:1789366524.242414:0:5810:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789366524.242426:0:5810:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000eb2854a8/0x8da3486b955f2e9a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x8da3486b955f2e93 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366524.242445:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000eb2854a8/0x8da3486b955f2e9a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8da3486b955f2e93 expref: 10 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366524.242453:0:5810:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000eb2854a8/0x8da3486b955f2e9a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8da3486b955f2e93 expref: 10 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366524.242460:0:5810:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000eb2854a8, rc 0) 00000100:00100000:3.0:1789366524.242503:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000008adad8df pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8cde4528-5832-4854-a387-4adacc3dd0ab+10:6656:x1876286758721152:12345-0@lo:101: Request processed in 117us (252us total) trans 0 rc 0/0 00000100:00100000:3.0:1789366524.242507:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1789366524.242546:0:6656:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000019d36dc2 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8cde4528-5832-4854-a387-4adacc3dd0ab:6656:1876286758721152:0@lo:101: 00010000:00010000:2.0:1789366524.242559:0:6656:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.123@tcp lock: 0000000094852893/0x8da3486b955f2e93 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8da3486b955f2e9a expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366524.242567:0:6656:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.123@tcp lock: 0000000094852893/0x8da3486b955f2e93 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x8da3486b955f2e9a expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789366524.242672:0:6656:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000019d36dc2 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8cde4528-5832-4854-a387-4adacc3dd0ab:6656:1876286758721280:0@lo:501: 00000100:00100000:2.0:1789366524.242703:0:6656:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789366524.242761:0:6656:0:(client.c:2716:ptlrpc_set_wait()) set 00000000475dc4f3 going to sleep for 11 seconds 00000100:00100000:1.0:1789366524.242764:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286758721280 00000100:00100000:1.0:1789366524.242770:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286758721280 00000100:00100000:1.0:1789366524.242805:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1789366524.242813:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a2e23228 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8cde4528-5832-4854-a387-4adacc3dd0ab+10:6656:x1876286758721280:12345-0@lo:501: 00000100:00100000:1.0:1789366524.243047:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a2e23228 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8cde4528-5832-4854-a387-4adacc3dd0ab+10:6656:x1876286758721280:12345-0@lo:501: Request processed in 236us (344us total) trans 0 rc 0/0 00000100:00100000:1.0:1789366524.243056:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1789366524.243080:0:6656:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000019d36dc2 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8cde4528-5832-4854-a387-4adacc3dd0ab:6656:1876286758721280:0@lo:501: 00000100:00100000:2.0:1789366524.243106:0:6656:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000019d36dc2 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8cde4528-5832-4854-a387-4adacc3dd0ab:6656:1876286758721408:0@lo:503: 00000100:00100000:2.0:1789366524.243142:0:6656:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789366524.243166:0:6656:0:(client.c:2716:ptlrpc_set_wait()) set 00000000475dc4f3 going to sleep for 11 seconds 00000100:00100000:1.0:1789366524.243192:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286758721408 00000100:00100000:1.0:1789366524.243197:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286758721408 00000100:00100000:1.0:1789366524.243227:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1789366524.243236:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000067b0d2a8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8cde4528-5832-4854-a387-4adacc3dd0ab+10:6656:x1876286758721408:12345-0@lo:503: 00000100:00100000:1.0:1789366524.243469:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000067b0d2a8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8cde4528-5832-4854-a387-4adacc3dd0ab+10:6656:x1876286758721408:12345-0@lo:503: Request processed in 236us (327us total) trans 0 rc 0/0 00000100:00100000:1.0:1789366524.243483:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1789366524.243520:0:6656:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000019d36dc2 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8cde4528-5832-4854-a387-4adacc3dd0ab:6656:1876286758721408:0@lo:503: 00000040:00080000:2.0:1789366524.243841:0:6656:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1789366524.243902:0:6656:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000019d36dc2 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8cde4528-5832-4854-a387-4adacc3dd0ab:6656:1876286758721536:0@lo:502: 00000100:00100000:2.0:1789366524.243940:0:6656:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789366524.243971:0:6656:0:(client.c:2716:ptlrpc_set_wait()) set 00000000475dc4f3 going to sleep for 11 seconds 00000100:00100000:1.0:1789366524.243995:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286758721536 00000100:00100000:1.0:1789366524.244001:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286758721536 00000100:00100000:1.0:1789366524.244029:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1789366524.244036:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000074b576db pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8cde4528-5832-4854-a387-4adacc3dd0ab+10:6656:x1876286758721536:12345-0@lo:502: 00000100:00100000:1.0:1789366524.244177:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000074b576db pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8cde4528-5832-4854-a387-4adacc3dd0ab+10:6656:x1876286758721536:12345-0@lo:502: Request processed in 142us (237us total) trans 0 rc 0/0 00000100:00100000:1.0:1789366524.244184:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1789366524.244210:0:6656:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000019d36dc2 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8cde4528-5832-4854-a387-4adacc3dd0ab:6656:1876286758721536:0@lo:502: 00000040:00080000:2.0:1789366524.244542:0:6656:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:2.0:1789366524.244605:0:6656:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:2.0:1789366524.244628:0:6656:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000019d36dc2 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8cde4528-5832-4854-a387-4adacc3dd0ab:6656:1876286758721664:0@lo:502: 00000100:00100000:2.0:1789366524.244667:0:6656:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789366524.244690:0:6656:0:(client.c:2716:ptlrpc_set_wait()) set 00000000475dc4f3 going to sleep for 11 seconds 00000100:00100000:1.0:1789366524.244712:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286758721664 00000100:00100000:1.0:1789366524.244735:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286758721664 00000100:00100000:1.0:1789366524.244773:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1789366524.244782:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000001d7f00e7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8cde4528-5832-4854-a387-4adacc3dd0ab+10:6656:x1876286758721664:12345-0@lo:502: 00000100:00100000:1.0:1789366524.244901:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000001d7f00e7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8cde4528-5832-4854-a387-4adacc3dd0ab+10:6656:x1876286758721664:12345-0@lo:502: Request processed in 121us (235us total) trans 0 rc 0/0 00000100:00100000:1.0:1789366524.244908:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1789366524.244930:0:6656:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000019d36dc2 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8cde4528-5832-4854-a387-4adacc3dd0ab:6656:1876286758721664:0@lo:502: 00000040:00080000:2.0:1789366524.245016:0:6656:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:2.0:1789366524.245026:0:6656:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:1.0:1789366524.245387:0:6680:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789366524.245404:0:6680:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789366524.245407:0:6680:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1789366524.245415:0:6680:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff963885b46000 00000020:00000080:1.0:1789366524.245418:0:6680:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1789366524.245461:0:6680:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789366524.245465:0:6680:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789366524.245467:0:6680:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:1.0:1789366524.245471:0:6680:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:2.0:1789366524.245535:0:6656:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:2.0:1789366524.245561:0:6656:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.123@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1789366524.245579:0:6656:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.123@tcp lock: ffff9638a0740800/0x8da3486b955f2e93 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8da3486b955f2e9a expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366524.245592:0:6656:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.123@tcp lock: ffff9638a0740800/0x8da3486b955f2e93 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8da3486b955f2e9a expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789366524.245628:0:6656:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1789366524.245631:0:6656:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff963885b46000 10000000:01000000:2.0:1789366524.245634:0:6656:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff963885b46000 10000000:01000000:2.0:1789366524.245638:0:6656:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1789366524.245643:0:6656:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff963885b46000 from 1 10000000:01000000:2.0:1789366524.245645:0:6656:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1789366524.245669:0:6656:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.123@tcp lock: ffff9638a0740600/0x8da3486b955f2ea1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366524.245678:0:6656:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.123@tcp lock: ffff9638a0740600/0x8da3486b955f2ea1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366524.245688:0:6656:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.123@tcp lock: ffff9638a0740600/0x8da3486b955f2ea1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789366524.245711:0:6656:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9638b6ea1500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8cde4528-5832-4854-a387-4adacc3dd0ab:6656:1876286758721792:0@lo:101: 00000100:00100000:2.0:1789366524.245777:0:6656:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789366524.245799:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286758721792 00000100:00100000:1.0:1789366524.245803:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286758721792 00000100:00100000:2.0:1789366524.245817:0:6656:0:(client.c:2716:ptlrpc_set_wait()) set ffff96389883e600 going to sleep for 11 seconds 00000100:00100000:1.0:1789366524.245836:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1789366524.245845:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638b4e3c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8cde4528-5832-4854-a387-4adacc3dd0ab+10:6656:x1876286758721792:12345-0@lo:101: 00010000:00010000:1.0:1789366524.245855:0:5808:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789366524.245867:0:5808:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff96388148fe00/0x8da3486b955f2ea8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x8da3486b955f2ea1 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366524.245888:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff96388148fe00/0x8da3486b955f2ea8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8da3486b955f2ea1 expref: 11 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366524.245897:0:5808:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff96388148fe00/0x8da3486b955f2ea8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8da3486b955f2ea1 expref: 11 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366524.245904:0:5808:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96388148fe00, rc 0) 00000100:00100000:1.0:1789366524.245935:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638b4e3c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8cde4528-5832-4854-a387-4adacc3dd0ab+11:6656:x1876286758721792:12345-0@lo:101: Request processed in 92us (158us total) trans 0 rc 0/0 00000100:00100000:1.0:1789366524.245942:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1789366524.245961:0:6656:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9638b6ea1500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8cde4528-5832-4854-a387-4adacc3dd0ab:6656:1876286758721792:0@lo:101: 00010000:00010000:2.0:1789366524.245976:0:6656:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.123@tcp lock: ffff9638a0740600/0x8da3486b955f2ea1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8da3486b955f2ea8 expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366524.245985:0:6656:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.123@tcp lock: ffff9638a0740600/0x8da3486b955f2ea1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x8da3486b955f2ea8 expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789366524.246043:0:6656:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9638b6ea1500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8cde4528-5832-4854-a387-4adacc3dd0ab:6656:1876286758721920:0@lo:501: 00000100:00100000:2.0:1789366524.246069:0:6656:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789366524.246086:0:6656:0:(client.c:2716:ptlrpc_set_wait()) set ffff96389883e600 going to sleep for 11 seconds 00000100:00100000:1.0:1789366524.246098:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286758721920 00000100:00100000:1.0:1789366524.246102:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286758721920 00000100:00100000:1.0:1789366524.246125:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1789366524.246131:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638b4e3f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8cde4528-5832-4854-a387-4adacc3dd0ab+11:6656:x1876286758721920:12345-0@lo:501: 00000100:00100000:1.0:1789366524.246278:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638b4e3f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8cde4528-5832-4854-a387-4adacc3dd0ab+11:6656:x1876286758721920:12345-0@lo:501: Request processed in 146us (207us total) trans 0 rc 0/0 00000100:00100000:1.0:1789366524.246287:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1789366524.246299:0:6656:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9638b6ea1500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8cde4528-5832-4854-a387-4adacc3dd0ab:6656:1876286758721920:0@lo:501: 00000100:00100000:2.0:1789366524.246321:0:6656:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9638b6ea1500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8cde4528-5832-4854-a387-4adacc3dd0ab:6656:1876286758722048:0@lo:503: 00000100:00100000:2.0:1789366524.246350:0:6656:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789366524.246365:0:6656:0:(client.c:2716:ptlrpc_set_wait()) set ffff96389883e600 going to sleep for 11 seconds 00000100:00100000:1.0:1789366524.246373:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286758722048 00000100:00100000:1.0:1789366524.246377:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286758722048 00000100:00100000:1.0:1789366524.246406:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1789366524.246413:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638b4e3d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8cde4528-5832-4854-a387-4adacc3dd0ab+11:6656:x1876286758722048:12345-0@lo:503: 00000100:00100000:1.0:1789366524.246512:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638b4e3d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8cde4528-5832-4854-a387-4adacc3dd0ab+11:6656:x1876286758722048:12345-0@lo:503: Request processed in 99us (160us total) trans 0 rc 0/0 00000100:00100000:1.0:1789366524.246519:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1789366524.246531:0:6656:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9638b6ea1500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8cde4528-5832-4854-a387-4adacc3dd0ab:6656:1876286758722048:0@lo:503: 00000040:00080000:2.0:1789366524.246706:0:6656:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1789366524.246762:0:6656:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9638b6ea1500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8cde4528-5832-4854-a387-4adacc3dd0ab:6656:1876286758722176:0@lo:502: 00000100:00100000:2.0:1789366524.246796:0:6656:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789366524.246815:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286758722176 00000100:00100000:1.0:1789366524.246818:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286758722176 00000100:00100000:2.0:1789366524.246823:0:6656:0:(client.c:2716:ptlrpc_set_wait()) set ffff96389883e600 going to sleep for 11 seconds 00000100:00100000:1.0:1789366524.246842:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1789366524.246850:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638b4e3e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8cde4528-5832-4854-a387-4adacc3dd0ab+11:6656:x1876286758722176:12345-0@lo:502: 00000100:00100000:1.0:1789366524.246968:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638b4e3e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8cde4528-5832-4854-a387-4adacc3dd0ab+11:6656:x1876286758722176:12345-0@lo:502: Request processed in 118us (171us total) trans 0 rc 0/0 00000100:00100000:1.0:1789366524.246975:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1789366524.246985:0:6656:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9638b6ea1500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8cde4528-5832-4854-a387-4adacc3dd0ab:6656:1876286758722176:0@lo:502: 00000040:00080000:2.0:1789366524.247201:0:6656:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:2.0:1789366524.247251:0:6656:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:2.0:1789366524.247283:0:6656:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:2.0:1789366524.247325:0:6656:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:2.0:1789366524.247358:0:6656:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:2.0:1789366524.247414:0:6656:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:2.0:1789366524.247452:0:6656:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:2.0:1789366524.247487:0:6656:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:2.0:1789366524.247533:0:6656:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:2.0:1789366524.247568:0:6656:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:2.0:1789366524.247602:0:6656:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:2.0:1789366524.247644:0:6656:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:2.0:1789366524.247693:0:6656:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:2.0:1789366524.247757:0:6656:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:2.0:1789366524.247806:0:6656:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:2.0:1789366524.247827:0:6656:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:2.0:1789366524.247843:0:6656:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:2.0:1789366524.247865:0:6656:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:2.0:1789366524.247882:0:6656:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:2.0:1789366524.247897:0:6656:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:2.0:1789366524.247928:0:6656:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:2.0:1789366524.247948:0:6656:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:2.0:1789366524.247963:0:6656:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:2.0:1789366524.247996:0:6656:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:2.0:1789366524.248031:0:6656:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 128 off12440 00000040:00080000:2.0:1789366524.248052:0:6656:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12664 00000040:00080000:2.0:1789366524.248076:0:6656:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12888 00000040:00080000:2.0:1789366524.248093:0:6656:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off12968 00000100:00100000:2.0:1789366524.248107:0:6656:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9638b6ea1500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8cde4528-5832-4854-a387-4adacc3dd0ab:6656:1876286758722304:0@lo:502: 00000100:00100000:2.0:1789366524.248134:0:6656:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789366524.248153:0:6656:0:(client.c:2716:ptlrpc_set_wait()) set ffff96389883e600 going to sleep for 11 seconds 00000100:00100000:1.0:1789366524.248164:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286758722304 00000100:00100000:1.0:1789366524.248168:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286758722304 00000100:00100000:1.0:1789366524.248191:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1789366524.248195:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638b4e3e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8cde4528-5832-4854-a387-4adacc3dd0ab+11:6656:x1876286758722304:12345-0@lo:502: 00000100:00100000:1.0:1789366524.248323:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638b4e3e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8cde4528-5832-4854-a387-4adacc3dd0ab+11:6656:x1876286758722304:12345-0@lo:502: Request processed in 126us (186us total) trans 0 rc 0/0 00000100:00100000:2.0:1789366524.248337:0:6656:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9638b6ea1500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8cde4528-5832-4854-a387-4adacc3dd0ab:6656:1876286758722304:0@lo:502: 00000100:00100000:1.0:1789366524.248341:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000040:00080000:2.0:1789366524.248422:0:6656:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13192 00000040:00080000:2.0:1789366524.248437:0:6656:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 29 count 30 00000020:01000004:2.0:1789366524.248903:0:6681:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:2.0:1789366524.248917:0:6681:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff9638986a4d40) 00000020:00000080:2.0:1789366524.248936:0:6681:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type lwp with refcount 2 00000020:01000004:2.0:1789366524.248995:0:6681:0:(tgt_mount.c:153:server_get_mount()) get mount ffff963885b46000 from lustre-OST0000, refs=3 00000020:01000004:2.0:1789366524.248999:0:6681:0:(tgt_mount.c:187:server_put_mount()) put mount ffff963885b46000 from lustre-OST0000, refs=3 00000020:01000004:2.0:1789366524.249001:0:6681:0:(obd_mount.c:710:lustre_put_lsi()) put ffff963885b46000 3 00010000:00080000:2.0:1789366524.249028:0:6681:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9638ba2ec800@lustre-MDT0000-lwp-OST0000: add connection 192.168.202.123@tcp at head 00010000:00010000:2.0:1789366524.250207:0:6681:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-2 is initialized 00000020:00000080:2.0:1789366524.250361:0:6681:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:2.0:1789366524.250379:0:6681:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1789366524.250385:0:6681:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0x8da3486b955f2eb6 00000100:00080000:2.0:1789366524.251848:0:6681:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1789366524.251864:0:6681:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9638ba2ec800 using connection 192.168.202.123@tcp/0@lo 00000100:00100000:2.0:1789366524.251914:0:6681:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9638b6ea1500 x1876286758722432/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1789366524.251937:0:6681:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00100000:3.0:1789366524.252055:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9638bf5a8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3284:1876286758722560:0@lo:400: 00000100:00100000:3.0:1789366524.252123:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000040:00080000:2.0:1789366524.252142:0:6681:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000100:00100000:3.0:1789366524.252208:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286758722560 00000100:00100000:3.0:1789366524.252216:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286758722560 00000100:00100000:3.0:1789366524.252263:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789366524.252274:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638bf5aad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3284:x1876286758722560:12345-0@lo:400: 00000100:00100000:0.0:1789366524.252331:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9638b6ea1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3283:1876286758722432:0@lo:38: 00000100:00100000:3.0:1789366524.252348:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638bf5aad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3284:x1876286758722560:12345-0@lo:400: Request processed in 75us (224us total) trans 0 rc 0/0 00000100:00100000:3.0:1789366524.252356:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789366524.252381:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:2.0:1789366524.252385:0:3284:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9638bf5a8700 x1876286758722560/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789366540 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000020:01000000:3.0:1789366524.252388:0:6656:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-29 (rc=0) 00000100:00100000:2.0:1789366524.252420:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9638bf5a8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3284:1876286758722560:0@lo:400: 10000000:01000000:3.0:1789366524.252430:0:6656:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.123@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1789366524.252450:0:6656:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.123@tcp lock: ffff9638a0740600/0x8da3486b955f2ea1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8da3486b955f2ea8 expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789366524.252450:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286758722432 00000100:00100000:2.0:1789366524.252455:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286758722432 00010000:00010000:3.0:1789366524.252465:0:6656:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.123@tcp lock: ffff9638a0740600/0x8da3486b955f2ea1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8da3486b955f2ea8 expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789366524.252480:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789366524.252487:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638b4f19180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3283:x1876286758722432:12345-0@lo:38: 00010000:00080000:2.0:1789366524.252509:0:5816:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 99 last 0 00000020:01000004:3.0:1789366524.252527:0:6656:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1789366524.252530:0:6656:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1789366524.252531:0:6656:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789366524.252532:0:6656:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789366524.252534:0:6656:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789366524.252535:0:6656:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789366524.252537:0:6656:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1789366524.252539:0:6656:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1789366524.252540:0:6656:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:00000080:2.0:1789366524.252541:0:5816:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0x8da3486b955f2ebd 00000020:01000004:3.0:1789366524.252542:0:6656:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789366524.252546:0:6656:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1789366524.252551:0:6656:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020062 00000004:00100000:2.0:1789366524.252556:0:5816:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000020:01000004:3.0:1789366524.252558:0:6656:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1789366524.252559:0:6656:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1789366524.252560:0:6656:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789366524.252561:0:6656:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789366524.252562:0:6656:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789366524.252563:0:6656:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789366524.252565:0:6656:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1789366524.252568:0:6656:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1789366524.252569:0:6656:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1789366524.252570:0:6656:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789366524.252572:0:6656:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1789366524.252587:0:6656:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00080000:2.0:1789366524.252598:0:5816:0:(import.c:65:import_set_state_nolock()) ffff963784ba4800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789366524.252600:0:6656:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9638bf5a8a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8cde4528-5832-4854-a387-4adacc3dd0ab:6656:1876286758722688:0@lo:253: 00000100:00100000:3.0:1789366524.252654:0:6656:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789366524.252678:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638b4f19180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3283:x1876286758722432:12345-0@lo:38: Request processed in 187us (296us total) trans 0 rc 0/0 00000100:00100000:1.0:1789366524.252684:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286758722688 00000100:00100000:2.0:1789366524.252688:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789366524.252691:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286758722688 00010000:00080000:0.0:1789366524.252693:0:3283:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9638b6ea1500 x1876286758722432/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789366534 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789366524.252704:0:3283:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1789366524.252711:0:3283:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 1 00000100:00080000:0.0:1789366524.252745:0:3283:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:0.0:1789366524.252750:0:3283:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00100000:1.0:1789366524.252754:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00080000:0.0:1789366524.252755:0:3283:0:(import.c:65:import_set_state_nolock()) ffff9638ba2ec800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1789366524.252766:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9638b6ea1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3283:1876286758722432:0@lo:38: 00000100:00100000:1.0:1789366524.252770:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638b4e3e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8cde4528-5832-4854-a387-4adacc3dd0ab+11:6656:x1876286758722688:12345-0@lo:253: 20000000:01000000:1.0:1789366524.252794:0:5810:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:1.0:1789366524.252809:0:5810:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:3.0:1789366524.252821:0:6656:0:(client.c:2716:ptlrpc_set_wait()) set ffff96388c4d0540 going to sleep for 11 seconds 20000000:01000000:1.0:1789366524.267959:0:5810:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1789366524.267976:0:5810:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:3.0:1789366524.268017:0:5831:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1789366524.268024:0:5831:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1789366524.268047:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9638827f6200/0x8da3486b955f2ec4 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366524.268064:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9638827f6200/0x8da3486b955f2ec4 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1789366524.268073:0:5831:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001027306s 00010000:00010000:3.0:1789366524.268078:0:5831:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9638827f6200/0x8da3486b955f2ec4 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366524.268085:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9638827f6200/0x8da3486b955f2ec4 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366524.268099:0:5831:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9638827f6200/0x8da3486b955f2ec4 lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366524.268106:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9638827f6200/0x8da3486b955f2ec4 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366524.268123:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9638827f6200 already unused, calling callback (ffffffffc16df520) 00010000:00010000:3.0:1789366524.268127:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9638827f6200/0x8da3486b955f2ec4 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366524.268135:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9638827f6200/0x8da3486b955f2ec4 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366524.268148:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9638827f6200/0x8da3486b955f2ec4 lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366524.268158:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9638827f6200/0x8da3486b955f2ec4 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366524.268165:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9638827f6200/0x8da3486b955f2ec4 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789366524.270194:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638b4e3e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8cde4528-5832-4854-a387-4adacc3dd0ab+11:6656:x1876286758722688:12345-0@lo:253: Request processed in 17426us (17535us total) trans 0 rc 0/0 00000100:00100000:2.0:1789366524.270204:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1789366524.270221:0:6656:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9638bf5a8a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8cde4528-5832-4854-a387-4adacc3dd0ab:6656:1876286758722688:0@lo:253: 10000000:01000000:3.0:1789366524.270235:0:6656:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:3.0:1789366524.270237:0:6656:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1789366524.270239:0:6656:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1789366524.270240:0:6656:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789366524.270240:0:6656:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789366524.270241:0:6656:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789366524.270242:0:6656:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789366524.270243:0:6656:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1789366524.270244:0:6656:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1789366524.270245:0:6656:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1789366524.270247:0:6656:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789366524.270248:0:6656:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1789366524.270263:0:6656:0:(tgt_mount.c:2698:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:3.0:1789366524.273154:0:6656:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:3.0:1789366524.273361:0:6656:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:3.0:1789366524.273557:0:6656:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:3.0:1789366524.273710:0:6656:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:3.0:1789366524.273902:0:6656:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:3.0:1789366524.274107:0:6656:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:3.0:1789366524.274692:0:6656:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00002000:00080000:2.0:1789366524.352521:0:6656:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:2.0:1789366524.352529:0:6656:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:2.0:1789366524.352561:0:6656:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1789366524.352626:0:6656:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.123@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1789366524.352642:0:6656:0:(tgt_mount.c:2464:server_fill_super_common()) Server sb, dev=48 00000080:00000004:2.0:1789366524.352664:0:6656:0:(super25.c:182:lustre_fill_super()) lustre-ost1/ost1: Mount complete 00010000:00010000:1.0:1789366524.793784:0:6675:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789366525.815849:0:5805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1789366526.481847:0:7024:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg223-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:1.0:1789366526.840423:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1789366527.351837:0:5813:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1789366527.351843:0:5813:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff963884956000 from 21 10000000:01000000:3.0:1789366527.351848:0:5813:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1789366527.351886:0:5813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.123@tcp lock: ffff9638827f6200/0x8da3486b955f2ecb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366527.351895:0:5813:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.123@tcp lock: ffff9638827f6200/0x8da3486b955f2ecb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366527.351903:0:5813:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.123@tcp lock: ffff9638827f6200/0x8da3486b955f2ecb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789366527.351921:0:5813:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9638bf5a8a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8cde4528-5832-4854-a387-4adacc3dd0ab:5813:1876286758722816:0@lo:101: 00000100:00100000:3.0:1789366527.351994:0:5813:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789366527.352064:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286758722816 00000100:00100000:3.0:1789366527.352071:0:5813:0:(client.c:2716:ptlrpc_set_wait()) set ffff9638871970c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789366527.352073:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286758722816 00000100:00100000:1.0:1789366527.352133:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1789366527.352143:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638b4e3f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8cde4528-5832-4854-a387-4adacc3dd0ab+11:5813:x1876286758722816:12345-0@lo:101: 00010000:00010000:1.0:1789366527.352156:0:5808:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789366527.352169:0:5808:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff96388148e400/0x8da3486b955f2ed2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x8da3486b955f2ecb expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366527.352205:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff96388148e400/0x8da3486b955f2ed2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8da3486b955f2ecb expref: 12 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366527.352216:0:5808:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff96388148e400/0x8da3486b955f2ed2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8da3486b955f2ecb expref: 12 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366527.352226:0:5808:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96388148e400, rc 0) 00000100:00100000:1.0:1789366527.352272:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638b4e3f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8cde4528-5832-4854-a387-4adacc3dd0ab+12:5813:x1876286758722816:12345-0@lo:101: Request processed in 131us (277us total) trans 0 rc 0/0 00000100:00100000:1.0:1789366527.352280:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1789366527.352299:0:5813:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9638bf5a8a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8cde4528-5832-4854-a387-4adacc3dd0ab:5813:1876286758722816:0@lo:101: 00010000:00010000:3.0:1789366527.352312:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.123@tcp lock: ffff9638827f6200/0x8da3486b955f2ecb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x8da3486b955f2ed2 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366527.352319:0:5813:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.123@tcp lock: ffff9638827f6200/0x8da3486b955f2ecb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x8da3486b955f2ed2 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789366527.352357:0:5813:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9638bf5a8a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8cde4528-5832-4854-a387-4adacc3dd0ab:5813:1876286758722944:0@lo:501: 00000100:00100000:3.0:1789366527.352395:0:5813:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789366527.352419:0:5813:0:(client.c:2716:ptlrpc_set_wait()) set ffff9638871970c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789366527.352451:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286758722944 00000100:00100000:2.0:1789366527.352456:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286758722944 00000100:00100000:2.0:1789366527.352487:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1789366527.352494:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638b4e3d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8cde4528-5832-4854-a387-4adacc3dd0ab+12:5813:x1876286758722944:12345-0@lo:501: 00000100:00100000:2.0:1789366527.352860:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638b4e3d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8cde4528-5832-4854-a387-4adacc3dd0ab+12:5813:x1876286758722944:12345-0@lo:501: Request processed in 366us (463us total) trans 0 rc 0/0 00000100:00100000:2.0:1789366527.352867:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1789366527.352904:0:5813:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9638bf5a8a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8cde4528-5832-4854-a387-4adacc3dd0ab:5813:1876286758722944:0@lo:501: 00000100:00100000:3.0:1789366527.352934:0:5813:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9638bf5a8a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8cde4528-5832-4854-a387-4adacc3dd0ab:5813:1876286758723072:0@lo:503: 00000100:00100000:3.0:1789366527.352982:0:5813:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789366527.353010:0:5813:0:(client.c:2716:ptlrpc_set_wait()) set ffff9638871970c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789366527.353047:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286758723072 00000100:00100000:1.0:1789366527.353053:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286758723072 00000100:00100000:1.0:1789366527.353088:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1789366527.353096:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638b4e3c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8cde4528-5832-4854-a387-4adacc3dd0ab+12:5813:x1876286758723072:12345-0@lo:503: 00000100:00100000:1.0:1789366527.353412:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638b4e3c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8cde4528-5832-4854-a387-4adacc3dd0ab+12:5813:x1876286758723072:12345-0@lo:503: Request processed in 317us (429us total) trans 0 rc 0/0 00000100:00100000:1.0:1789366527.353420:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1789366527.353452:0:5813:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9638bf5a8a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8cde4528-5832-4854-a387-4adacc3dd0ab:5813:1876286758723072:0@lo:503: 00000100:00100000:3.0:1789366527.353812:0:7128:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9638bf5a8a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8cde4528-5832-4854-a387-4adacc3dd0ab:7128:1876286758723200:0@lo:502: 00000100:00100000:3.0:1789366527.353844:0:7128:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789366527.353866:0:7128:0:(client.c:2716:ptlrpc_set_wait()) set ffff963887197d80 going to sleep for 11 seconds 00000100:00100000:2.0:1789366527.353891:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286758723200 00000100:00100000:2.0:1789366527.353897:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286758723200 00000100:00100000:2.0:1789366527.353926:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1789366527.353933:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638b4e3c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8cde4528-5832-4854-a387-4adacc3dd0ab+12:7128:x1876286758723200:12345-0@lo:502: 00000100:00100000:2.0:1789366527.354130:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638b4e3c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8cde4528-5832-4854-a387-4adacc3dd0ab+12:7128:x1876286758723200:12345-0@lo:502: Request processed in 197us (284us total) trans 0 rc 0/0 00000100:00100000:2.0:1789366527.354151:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1789366527.354168:0:7128:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9638bf5a8a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8cde4528-5832-4854-a387-4adacc3dd0ab:7128:1876286758723200:0@lo:502: 00000100:00100000:3.0:1789366527.354210:0:7128:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9638bf5a8a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8cde4528-5832-4854-a387-4adacc3dd0ab:7128:1876286758723328:0@lo:502: 00000100:00100000:3.0:1789366527.354239:0:7128:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789366527.354257:0:7128:0:(client.c:2716:ptlrpc_set_wait()) set ffff963887197d80 going to sleep for 11 seconds 00000100:00100000:1.0:1789366527.354286:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286758723328 00000100:00100000:1.0:1789366527.354291:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286758723328 00000100:00100000:1.0:1789366527.354323:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1789366527.354331:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638b4e3d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8cde4528-5832-4854-a387-4adacc3dd0ab+12:7128:x1876286758723328:12345-0@lo:502: 00000100:00100000:1.0:1789366527.354475:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638b4e3d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8cde4528-5832-4854-a387-4adacc3dd0ab+12:7128:x1876286758723328:12345-0@lo:502: Request processed in 145us (236us total) trans 0 rc 0/0 00000100:00100000:1.0:1789366527.354480:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1789366527.354519:0:7128:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9638bf5a8a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8cde4528-5832-4854-a387-4adacc3dd0ab:7128:1876286758723328:0@lo:502: 00000040:00080000:3.0:1789366527.354542:0:7128:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 30 count 30 00000020:01000000:1.0:1789366527.354627:0:5813:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 21-29 (rc=0) 10000000:01000000:1.0:1789366527.354646:0:5813:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.123@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1789366527.354654:0:5813:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.123@tcp lock: ffff9638827f6200/0x8da3486b955f2ecb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x8da3486b955f2ed2 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366527.354665:0:5813:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.123@tcp lock: ffff9638827f6200/0x8da3486b955f2ecb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x8da3486b955f2ed2 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789366527.354673:0:5813:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1789366527.354675:0:5813:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff963884956000 from 3 10000000:01000000:1.0:1789366527.354678:0:5813:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1789366527.354698:0:5813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.123@tcp lock: ffff96388148f600/0x8da3486b955f2ed9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366527.354705:0:5813:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.123@tcp lock: ffff96388148f600/0x8da3486b955f2ed9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366527.354736:0:5813:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.123@tcp lock: ffff96388148f600/0x8da3486b955f2ed9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789366527.354745:0:5813:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9638987ea680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8cde4528-5832-4854-a387-4adacc3dd0ab:5813:1876286758723456:0@lo:101: 00000100:00100000:1.0:1789366527.354765:0:5813:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789366527.354798:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286758723456 00000100:00100000:1.0:1789366527.354802:0:5813:0:(client.c:2716:ptlrpc_set_wait()) set ffff963884dfdb40 going to sleep for 11 seconds 00000100:00100000:3.0:1789366527.354804:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286758723456 00000100:00100000:3.0:1789366527.354838:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1789366527.354846:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638b4e39450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8cde4528-5832-4854-a387-4adacc3dd0ab+12:5813:x1876286758723456:12345-0@lo:101: 00010000:00010000:3.0:1789366527.354855:0:5810:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789366527.354867:0:5810:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9638827f6400/0x8da3486b955f2ee0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x8da3486b955f2ed9 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366527.354884:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9638827f6400/0x8da3486b955f2ee0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8da3486b955f2ed9 expref: 13 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366527.354901:0:5810:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9638827f6400/0x8da3486b955f2ee0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8da3486b955f2ed9 expref: 13 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366527.354910:0:5810:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9638827f6400, rc 0) 00000100:00100000:3.0:1789366527.354942:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638b4e39450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8cde4528-5832-4854-a387-4adacc3dd0ab+13:5813:x1876286758723456:12345-0@lo:101: Request processed in 98us (175us total) trans 0 rc 0/0 00000100:00100000:3.0:1789366527.354949:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1789366527.354970:0:5813:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9638987ea680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8cde4528-5832-4854-a387-4adacc3dd0ab:5813:1876286758723456:0@lo:101: 00010000:00010000:1.0:1789366527.354980:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.123@tcp lock: ffff96388148f600/0x8da3486b955f2ed9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8da3486b955f2ee0 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366527.354986:0:5813:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.123@tcp lock: ffff96388148f600/0x8da3486b955f2ed9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x8da3486b955f2ee0 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789366527.355016:0:5813:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9638987ea680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8cde4528-5832-4854-a387-4adacc3dd0ab:5813:1876286758723584:0@lo:256: 00000100:00100000:1.0:1789366527.355043:0:5813:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789366527.355062:0:5813:0:(client.c:2716:ptlrpc_set_wait()) set ffff963884dfdb40 going to sleep for 11 seconds 00000100:00100000:3.0:1789366527.355080:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286758723584 00000100:00100000:3.0:1789366527.355085:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286758723584 00000100:00100000:3.0:1789366527.355114:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1789366527.355121:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638b4e38c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8cde4528-5832-4854-a387-4adacc3dd0ab+13:5813:x1876286758723584:12345-0@lo:256: 20000000:01000000:3.0:1789366527.355134:0:5808:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1789366527.355164:0:5808:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1789366527.355169:0:5808:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/4/3. 20000000:01000000:3.0:1789366527.355172:0:5808:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 88, version 4 00000100:00100000:3.0:1789366527.355261:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638b4e38c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8cde4528-5832-4854-a387-4adacc3dd0ab+13:5813:x1876286758723584:12345-0@lo:256: Request processed in 139us (215us total) trans 0 rc 0/0 00000100:00100000:1.0:1789366527.355269:0:5813:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9638987ea680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8cde4528-5832-4854-a387-4adacc3dd0ab:5813:1876286758723584:0@lo:256: 00000100:00100000:3.0:1789366527.355271:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 10000000:01000000:1.0:1789366527.355306:0:5813:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.123@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1789366527.355309:0:5813:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.123@tcp lock: ffff96388148f600/0x8da3486b955f2ed9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8da3486b955f2ee0 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366527.355314:0:5813:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.123@tcp lock: ffff96388148f600/0x8da3486b955f2ed9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8da3486b955f2ee0 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789366527.355318:0:5813:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:1.0:1789366527.355319:0:5813:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 16 10000000:01000000:1.0:1789366527.355324:0:5813:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:1.0:1789366527.355334:0:5813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.123@tcp lock: ffff96388148fa00/0x8da3486b955f2ee7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366527.355338:0:5813:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.123@tcp lock: ffff96388148fa00/0x8da3486b955f2ee7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366527.355343:0:5813:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.123@tcp lock: ffff96388148fa00/0x8da3486b955f2ee7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789366527.355350:0:5813:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9638987ea680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8cde4528-5832-4854-a387-4adacc3dd0ab:5813:1876286758723712:0@lo:101: 00000100:00100000:1.0:1789366527.355386:0:5813:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789366527.355408:0:5813:0:(client.c:2716:ptlrpc_set_wait()) set ffff963884dfdb40 going to sleep for 11 seconds 00000100:00100000:3.0:1789366527.355452:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286758723712 00000100:00100000:3.0:1789366527.355458:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286758723712 00000100:00100000:3.0:1789366527.355487:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1789366527.355494:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638b4e39c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8cde4528-5832-4854-a387-4adacc3dd0ab+13:5813:x1876286758723712:12345-0@lo:101: 00010000:00010000:3.0:1789366527.355502:0:5810:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789366527.355511:0:5810:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9638827f7600/0x8da3486b955f2eee lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x8da3486b955f2ee7 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366527.355526:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9638827f7600/0x8da3486b955f2eee lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8da3486b955f2ee7 expref: 14 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366527.355541:0:5810:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9638827f7600/0x8da3486b955f2eee lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8da3486b955f2ee7 expref: 14 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366527.355548:0:5810:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9638827f7600, rc 0) 00000100:00100000:3.0:1789366527.355583:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638b4e39c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8cde4528-5832-4854-a387-4adacc3dd0ab+14:5813:x1876286758723712:12345-0@lo:101: Request processed in 90us (195us total) trans 0 rc 0/0 00000100:00100000:3.0:1789366527.355590:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1789366527.355610:0:5813:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9638987ea680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8cde4528-5832-4854-a387-4adacc3dd0ab:5813:1876286758723712:0@lo:101: 00010000:00010000:1.0:1789366527.355620:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.123@tcp lock: ffff96388148fa00/0x8da3486b955f2ee7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x8da3486b955f2eee expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366527.355628:0:5813:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.123@tcp lock: ffff96388148fa00/0x8da3486b955f2ee7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x8da3486b955f2eee expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789366527.355666:0:5813:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9638987ea680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8cde4528-5832-4854-a387-4adacc3dd0ab:5813:1876286758723840:0@lo:501: 00000100:00100000:1.0:1789366527.355686:0:5813:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789366527.355700:0:5813:0:(client.c:2716:ptlrpc_set_wait()) set ffff963884dfdb40 going to sleep for 11 seconds 00000100:00100000:3.0:1789366527.355742:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286758723840 00000100:00100000:3.0:1789366527.355748:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286758723840 00000100:00100000:3.0:1789366527.355781:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1789366527.355788:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638b4e3b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8cde4528-5832-4854-a387-4adacc3dd0ab+14:5813:x1876286758723840:12345-0@lo:501: 00000100:00100000:3.0:1789366527.355970:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638b4e3b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8cde4528-5832-4854-a387-4adacc3dd0ab+14:5813:x1876286758723840:12345-0@lo:501: Request processed in 182us (280us total) trans 0 rc 0/0 00000100:00100000:3.0:1789366527.355977:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1789366527.356007:0:5813:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9638987ea680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8cde4528-5832-4854-a387-4adacc3dd0ab:5813:1876286758723840:0@lo:501: 00000100:00100000:1.0:1789366527.356036:0:5813:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9638987ea680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8cde4528-5832-4854-a387-4adacc3dd0ab:5813:1876286758723968:0@lo:503: 00000100:00100000:1.0:1789366527.356069:0:5813:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789366527.356096:0:5813:0:(client.c:2716:ptlrpc_set_wait()) set ffff963884dfdb40 going to sleep for 11 seconds 00000100:00100000:3.0:1789366527.356106:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286758723968 00000100:00100000:3.0:1789366527.356111:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286758723968 00000100:00100000:3.0:1789366527.356140:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1789366527.356148:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638b4e3bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8cde4528-5832-4854-a387-4adacc3dd0ab+14:5813:x1876286758723968:12345-0@lo:503: 00000100:00100000:3.0:1789366527.356430:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638b4e3bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8cde4528-5832-4854-a387-4adacc3dd0ab+14:5813:x1876286758723968:12345-0@lo:503: Request processed in 283us (359us total) trans 0 rc 0/0 00000100:00100000:3.0:1789366527.356437:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1789366527.356561:0:5813:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9638987ea680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8cde4528-5832-4854-a387-4adacc3dd0ab:5813:1876286758723968:0@lo:503: 00000100:00100000:3.0:1789366527.356814:0:7129:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9638bf5a8a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8cde4528-5832-4854-a387-4adacc3dd0ab:7129:1876286758724096:0@lo:502: 00000100:00100000:3.0:1789366527.356845:0:7129:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789366527.356871:0:7129:0:(client.c:2716:ptlrpc_set_wait()) set ffff96388a342f00 going to sleep for 11 seconds 00000100:00100000:0.0:1789366527.356891:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286758724096 00000100:00100000:0.0:1789366527.356895:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286758724096 00000100:00100000:0.0:1789366527.356934:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1789366527.356943:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638b4e3ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8cde4528-5832-4854-a387-4adacc3dd0ab+14:7129:x1876286758724096:12345-0@lo:502: 00000100:00100000:0.0:1789366527.357137:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638b4e3ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8cde4528-5832-4854-a387-4adacc3dd0ab+14:7129:x1876286758724096:12345-0@lo:502: Request processed in 195us (290us total) trans 0 rc 0/0 00000100:00100000:0.0:1789366527.357145:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1789366527.357179:0:7129:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9638bf5a8a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8cde4528-5832-4854-a387-4adacc3dd0ab:7129:1876286758724096:0@lo:502: 00000020:01000000:3.0:1789366527.357200:0:7129:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1789366527.357210:0:7129:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-mdt1/mdt1 00000020:00000080:3.0:1789366527.357217:0:7129:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789366527.357220:0:7129:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-OST0000 add osc 00000020:00000080:3.0:1789366527.357226:0:7129:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1789366527.357231:0:7129:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.202.123@tcp to nid 0x20000c0a8ca7b (192.168.202.123@tcp) 00000020:01000000:3.0:1789366527.357250:0:7129:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:3.0:1789366527.357253:0:7129:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1789366527.357266:0:7129:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff9638bfe7cd40) 00000020:00000080:3.0:1789366527.357283:0:7129:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type osp with refcount 2 00000020:00000080:3.0:1789366527.357288:0:7129:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1789366527.357349:0:7129:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:3.0:1789366527.357354:0:7129:0:(osd_handler.c:1574:osd_obd_connect()) connect #5 00000020:00000080:3.0:1789366527.357360:0:7129:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x8da3486b955f2efc 00010000:00080000:3.0:1789366527.357410:0:7129:0:(ldlm_lib.c:102:import_set_conn()) imp ffff963785035000@lustre-OST0000-osc-MDT0000: add connection 192.168.202.123@tcp at head 00010000:00010000:3.0:1789366527.357866:0:7129:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-3 is initialized 00000040:01000000:3.0:1789366527.369020:0:7129:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:3.0:1789366527.369040:0:7129:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:3.0:1789366527.369456:0:7129:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789366527.369568:0:7129:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789366527.369599:0:7129:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].1, 64 off8256 00000040:00080000:3.0:1789366527.369633:0:7129:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1, 64 off8256 00000040:00080000:2.0:1789366527.369948:0:7130:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1789366527.369954:0:7130:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x3:0x0] at index 1 of catalog [0x1:0x2:0x0] 00000020:00000080:3.0:1789366527.370315:0:7129:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1789366527.370325:0:7129:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1789366527.370351:0:7129:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:3.0:1789366527.370383:0:7129:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x8da3486b955f2f03 00000100:00080000:3.0:1789366527.370393:0:7129:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1789366527.370404:0:7129:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff963785035000 using connection 192.168.202.123@tcp/0@lo 00000100:00100000:3.0:1789366527.370436:0:7129:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9638bf5a8a80 x1876286758724224/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1789366527.370460:0:7129:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00100000:0.0:1789366527.370499:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9638bf5a8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3283:1876286758724224:0@lo:8: 00000020:01000000:3.0:1789366527.370520:0:7129:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789366527.370525:0:7129:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789366527.370528:0:7129:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-OST0000 add osc 00000020:01000000:3.0:1789366527.370531:0:7129:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789366527.370536:0:7129:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789366527.370538:0:7129:0:(obd_config.c:1563:class_process_config()) marker 15 (0x1) lustre sys.timeout 00000020:00000080:3.0:1789366527.370544:0:7129:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1789366527.370546:0:7129:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:0.0:1789366527.370557:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789366527.370561:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9638987ea680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3285:1876286758724352:0@lo:400: 00000100:00100000:3.0:1789366527.370573:0:7129:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9638bf5aa680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8cde4528-5832-4854-a387-4adacc3dd0ab:7129:1876286758724608:0@lo:502: 00000100:00100000:1.0:1789366527.370586:0:3286:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9638987e9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3286:1876286758724480:0@lo:400: 00000100:00100000:2.0:1789366527.370607:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789366527.370625:0:7129:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789366527.370653:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789366527.370654:0:7129:0:(client.c:2716:ptlrpc_set_wait()) set ffff96388a3426c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789366527.370665:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286758724352 00000100:00100000:0.0:1789366527.370672:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286758724352 00000100:00100000:3.0:1789366527.370677:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286758724608 00000100:00100000:3.0:1789366527.370683:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286758724608 00000100:00100000:2.0:1789366527.370697:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286758724224 00000100:00100000:2.0:1789366527.370703:0:6659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286758724224 00000100:00100000:1.0:1789366527.370707:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286758724480 00000100:00100000:0.0:1789366527.370711:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789366527.370713:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286758724480 00000100:00100000:3.0:1789366527.370742:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1789366527.370748:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638b6ea0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3285:x1876286758724352:12345-0@lo:400: 00000100:00100000:3.0:1789366527.370753:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638b4e38450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8cde4528-5832-4854-a387-4adacc3dd0ab+14:7129:x1876286758724608:12345-0@lo:502: 00000100:00100000:2.0:1789366527.370760:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789366527.370768:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638b4f19500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3283:x1876286758724224:12345-0@lo:8: 00000100:00100000:1.0:1789366527.370769:0:5815:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:1.0:1789366527.370779:0:5815:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_003' 00010000:00080000:2.0:1789366527.370792:0:6659:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 102 last 0 00000100:00080000:1.0:1789366527.370795:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789366527.370805:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638b6ea0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3285:x1876286758724352:12345-0@lo:400: Request processed in 84us (196us total) trans 0 rc 0/0 00000100:00100000:0.0:1789366527.370813:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000020:00000080:2.0:1789366527.370824:0:6659:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x8da3486b955f2f0a 00000100:00100000:0.0:1789366527.370836:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1789366527.370845:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638987e9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3286:x1876286758724480:12345-0@lo:400: 00002000:00100000:2.0:1789366527.370860:0:6659:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff963784ba6000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a06 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:2.0:1789366527.370866:0:6659:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00000001:00000004:2.0:1789366527.370870:0:6659:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00000100:00100000:0.0:1789366527.370885:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638987e9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3286:x1876286758724480:12345-0@lo:400: Request processed in 42us (233us total) trans 0 rc 0/0 00000100:00100000:0.0:1789366527.370890:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:1.0:1789366527.370906:0:3286:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9638987e9c00 x1876286758724480/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789366543 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789366527.370918:0:3286:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9638987e9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3286:1876286758724480:0@lo:400: 00010000:00080000:0.0:1789366527.370927:0:3285:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9638987ea680 x1876286758724352/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789366543 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789366527.370941:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9638987ea680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3285:1876286758724352:0@lo:400: 00002000:00100000:2.0:1789366527.370996:0:6659:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00000100:00100000:3.0:1789366527.371018:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638b4e38450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8cde4528-5832-4854-a387-4adacc3dd0ab+14:7129:x1876286758724608:12345-0@lo:502: Request processed in 268us (392us total) trans 0 rc 0/0 00000100:00100000:3.0:1789366527.371027:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1789366527.371038:0:7129:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9638bf5aa680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8cde4528-5832-4854-a387-4adacc3dd0ab:7129:1876286758724608:0@lo:502: 00000020:01000000:0.0:1789366527.371060:0:7129:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789366527.371064:0:7129:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789366527.371066:0:7129:0:(obd_config.c:1563:class_process_config()) marker 15 (0x2) lustre sys.timeout 00000040:00080000:0.0:1789366527.371070:0:7129:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 25 count 25 00000020:01000000:1.0:1789366527.371123:0:5813:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 16-24 (rc=0) 10000000:01000000:1.0:1789366527.371146:0:5813:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.123@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:1.0:1789366527.371156:0:5813:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.123@tcp lock: ffff96388148fa00/0x8da3486b955f2ee7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x8da3486b955f2eee expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366527.371167:0:5813:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.123@tcp lock: ffff96388148fa00/0x8da3486b955f2ee7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x8da3486b955f2eee expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00080000:2.0:1789366527.371174:0:6659:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 10000000:01000000:1.0:1789366527.371191:0:5813:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1789366527.371193:0:5813:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff963884956000 from 1 00000100:00080000:2.0:1789366527.371195:0:6659:0:(import.c:65:import_set_state_nolock()) ffff963784ba1000 : changing import state from RECOVER to FULL 10000000:01000000:1.0:1789366527.371196:0:5813:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1789366527.371218:0:5813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.123@tcp lock: ffff96388148f000/0x8da3486b955f2f11 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366527.371224:0:5813:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.123@tcp lock: ffff96388148f000/0x8da3486b955f2f11 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366527.371234:0:5813:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.123@tcp lock: ffff96388148f000/0x8da3486b955f2f11 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789366527.371255:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638b4f19500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3283:x1876286758724224:12345-0@lo:8: Request processed in 486us (696us total) trans 0 rc 0/0 00000100:00100000:1.0:1789366527.371258:0:5813:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9638987e9c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8cde4528-5832-4854-a387-4adacc3dd0ab:5813:1876286758724736:0@lo:101: 00010000:00080000:0.0:1789366527.371261:0:3283:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9638bf5a8a80 x1876286758724224/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1789366537 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789366527.371273:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789366527.371275:0:3283:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1789366527.371281:0:3283:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 1 00000100:00080000:0.0:1789366527.371288:0:3283:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00100000:1.0:1789366527.371293:0:5813:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1789366527.371293:0:3283:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:0.0:1789366527.371297:0:3283:0:(import.c:65:import_set_state_nolock()) ffff963785035000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1789366527.371305:0:3283:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1789366527.371311:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9638bf5a8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3283:1876286758724224:0@lo:8: 00000004:00080000:2.0:1789366527.371327:0:7130:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000100:00100000:3.0:1789366527.371328:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286758724736 00000100:00100000:1.0:1789366527.371330:0:5813:0:(client.c:2716:ptlrpc_set_wait()) set ffff963884dfdb40 going to sleep for 11 seconds 00000100:00100000:3.0:1789366527.371333:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286758724736 00000100:00100000:3.0:1789366527.371359:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1789366527.371377:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638b4e3b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8cde4528-5832-4854-a387-4adacc3dd0ab+14:5813:x1876286758724736:12345-0@lo:101: 00010000:00010000:3.0:1789366527.371384:0:5808:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789366527.371402:0:5808:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9638832d2000/0x8da3486b955f2f18 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x8da3486b955f2f11 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366527.371422:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9638832d2000/0x8da3486b955f2f18 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8da3486b955f2f11 expref: 15 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366527.371433:0:5808:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9638832d2000/0x8da3486b955f2f18 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8da3486b955f2f11 expref: 15 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1789366527.371443:0:7130:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 102835723994ns, next at 0ns, rc = 0 00010000:00010000:3.0:1789366527.371451:0:5808:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9638832d2000, rc 0) 00000100:00100000:3.0:1789366527.371491:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638b4e3b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8cde4528-5832-4854-a387-4adacc3dd0ab+15:5813:x1876286758724736:12345-0@lo:101: Request processed in 126us (199us total) trans 0 rc 0/0 00000100:00100000:3.0:1789366527.371499:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1789366527.371511:0:5813:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9638987e9c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8cde4528-5832-4854-a387-4adacc3dd0ab:5813:1876286758724736:0@lo:101: 00010000:00010000:0.0:1789366527.371526:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.123@tcp lock: ffff96388148f000/0x8da3486b955f2f11 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8da3486b955f2f18 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366527.371536:0:5813:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.123@tcp lock: ffff96388148f000/0x8da3486b955f2f11 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x8da3486b955f2f18 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789366527.371574:0:5813:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9638b4f18e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8cde4528-5832-4854-a387-4adacc3dd0ab:5813:1876286758724864:0@lo:501: 00000100:00100000:0.0:1789366527.371601:0:5813:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789366527.371624:0:5813:0:(client.c:2716:ptlrpc_set_wait()) set ffff9638987bc840 going to sleep for 11 seconds 00000100:00100000:2.0:1789366527.371745:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286758724864 00000100:00100000:2.0:1789366527.371749:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286758724864 00000100:00100000:2.0:1789366527.371770:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1789366527.371777:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638b4e39850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8cde4528-5832-4854-a387-4adacc3dd0ab+15:5813:x1876286758724864:12345-0@lo:501: 00000100:00100000:2.0:1789366527.371943:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638b4e39850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8cde4528-5832-4854-a387-4adacc3dd0ab+15:5813:x1876286758724864:12345-0@lo:501: Request processed in 166us (341us total) trans 0 rc 0/0 00000100:00100000:2.0:1789366527.371955:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1789366527.371959:0:5813:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9638b4f18e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8cde4528-5832-4854-a387-4adacc3dd0ab:5813:1876286758724864:0@lo:501: 00000100:00100000:0.0:1789366527.371990:0:5813:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9638b4f18e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8cde4528-5832-4854-a387-4adacc3dd0ab:5813:1876286758724992:0@lo:503: 00000100:00100000:0.0:1789366527.372025:0:5813:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789366527.372048:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286758724992 00000100:00100000:2.0:1789366527.372052:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286758724992 00000100:00100000:0.0:1789366527.372056:0:5813:0:(client.c:2716:ptlrpc_set_wait()) set ffff9638987bc840 going to sleep for 11 seconds 00000100:00100000:2.0:1789366527.372072:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1789366527.372081:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638b4e3a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8cde4528-5832-4854-a387-4adacc3dd0ab+15:5813:x1876286758724992:12345-0@lo:503: 00000100:00100000:2.0:1789366527.372429:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638b4e3a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8cde4528-5832-4854-a387-4adacc3dd0ab+15:5813:x1876286758724992:12345-0@lo:503: Request processed in 349us (402us total) trans 0 rc 0/0 00000100:00100000:2.0:1789366527.372437:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1789366527.372512:0:5813:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9638b4f18e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8cde4528-5832-4854-a387-4adacc3dd0ab:5813:1876286758724992:0@lo:503: 00000100:00100000:3.0:1789366527.372950:0:7133:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9638bf5a9c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8cde4528-5832-4854-a387-4adacc3dd0ab:7133:1876286758725120:0@lo:502: 00000100:00100000:3.0:1789366527.372992:0:7133:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789366527.373022:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286758725120 00000100:00100000:3.0:1789366527.373027:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286758725120 00000100:00100000:3.0:1789366527.373064:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1789366527.373073:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638b4e3a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8cde4528-5832-4854-a387-4adacc3dd0ab+15:7133:x1876286758725120:12345-0@lo:502: 00000100:00100000:3.0:1789366527.373313:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638b4e3a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8cde4528-5832-4854-a387-4adacc3dd0ab+15:7133:x1876286758725120:12345-0@lo:502: Request processed in 241us (321us total) trans 0 rc 0/0 00000100:00100000:3.0:1789366527.373322:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1789366527.373402:0:7133:0:(client.c:2716:ptlrpc_set_wait()) set ffff96388a342900 going to sleep for 11 seconds 00000100:00100000:3.0:1789366527.373421:0:7133:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9638bf5a9c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8cde4528-5832-4854-a387-4adacc3dd0ab:7133:1876286758725120:0@lo:502: 00000020:01000000:3.0:1789366527.373450:0:7133:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789366527.373467:0:7133:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789366527.373470:0:7133:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1789366527.373480:0:7133:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff963884956000 00000020:00000080:3.0:1789366527.373483:0:7133:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1789366527.373507:0:7133:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9638bf5a9c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8cde4528-5832-4854-a387-4adacc3dd0ab:7133:1876286758725248:0@lo:502: 00000100:00100000:3.0:1789366527.373546:0:7133:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789366527.373570:0:7133:0:(client.c:2716:ptlrpc_set_wait()) set ffff96388a342900 going to sleep for 11 seconds 00000100:00100000:0.0:1789366527.373572:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286758725248 00000100:00100000:0.0:1789366527.373578:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286758725248 00000100:00100000:0.0:1789366527.373608:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1789366527.373617:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638b4e3a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8cde4528-5832-4854-a387-4adacc3dd0ab+15:7133:x1876286758725248:12345-0@lo:502: 00000100:00100000:0.0:1789366527.373814:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638b4e3a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8cde4528-5832-4854-a387-4adacc3dd0ab+15:7133:x1876286758725248:12345-0@lo:502: Request processed in 199us (268us total) trans 0 rc 0/0 00000100:00100000:0.0:1789366527.373822:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1789366527.373865:0:7133:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9638bf5a9c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8cde4528-5832-4854-a387-4adacc3dd0ab:7133:1876286758725248:0@lo:502: 00000020:01000000:0.0:1789366527.373888:0:7133:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789366527.373892:0:7133:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789366527.373894:0:7133:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:0.0:1789366527.373898:0:7133:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 00000020:01000000:3.0:1789366527.373942:0:5813:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:3.0:1789366527.373976:0:5813:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.123@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1789366527.373984:0:5813:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.123@tcp lock: ffff96388148f000/0x8da3486b955f2f11 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8da3486b955f2f18 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366527.373994:0:5813:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.123@tcp lock: ffff96388148f000/0x8da3486b955f2f11 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8da3486b955f2f18 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789366527.374003:0:5813:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:3.0:1789366527.374006:0:5813:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff963882f5cd40 from 1 10000000:01000000:3.0:1789366527.374009:0:5813:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1789366527.374030:0:5813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.123@tcp lock: ffff9638832d3400/0x8da3486b955f2f1f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366527.374039:0:5813:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.123@tcp lock: ffff9638832d3400/0x8da3486b955f2f1f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366527.374047:0:5813:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.123@tcp lock: ffff9638832d3400/0x8da3486b955f2f1f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789366527.374059:0:5813:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9638bf5a9180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8cde4528-5832-4854-a387-4adacc3dd0ab:5813:1876286758725376:0@lo:101: 00000100:00100000:3.0:1789366527.374090:0:5813:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789366527.374111:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286758725376 00000100:00100000:0.0:1789366527.374114:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286758725376 00000100:00100000:3.0:1789366527.374124:0:5813:0:(client.c:2716:ptlrpc_set_wait()) set ffff96388a3420c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789366527.374144:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1789366527.374153:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638b4e3b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8cde4528-5832-4854-a387-4adacc3dd0ab+15:5813:x1876286758725376:12345-0@lo:101: 00010000:00010000:0.0:1789366527.374162:0:5810:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789366527.374182:0:5810:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff963880031400/0x8da3486b955f2f26 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x8da3486b955f2f1f expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366527.374203:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff963880031400/0x8da3486b955f2f26 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8da3486b955f2f1f expref: 16 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366527.374214:0:5810:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff963880031400/0x8da3486b955f2f26 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8da3486b955f2f1f expref: 16 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366527.374229:0:5810:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff963880031400, rc 0) 00000100:00100000:0.0:1789366527.374270:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638b4e3b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8cde4528-5832-4854-a387-4adacc3dd0ab+16:5813:x1876286758725376:12345-0@lo:101: Request processed in 117us (178us total) trans 0 rc 0/0 00000100:00100000:0.0:1789366527.374277:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1789366527.374300:0:5813:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9638bf5a9180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8cde4528-5832-4854-a387-4adacc3dd0ab:5813:1876286758725376:0@lo:101: 00010000:00010000:3.0:1789366527.374316:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.123@tcp lock: ffff9638832d3400/0x8da3486b955f2f1f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x8da3486b955f2f26 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366527.374325:0:5813:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.123@tcp lock: ffff9638832d3400/0x8da3486b955f2f1f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x8da3486b955f2f26 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789366527.374387:0:5813:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9638bf5a9180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8cde4528-5832-4854-a387-4adacc3dd0ab:5813:1876286758725504:0@lo:501: 00000100:00100000:3.0:1789366527.374428:0:5813:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789366527.374451:0:5813:0:(client.c:2716:ptlrpc_set_wait()) set ffff96388a3420c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789366527.374494:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286758725504 00000100:00100000:0.0:1789366527.374499:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286758725504 00000100:00100000:0.0:1789366527.374525:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1789366527.374532:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638b4e39050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8cde4528-5832-4854-a387-4adacc3dd0ab+16:5813:x1876286758725504:12345-0@lo:501: 00000100:00100000:0.0:1789366527.374659:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638b4e39050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8cde4528-5832-4854-a387-4adacc3dd0ab+16:5813:x1876286758725504:12345-0@lo:501: Request processed in 128us (233us total) trans 0 rc -2/-2 00000100:00100000:0.0:1789366527.374667:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1789366527.374687:0:5813:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9638bf5a9180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8cde4528-5832-4854-a387-4adacc3dd0ab:5813:1876286758725504:0@lo:501: 10000000:01000000:3.0:1789366527.374756:0:5813:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.123@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:3.0:1789366527.374762:0:5813:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.123@tcp lock: ffff9638832d3400/0x8da3486b955f2f1f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x8da3486b955f2f26 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366527.374770:0:5813:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.123@tcp lock: ffff9638832d3400/0x8da3486b955f2f1f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x8da3486b955f2f26 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1789366527.381689:0:5837:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00000004:00080000:2.0:1789366527.381743:0:7131:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x100000000:0x1:0x0] 00000100:00100000:1.0:1789366527.381758:0:3287:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9638b6ea2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3287:1876286758725632:0@lo:13: 00000100:00100000:2.0:1789366527.381768:0:7131:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9638b6ea3100 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:7131:1876286758725760:0@lo:7: 00000100:00100000:2.0:1789366527.381842:0:7131:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789366527.381842:0:3287:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789366527.381896:0:6662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286758725632 00000100:00100000:0.0:1789366527.381896:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286758725760 00000100:00100000:2.0:1789366527.381900:0:7131:0:(client.c:2716:ptlrpc_set_wait()) set ffff96389883ed80 going to sleep for 11 seconds 00000100:00100000:3.0:1789366527.381905:0:6662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286758725632 00000100:00100000:0.0:1789366527.381906:0:6661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286758725760 00000100:00080000:2.0:1789366527.381945:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789366527.381963:0:6662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789366527.381964:0:6661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789366527.381979:0:6661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638b6ea0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:7131:x1876286758725760:12345-0@lo:7: 00000100:00100000:3.0:1789366527.381987:0:6662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638987e9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3287:x1876286758725632:12345-0@lo:13: 00000100:00100000:1.0:1789366527.381991:0:6663:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 2 min 2 max 16 00000100:00100000:1.0:1789366527.382000:0:6663:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_002' 00002000:00000024:3.0:1789366527.382022:0:6662:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3860856832 avail 3858759680 00000100:00100000:3.0:1789366527.382075:0:6662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638987e9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3287:x1876286758725632:12345-0@lo:13: Request processed in 93us (240us total) trans 0 rc 0/0 00000100:00100000:3.0:1789366527.382084:0:6662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:1.0:1789366527.382110:0:3287:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9638b6ea2300 x1876286758725632/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789366543 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789366527.382131:0:3287:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9638b6ea2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3287:1876286758725632:0@lo:13: 00002000:00080000:0.0:1789366527.385024:0:6661:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x0 00002000:00080000:0.0:1789366527.385031:0:6661:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x100000000:0x0:0x0] 00000100:00100000:0.0:1789366527.385097:0:6661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638b6ea0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:7131:x1876286758725760:12345-0@lo:7: Request processed in 3122us (3263us total) trans 0 rc 0/0 00000100:00100000:0.0:1789366527.385105:0:6661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1789366527.385136:0:7131:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9638b6ea3100 x1876286758725760/t0(0) o7->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1789366543 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789366527.385146:0:7131:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9638b6ea3100 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:7131:1876286758725760:0@lo:7: 00000004:00080000:2.0:1789366527.385155:0:7131:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0000: Got last_fid [0x100000000:0x0:0x0] 00000100:00100000:2.0:1789366527.385180:0:7131:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9638b6ea3100 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:7131:1876286758725888:0@lo:5: 00000100:00100000:2.0:1789366527.385203:0:7131:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789366527.385238:0:7131:0:(client.c:2716:ptlrpc_set_wait()) set ffff96389883ed80 going to sleep for 11 seconds 00000100:00100000:0.0:1789366527.385240:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286758725888 00000100:00100000:0.0:1789366527.385244:0:6659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286758725888 00000100:00100000:0.0:1789366527.385272:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1789366527.385278:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638b6ea3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:7131:x1876286758725888:12345-0@lo:5: 00002000:00080000:0.0:1789366527.385295:0:6659:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:0.0:1789366527.385302:0:6659:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 1 objects in group 0x0 at 1 00000100:00100000:0.0:1789366527.385467:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638b6ea3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:7131:x1876286758725888:12345-0@lo:5: Request processed in 187us (261us total) trans 4294967297 rc 0/0 00000100:00100000:0.0:1789366527.385474:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:2.0:1789366527.385489:0:7131:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9638b6ea3100 x1876286758725888/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1789366543 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789366527.385498:0:7131:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9638b6ea3100 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:7131:1876286758725888:0@lo:5: 00000004:00080000:2.0:1789366527.385503:0:7131:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x100000000:0x1:0x0] from OST, last_created [0x100000000:0x1:0x0]last_used is [0x100000000:0x1:0x0] 00000100:00100000:2.0:1789366527.385524:0:7131:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9638b6ea2a00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:7131:1876286758726016:0@lo:700: 00000100:00100000:2.0:1789366527.385540:0:7131:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789366527.385553:0:7131:0:(client.c:2716:ptlrpc_set_wait()) set ffff96389883ed80 going to sleep for 11 seconds 00000100:00100000:0.0:1789366527.385566:0:6667:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286758726016 00000100:00100000:0.0:1789366527.385570:0:6667:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286758726016 00000100:00100000:0.0:1789366527.385589:0:6667:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789366527.385594:0:6667:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638b6ea3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+7:7131:x1876286758726016:12345-0@lo:700: 00000100:00100000:0.0:1789366527.385615:0:6667:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9638b4f1a300 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:6667:1876286758726144:0@lo:700: 00000100:00100000:0.0:1789366527.385636:0:6667:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789366527.385650:0:6667:0:(client.c:2716:ptlrpc_set_wait()) set ffff9638987bc000 going to sleep for 11 seconds 00000100:00100000:2.0:1789366527.385671:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286758726144 00000100:00100000:2.0:1789366527.385675:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286758726144 00000100:00100000:2.0:1789366527.385706:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789366527.385711:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638b4f1b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:6667:x1876286758726144:12345-0@lo:700: 40000000:02000000:2.0:1789366527.393283:0:5822:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:0:ost 00000100:00100000:2.0:1789366527.396007:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638b4f1b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:6667:x1876286758726144:12345-0@lo:700: Request processed in 10292us (10365us total) trans 0 rc 0/0 00000100:00100000:2.0:1789366527.396017:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:0.0:1789366527.396059:0:6667:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9638b4f1a300 x1876286758726144/t0(0) o700->lustre-MDT0000-lwp-OST0000@0@lo:32/10 lens 264/248 e 0 to 0 dl 1789366543 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789366527.396075:0:6667:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9638b4f1a300 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:6667:1876286758726144:0@lo:700: 40000000:02000000:0.0:1789366527.396092:0:6667:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0000-super: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:0:ost] 00000001:00080000:1.0:1789366527.413662:0:6685:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967297 is committed 00000001:00100000:1.0:1789366527.413677:0:6685:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:3.0:1789366527.413763:0:6667:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638b6ea3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:7131:x1876286758726016:12345-0@lo:700: Request processed in 28164us (28216us total) trans 0 rc 0/0 00000100:00100000:3.0:1789366527.413778:0:6667:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:2.0:1789366527.413778:0:7131:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9638b6ea2a00 x1876286758726016/t0(0) o700->lustre-OST0000-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1789366543 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789366527.413790:0:7131:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:2.0:1789366527.413804:0:7131:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9638b6ea2a00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:7131:1876286758726016:0@lo:700: 00000004:02000040:2.0:1789366527.421565:0:7131:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x240000400 00000100:00100000:2.0:1789366527.423541:0:7131:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9638b6ea2a00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:7131:1876286758726272:0@lo:5: 00000100:00100000:2.0:1789366527.423604:0:7131:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789366527.423658:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286758726272 00000100:00100000:0.0:1789366527.423667:0:6661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286758726272 00000100:00100000:2.0:1789366527.423670:0:7131:0:(client.c:2716:ptlrpc_set_wait()) set ffff96389883e600 going to sleep for 11 seconds 00000100:00100000:0.0:1789366527.423747:0:6661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1789366527.423758:0:6661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638b6ea3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:7131:x1876286758726272:12345-0@lo:5: 00002000:00080000:0.0:1789366527.426797:0:6661:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x240000400 00002000:00080000:0.0:1789366527.426811:0:6661:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x240000400 at 2 00000100:00100000:0.0:1789366527.428281:0:6661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638b6ea3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:7131:x1876286758726272:12345-0@lo:5: Request processed in 4524us (4675us total) trans 4294967298 rc 0/0 00000100:00100000:0.0:1789366527.428289:0:6661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:2.0:1789366527.428332:0:7131:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9638b6ea2a00 x1876286758726272/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1789366543 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789366527.428349:0:7131:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9638b6ea2a00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:7131:1876286758726272:0@lo:5: 00000004:00080000:2.0:1789366527.428372:0:7131:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x240000400:0x1:0x0]-[0x240000400:0x21:0x0] 00010000:00010000:1.0:1789366527.863941:0:6675:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1789366528.887534:0:6685:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967298 is committed 00010000:00010000:3.0:1789366528.887792:0:5805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789366529.911821:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789366530.935856:0:6675:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1789366531.278097:0:7601:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1789366531.278101:0:7601:0:(obd_mount.c:926:lmd_print()) device: lustre-ost2/ost2 00000080:01200004:3.0:1789366531.278203:0:7601:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff963883577000 00000020:01000004:3.0:1789366531.278219:0:7601:0:(tgt_mount.c:2506:osd_start()) Attempting to start lustre-OST0001, type=osd-zfs, lsifl=200062, mountfl=0 00000020:01000004:3.0:1789366531.278232:0:7601:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-zfs) 00000020:00000080:3.0:1789366531.278246:0:7601:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff9638bfe799c0) 00000020:00000080:3.0:1789366531.278259:0:7601:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type osd-zfs with refcount 2 00100000:10000000:2.0:1789366531.302441:0:7601:0:(scrub.c:230:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00100000:10000000:2.0:1789366531.302708:0:7601:0:(scrub.c:230:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00100000:10000000:2.0:1789366531.322707:0:7601:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:2.0:1789366531.332144:0:7601:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:2.0:1789366531.332183:0:7601:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:2.0:1789366531.332245:0:7601:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:2.0:1789366531.332283:0:7601:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:2.0:1789366531.332689:0:7601:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:2.0:1789366531.332704:0:7601:0:(osd_handler.c:1574:osd_obd_connect()) connect #0 00000020:00000080:2.0:1789366531.332750:0:7601:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x8da3486b955f2f34 00000020:01000004:2.0:1789366531.332761:0:7601:0:(tgt_mount.c:2591:server_fill_super()) Found service lustre-OST0001 on device lustre-ost2/ost2 00000020:01000004:2.0:1789366531.332789:0:7601:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.202.123@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1789366531.332794:0:7601:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.202.123@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1789366531.332800:0:7601:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-OST0001 00000020:01000004:2.0:1789366531.332826:0:7601:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost2/ost2 10000000:01000000:2.0:1789366531.332831:0:7601:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.123@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:3.0:1789366531.346964:0:7601:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.123@tcp ctxt 0 is initialized 00000020:01000004:3.0:1789366531.347015:0:7601:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.202.123@tcp, index=0001, flags=0x20062 00000020:01000004:3.0:1789366531.347020:0:7601:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1789366531.347022:0:7601:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1789366531.347023:0:7601:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789366531.347024:0:7601:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789366531.347025:0:7601:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789366531.347027:0:7601:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789366531.347028:0:7601:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1789366531.347030:0:7601:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1789366531.347032:0:7601:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1789366531.347034:0:7601:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789366531.347035:0:7601:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1789366531.347039:0:7601:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020062 00000020:01000004:3.0:1789366531.347042:0:7601:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1789366531.347043:0:7601:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1789366531.347044:0:7601:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789366531.347045:0:7601:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789366531.347047:0:7601:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789366531.347048:0:7601:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789366531.347049:0:7601:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1789366531.347050:0:7601:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1789366531.347051:0:7601:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1789366531.347052:0:7601:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789366531.347054:0:7601:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1789366531.347093:0:7601:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:3.0:1789366531.347116:0:7601:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9638bf5a9180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8cde4528-5832-4854-a387-4adacc3dd0ab:7601:1876286758726400:0@lo:253: 00000100:00100000:3.0:1789366531.347205:0:7601:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789366531.347326:0:7601:0:(client.c:2716:ptlrpc_set_wait()) set ffff963889968780 going to sleep for 11 seconds 00000100:00100000:0.0:1789366531.347397:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286758726400 00000100:00100000:0.0:1789366531.347407:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286758726400 00000100:00100000:0.0:1789366531.347470:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1789366531.347482:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638b4e38850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8cde4528-5832-4854-a387-4adacc3dd0ab+16:7601:x1876286758726400:12345-0@lo:253: 20000000:01000000:0.0:1789366531.347524:0:5810:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:0.0:1789366531.347529:0:5810:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0001, index=1 20000000:01000000:0.0:1789366531.347535:0:5810:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0001 to 1 20000000:01000000:0.0:1789366531.347538:0:5810:0:(mgs_llog.c:3862:mgs_write_log_ost()) writing new ost lustre-OST0001 00000040:00080000:0.0:1789366531.348610:0:5810:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789366531.350158:0:5810:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 20000000:01000000:3.0:1789366531.350184:0:5810:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf001 obdfilter lustre-OST0001_UUID (null) (null) 00000040:00080000:3.0:1789366531.350246:0:5810:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 128 off8544 20000000:01000000:3.0:1789366531.350257:0:5810:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf003 dev type f (null) 00000040:00080000:3.0:1789366531.350289:0:5810:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 112 off8656 00000040:00080000:3.0:1789366531.350353:0:5810:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8880 00000040:00080000:3.0:1789366531.350825:0:5810:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 224 off12648 20000000:01000000:3.0:1789366531.350848:0:5810:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.202.123@tcp 20000000:01000000:3.0:1789366531.350857:0:5810:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.202.123@tcp (null) (null) (null) 00000040:00080000:3.0:1789366531.350897:0:5810:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 88 off12736 20000000:01000000:3.0:1789366531.350906:0:5810:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:3.0:1789366531.350954:0:5810:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 144 off12880 20000000:01000000:3.0:1789366531.350963:0:5810:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf003 lustre-OST0001_UUID 192.168.202.123@tcp (null) (null) 00000040:00080000:3.0:1789366531.350996:0:5810:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 152 off13032 20000000:01000000:3.0:1789366531.351006:0:5810:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:3.0:1789366531.351040:0:5810:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 136 off13168 00000040:00080000:3.0:1789366531.351104:0:5810:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13392 00000040:00080000:3.0:1789366531.351854:0:5810:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].30, 224 off13416 20000000:01000000:3.0:1789366531.351867:0:5810:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.202.123@tcp 20000000:01000000:3.0:1789366531.351869:0:5810:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.202.123@tcp (null) (null) (null) 00000040:00080000:3.0:1789366531.351891:0:5810:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].31, 88 off13504 20000000:01000000:3.0:1789366531.351895:0:5810:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:3.0:1789366531.351910:0:5810:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].32, 128 off13632 20000000:01000000:3.0:1789366531.351914:0:5810:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf003 lustre-OST0001_UUID 192.168.202.123@tcp (null) (null) 00000040:00080000:3.0:1789366531.351929:0:5810:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].33, 144 off13776 20000000:01000000:3.0:1789366531.351933:0:5810:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:3.0:1789366531.351976:0:5810:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].34, 128 off13904 00000040:00080000:3.0:1789366531.352014:0:5810:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].35, 224 off14128 20000000:01000000:3.0:1789366531.352032:0:5810:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' sys.timeout=20 ', param: 'autodegrade=on' 20000000:01000000:3.0:1789366531.352035:0:5810:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'autodegrade=on' 20000000:01000000:3.0:1789366531.352042:0:5810:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'sys.timeout=20' 20000000:01000000:3.0:1789366531.352044:0:5810:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:3.0:1789366531.352046:0:5810:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:3.0:1789366531.352063:0:5810:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:3.0:1789366531.352066:0:5810:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:3.0:1789366531.352105:0:5810:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:3.0:1789366531.352108:0:5810:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:0.0:1789366531.352538:0:7603:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 27 marker 14 1->4: lustre sys.timeout 20000000:01000000:0.0:1789366531.352574:0:7603:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 29 marker 14 2->4: lustre sys.timeout 00000040:00080000:0.0:1789366531.352628:0:7603:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 36 count 36 00000040:00080000:3.0:1789366531.352871:0:5810:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].36, 224 off14352 00000040:00080000:3.0:1789366531.352895:0:5810:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].37, 80 off14432 00000040:00080000:3.0:1789366531.352912:0:5810:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].38, 224 off14656 20000000:01000000:3.0:1789366531.352926:0:5810:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:3.0:1789366531.352927:0:5810:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.timeout fl=4 00000040:00080000:3.0:1789366531.353239:0:7604:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 5 count 5 00000040:00080000:0.0:1789366531.353365:0:5810:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9104 00000040:00080000:0.0:1789366531.353386:0:5810:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 80 off9184 00000040:00080000:0.0:1789366531.353417:0:5810:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 224 off9408 20000000:01000000:0.0:1789366531.353425:0:5810:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:0.0:1789366531.353426:0:5810:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:3.0:1789366531.353774:0:7605:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 22 marker 15 1->4: lustre sys.timeout 20000000:01000000:3.0:1789366531.353825:0:7605:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 24 marker 15 2->4: lustre sys.timeout 00000040:00080000:3.0:1789366531.353874:0:7605:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 31 count 31 00000040:00080000:0.0:1789366531.354050:0:5810:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 224 off13616 00000040:00080000:0.0:1789366531.354098:0:5810:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 80 off13696 00000040:00080000:0.0:1789366531.354144:0:5810:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 224 off13920 20000000:01000000:0.0:1789366531.354155:0:5810:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:0.0:1789366531.354157:0:5810:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 20000000:01000000:3.0:1789366531.354698:0:7606:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 5 marker 16 1->4: lustre sys.timeout 20000000:01000000:3.0:1789366531.354785:0:7606:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 7 marker 16 2->4: lustre sys.timeout 00000040:00080000:3.0:1789366531.354820:0:7606:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 8 count 8 00000040:00080000:0.0:1789366531.354982:0:5810:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 224 off9632 00000040:00080000:0.0:1789366531.355024:0:5810:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 80 off9712 00000040:00080000:0.0:1789366531.355075:0:5810:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off9936 10000000:01000000:0.0:1789366531.355095:0:5810:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:0.0:1789366531.355120:0:5810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff963880031e00/0x8da3486b955f2f3b lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366531.355140:0:5810:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff96388148e200/0x8da3486b955f2e7e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8da3486b955f2e77 expref: 16 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366531.355148:0:5810:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff96388148fe00/0x8da3486b955f2ea8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8da3486b955f2ea1 expref: 16 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366531.355152:0:5810:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff96388148e400/0x8da3486b955f2ed2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8da3486b955f2ecb expref: 16 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366531.355163:0:5810:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9638827f7600/0x8da3486b955f2eee lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8da3486b955f2ee7 expref: 16 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366531.355168:0:5810:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff963880031400/0x8da3486b955f2f26 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8da3486b955f2f1f expref: 16 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366531.355173:0:5810:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff963880031e00/0x8da3486b955f2f3b lrc: 8/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366531.355211:0:5810:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff963880031400/0x8da3486b955f2f26 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x8da3486b955f2f1f expref: 16 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366531.355233:0:5810:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff963880031400/0x8da3486b955f2f26 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x8da3486b955f2f1f expref: 16 pid: 5810 timeout: 256 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789366531.355245:0:5810:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9638b4f1a300 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5810:1876286758726528:0@lo:104: 00000100:00100000:0.0:1789366531.355324:0:5810:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789366531.355405:0:5810:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9638827f7600/0x8da3486b955f2eee lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x8da3486b955f2ee7 expref: 16 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366531.355414:0:5810:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9638827f7600/0x8da3486b955f2eee lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x8da3486b955f2ee7 expref: 16 pid: 5810 timeout: 256 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789366531.355422:0:5810:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9638b4f1b800 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5810:1876286758726656:0@lo:104: 00000100:00100000:0.0:1789366531.355454:0:5810:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789366531.355497:0:5810:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff96388148e400/0x8da3486b955f2ed2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x8da3486b955f2ecb expref: 16 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366531.355505:0:5810:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff96388148e400/0x8da3486b955f2ed2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x8da3486b955f2ecb expref: 16 pid: 5808 timeout: 256 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789366531.355520:0:5810:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9638b4f1aa00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5810:1876286758726784:0@lo:104: 00010000:00010000:0.0:1789366531.355547:0:5810:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff96388148fe00/0x8da3486b955f2ea8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x8da3486b955f2ea1 expref: 16 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366531.355555:0:5810:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff96388148fe00/0x8da3486b955f2ea8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x8da3486b955f2ea1 expref: 16 pid: 5808 timeout: 256 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789366531.355564:0:5810:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9638b4f1b480 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5810:1876286758726912:0@lo:104: 00010000:00010000:0.0:1789366531.355583:0:5810:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff96388148e200/0x8da3486b955f2e7e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x8da3486b955f2e77 expref: 16 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366531.355588:0:5810:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff96388148e200/0x8da3486b955f2e7e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x8da3486b955f2e77 expref: 16 pid: 5808 timeout: 256 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789366531.355593:0:5810:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9638b4f18000 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5810:1876286758727040:0@lo:104: 00000100:00100000:0.0:1789366531.355603:0:5810:0:(client.c:2716:ptlrpc_set_wait()) set ffff963883ba5e40 going to sleep for 11 seconds 00000100:00100000:3.0:1789366531.355661:0:6674:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1789366531.355679:0:6674:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789366531.355704:0:6674:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789366531.355713:0:6674:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789366531.355755:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286758726528 00000100:00100000:3.0:1789366531.355762:0:6674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286758726528 00000100:00100000:2.0:1789366531.355780:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286758726656 00000100:00100000:2.0:1789366531.355788:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286758726656 00000100:00100000:3.0:1789366531.355811:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286758726784 00000100:00100000:3.0:1789366531.355816:0:6674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286758726784 00000100:00100000:2.0:1789366531.355816:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286758726912 00000100:00100000:2.0:1789366531.355822:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286758726912 00000100:00100000:3.0:1789366531.355836:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286758727040 00000100:00100000:3.0:1789366531.355840:0:6674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286758727040 00000100:00100000:2.0:1789366531.355848:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1789366531.355860:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638b4f18380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8cde4528-5832-4854-a387-4adacc3dd0ab+7:5810:x1876286758726528:12345-0@lo:104: 00010000:00010000:2.0:1789366531.355875:0:5799:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.123@tcp lock: ffff9638832d3400/0x8da3486b955f2f1f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x8da3486b955f2f26 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789366531.355913:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1789366531.355920:0:6674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963882f77850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:8cde4528-5832-4854-a387-4adacc3dd0ab+7:5810:x1876286758726656:12345-0@lo:104: 00010000:00010000:3.0:1789366531.355928:0:6674:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.123@tcp lock: ffff96388148fa00/0x8da3486b955f2ee7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x8da3486b955f2eee expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366531.355946:0:5799:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1789366531.355955:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638b4f18380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8cde4528-5832-4854-a387-4adacc3dd0ab+7:5810:x1876286758726528:12345-0@lo:104: Request processed in 97us (630us total) trans 0 rc 0/0 00000100:00100000:2.0:1789366531.355964:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00010000:3.0:1789366531.355969:0:6674:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1789366531.355978:0:6674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963882f77850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:8cde4528-5832-4854-a387-4adacc3dd0ab+7:5810:x1876286758726656:12345-0@lo:104: Request processed in 57us (521us total) trans 0 rc 0/0 00000100:00100000:3.0:1789366531.355985:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1789366531.356001:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1789366531.356018:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638bf5a9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8cde4528-5832-4854-a387-4adacc3dd0ab+6:5810:x1876286758726784:12345-0@lo:104: 00010000:00010000:2.0:1789366531.356027:0:5799:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.123@tcp lock: ffff9638827f6200/0x8da3486b955f2ecb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x8da3486b955f2ed2 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789366531.356047:0:5810:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9638b4f1a300 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5810:1876286758726528:0@lo:104: 00000100:00100000:0.0:1789366531.356059:0:5810:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9638b4f1b800 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5810:1876286758726656:0@lo:104: 00000100:00100000:0.0:1789366531.356081:0:5810:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9638b4f1aa00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5810:1876286758726784:0@lo:104: 00010000:00010000:2.0:1789366531.356087:0:5799:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:2.0:1789366531.356095:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638bf5a9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8cde4528-5832-4854-a387-4adacc3dd0ab+6:5810:x1876286758726784:12345-0@lo:104: Request processed in 79us (415us total) trans 0 rc 0/0 00000100:00100000:2.0:1789366531.356103:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00010000:0.0:1789366531.356108:0:5804:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1789366531.356115:0:5804:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.123@tcp lock: ffff9638832d3400/0x8da3486b955f2f1f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x8da3486b955f2f26 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789366531.356122:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00010000:00010000:0.0:1789366531.356130:0:5804:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9638832d3400 already unused, calling callback (ffffffffc1cc7c20) 00000100:00100000:2.0:1789366531.356135:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638bf5a8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8cde4528-5832-4854-a387-4adacc3dd0ab+5:5810:x1876286758726912:12345-0@lo:104: 10000000:00010000:0.0:1789366531.356137:0:5804:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.123@tcp lock: ffff9638832d3400/0x8da3486b955f2f1f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x8da3486b955f2f26 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366531.356147:0:5799:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.123@tcp lock: ffff9638a0740600/0x8da3486b955f2ea1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x8da3486b955f2ea8 expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366531.356171:0:5804:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.123@tcp lock: ffff9638832d3400/0x8da3486b955f2f1f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x8da3486b955f2f26 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789366531.356178:0:5804:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.123@tcp lock: ffff9638832d3400/0x8da3486b955f2f1f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x8da3486b955f2f26 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789366531.356182:0:5804:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1789366531.356194:0:5799:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:2.0:1789366531.356202:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638bf5a8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8cde4528-5832-4854-a387-4adacc3dd0ab+5:5810:x1876286758726912:12345-0@lo:104: Request processed in 70us (497us total) trans 0 rc 0/0 00000100:00100000:2.0:1789366531.356209:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00010000:0.0:1789366531.356211:0:5804:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.123@tcp lock: ffff9638832d3400/0x8da3486b955f2f1f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8da3486b955f2f26 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366531.356216:0:5804:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1789366531.356227:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00010000:00010000:0.0:1789366531.356232:0:5804:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.123@tcp lock: ffff9638832d3400/0x8da3486b955f2f1f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8da3486b955f2f26 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789366531.356238:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638bf5a9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8cde4528-5832-4854-a387-4adacc3dd0ab+4:5810:x1876286758727040:12345-0@lo:104: 00010000:00010000:0.0:1789366531.356241:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.123@tcp lock: ffff9638832d3400/0x8da3486b955f2f1f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8da3486b955f2f26 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366531.356251:0:5799:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.123@tcp lock: ffff9638827f6c00/0x8da3486b955f2e77 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x8da3486b955f2e7e expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366531.356255:0:5804:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1789366531.356260:0:5804:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.123@tcp lock: ffff96388148fa00/0x8da3486b955f2ee7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x8da3486b955f2eee expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366531.356270:0:5804:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96388148fa00 already unused, calling callback (ffffffffc1cc7c20) 10000000:00010000:0.0:1789366531.356273:0:5804:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.123@tcp lock: ffff96388148fa00/0x8da3486b955f2ee7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x8da3486b955f2eee expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366531.356280:0:5804:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.123@tcp lock: ffff96388148fa00/0x8da3486b955f2ee7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x8da3486b955f2eee expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789366531.356287:0:5804:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.123@tcp lock: ffff96388148fa00/0x8da3486b955f2ee7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x8da3486b955f2eee expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366531.356291:0:5799:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:2.0:1789366531.356301:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638bf5a9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8cde4528-5832-4854-a387-4adacc3dd0ab+4:5810:x1876286758727040:12345-0@lo:104: Request processed in 66us (585us total) trans 0 rc 0/0 10000000:01000000:0.0:1789366531.356305:0:5804:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:2.0:1789366531.356315:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00010000:0.0:1789366531.356325:0:5804:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.123@tcp lock: ffff96388148fa00/0x8da3486b955f2ee7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8da3486b955f2eee expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366531.356343:0:5804:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789366531.356351:0:5804:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.123@tcp lock: ffff96388148fa00/0x8da3486b955f2ee7 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8da3486b955f2eee expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366531.356358:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.123@tcp lock: ffff96388148fa00/0x8da3486b955f2ee7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8da3486b955f2eee expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366531.356370:0:5804:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1789366531.356373:0:5804:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.123@tcp lock: ffff9638827f6200/0x8da3486b955f2ecb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x8da3486b955f2ed2 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366531.356377:0:5804:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9638827f6200 already unused, calling callback (ffffffffc1cc7c20) 10000000:00010000:0.0:1789366531.356379:0:5804:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.123@tcp lock: ffff9638827f6200/0x8da3486b955f2ecb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x8da3486b955f2ed2 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366531.356384:0:5804:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.123@tcp lock: ffff9638827f6200/0x8da3486b955f2ecb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x8da3486b955f2ed2 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789366531.356387:0:5804:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.123@tcp lock: ffff9638827f6200/0x8da3486b955f2ecb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x8da3486b955f2ed2 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789366531.356390:0:5804:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1789366531.356400:0:5804:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.123@tcp lock: ffff9638827f6200/0x8da3486b955f2ecb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8da3486b955f2ed2 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366531.356404:0:5804:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789366531.356433:0:5804:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.123@tcp lock: ffff9638827f6200/0x8da3486b955f2ecb lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8da3486b955f2ed2 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366531.356440:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.123@tcp lock: ffff9638827f6200/0x8da3486b955f2ecb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8da3486b955f2ed2 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366531.356462:0:5804:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1789366531.356465:0:5804:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.123@tcp lock: ffff9638a0740600/0x8da3486b955f2ea1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x8da3486b955f2ea8 expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366531.356469:0:5804:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9638a0740600 already unused, calling callback (ffffffffc1cc7c20) 10000000:00010000:0.0:1789366531.356471:0:5804:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.123@tcp lock: ffff9638a0740600/0x8da3486b955f2ea1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x8da3486b955f2ea8 expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366531.356475:0:5804:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.123@tcp lock: ffff9638a0740600/0x8da3486b955f2ea1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x8da3486b955f2ea8 expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789366531.356479:0:5804:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.123@tcp lock: ffff9638a0740600/0x8da3486b955f2ea1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x8da3486b955f2ea8 expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789366531.356482:0:5804:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1789366531.356492:0:5804:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.123@tcp lock: ffff9638a0740600/0x8da3486b955f2ea1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8da3486b955f2ea8 expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366531.356496:0:5804:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789366531.356499:0:5804:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.123@tcp lock: ffff9638a0740600/0x8da3486b955f2ea1 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8da3486b955f2ea8 expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366531.356504:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.123@tcp lock: ffff9638a0740600/0x8da3486b955f2ea1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8da3486b955f2ea8 expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366531.356509:0:5804:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789366531.356514:0:5804:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.123@tcp lock: ffff9638827f6c00/0x8da3486b955f2e77 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x8da3486b955f2e7e expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366531.356518:0:5804:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9638827f6c00 already unused, calling callback (ffffffffc1cc7c20) 10000000:00010000:0.0:1789366531.356520:0:5804:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.123@tcp lock: ffff9638827f6c00/0x8da3486b955f2e77 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x8da3486b955f2e7e expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366531.356523:0:5804:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.123@tcp lock: ffff9638827f6c00/0x8da3486b955f2e77 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x8da3486b955f2e7e expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789366531.356526:0:5804:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.123@tcp lock: ffff9638827f6c00/0x8da3486b955f2e77 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x8da3486b955f2e7e expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789366531.356530:0:5804:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1789366531.356549:0:5804:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.123@tcp lock: ffff9638827f6c00/0x8da3486b955f2e77 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8da3486b955f2e7e expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366531.356554:0:5804:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789366531.356559:0:5804:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.123@tcp lock: ffff9638827f6c00/0x8da3486b955f2e77 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8da3486b955f2e7e expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366531.356564:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.123@tcp lock: ffff9638827f6c00/0x8da3486b955f2e77 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8da3486b955f2e7e expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366531.356579:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789366531.356581:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789366531.356583:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789366531.356598:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9638b4f19f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8cde4528-5832-4854-a387-4adacc3dd0ab:3284:1876286758727168:0@lo:103: 00000100:00100000:2.0:1789366531.356603:0:3286:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9638b4f18e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8cde4528-5832-4854-a387-4adacc3dd0ab:3286:1876286758727424:0@lo:103: 00000100:00100000:0.0:1789366531.356636:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789366531.356653:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789366531.356672:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9638b4f19880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8cde4528-5832-4854-a387-4adacc3dd0ab:3284:1876286758727680:0@lo:103: 00000100:00100000:2.0:1789366531.356683:0:3286:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789366531.356734:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789366531.356765:0:3284:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789366531.356774:0:3286:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9638b4f18700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8cde4528-5832-4854-a387-4adacc3dd0ab:3286:1876286758727552:0@lo:103: 00000100:00100000:0.0:1789366531.356776:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9638b4f1bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8cde4528-5832-4854-a387-4adacc3dd0ab:3284:1876286758727296:0@lo:103: 00000100:00100000:2.0:1789366531.356814:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789366531.356830:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286758727168 00000100:00100000:0.0:1789366531.356836:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286758727168 00010000:00010000:0.0:1789366531.356857:0:5802:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff963880031400/0x8da3486b955f2f26 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8da3486b955f2f1f expref: 17 pid: 5810 timeout: 256 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789366531.356872:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286758727424 00000100:00100000:0.0:1789366531.356874:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286758727424 00010000:00010000:0.0:1789366531.356883:0:5802:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff96388148e400/0x8da3486b955f2ed2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8da3486b955f2ecb expref: 18 pid: 5808 timeout: 256 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789366531.356892:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286758727680 00000100:00100000:0.0:1789366531.356894:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286758727680 00010000:00010000:0.0:1789366531.356904:0:5802:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff96388148e200/0x8da3486b955f2e7e lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8da3486b955f2e77 expref: 19 pid: 5808 timeout: 256 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789366531.356913:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286758727552 00000100:00100000:0.0:1789366531.356916:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286758727552 00010000:00010000:0.0:1789366531.356925:0:5802:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff96388148fe00/0x8da3486b955f2ea8 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8da3486b955f2ea1 expref: 20 pid: 5808 timeout: 256 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789366531.356936:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1789366531.356942:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96389861c050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8cde4528-5832-4854-a387-4adacc3dd0ab+20:3284:x1876286758727168:12345-0@lo:103: 00010000:00010000:0.0:1789366531.356954:0:5802:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789366531.356959:0:5802:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff963880031400/0x8da3486b955f2f26 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8da3486b955f2f1f expref: 20 pid: 5810 timeout: 256 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366531.356970:0:5802:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff963880031400/0x8da3486b955f2f26 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x8da3486b955f2f1f expref: 20 pid: 5810 timeout: 256 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366531.356991:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff963880031400/0x8da3486b955f2f26 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x8da3486b955f2f1f expref: 20 pid: 5810 timeout: 256 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366531.357005:0:5802:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789366531.357029:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96389861c050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8cde4528-5832-4854-a387-4adacc3dd0ab+19:3284:x1876286758727168:12345-0@lo:103: Request processed in 88us (393us total) trans 0 rc 0/0 00000100:00100000:0.0:1789366531.357036:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1789366531.357080:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1789366531.357087:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638b6ea0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8cde4528-5832-4854-a387-4adacc3dd0ab+18:3286:x1876286758727424:12345-0@lo:103: 00010000:00010000:0.0:1789366531.357095:0:5802:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789366531.357099:0:5802:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff96388148e400/0x8da3486b955f2ed2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8da3486b955f2ecb expref: 18 pid: 5808 timeout: 256 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366531.357107:0:5802:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff96388148e400/0x8da3486b955f2ed2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x8da3486b955f2ecb expref: 18 pid: 5808 timeout: 256 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366531.357117:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff96388148e400/0x8da3486b955f2ed2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x8da3486b955f2ecb expref: 18 pid: 5808 timeout: 256 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366531.357127:0:5802:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789366531.357156:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638b6ea0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8cde4528-5832-4854-a387-4adacc3dd0ab+17:3286:x1876286758727424:12345-0@lo:103: Request processed in 70us (505us total) trans 0 rc 0/0 00000100:00100000:0.0:1789366531.357163:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1789366531.357179:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1789366531.357188:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963785f29c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8cde4528-5832-4854-a387-4adacc3dd0ab+16:3284:x1876286758727680:12345-0@lo:103: 00000100:00100000:2.0:1789366531.357196:0:3286:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9638b4f18e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8cde4528-5832-4854-a387-4adacc3dd0ab:3286:1876286758727424:0@lo:103: 00010000:00010000:0.0:1789366531.357196:0:5802:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789366531.357204:0:5802:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff96388148e200/0x8da3486b955f2e7e lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8da3486b955f2e77 expref: 16 pid: 5808 timeout: 256 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366531.357220:0:5802:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff96388148e200/0x8da3486b955f2e7e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x8da3486b955f2e77 expref: 16 pid: 5808 timeout: 256 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366531.357231:0:5802:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789366531.357254:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963785f29c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8cde4528-5832-4854-a387-4adacc3dd0ab+16:3284:x1876286758727680:12345-0@lo:103: Request processed in 69us (539us total) trans 0 rc 0/0 00000100:00100000:0.0:1789366531.357260:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1789366531.357272:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1789366531.357279:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638b6ea1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8cde4528-5832-4854-a387-4adacc3dd0ab+15:3286:x1876286758727552:12345-0@lo:103: 00010000:00010000:0.0:1789366531.357286:0:5802:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789366531.357290:0:5802:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff96388148fe00/0x8da3486b955f2ea8 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8da3486b955f2ea1 expref: 15 pid: 5808 timeout: 256 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366531.357299:0:5802:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff96388148fe00/0x8da3486b955f2ea8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x8da3486b955f2ea1 expref: 15 pid: 5808 timeout: 256 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366531.357308:0:5802:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789366531.357346:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638b6ea1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8cde4528-5832-4854-a387-4adacc3dd0ab+15:3286:x1876286758727552:12345-0@lo:103: Request processed in 68us (533us total) trans 0 rc 0/0 00000100:00100000:0.0:1789366531.357353:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1789366531.357372:0:3286:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9638b4f18700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8cde4528-5832-4854-a387-4adacc3dd0ab:3286:1876286758727552:0@lo:103: 00000100:00100000:0.0:1789366531.357384:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789366531.357408:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9638b4f19f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8cde4528-5832-4854-a387-4adacc3dd0ab:3284:1876286758727168:0@lo:103: 00000100:00100000:0.0:1789366531.357416:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9638b4f19880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8cde4528-5832-4854-a387-4adacc3dd0ab:3284:1876286758727680:0@lo:103: 00000100:00100000:0.0:1789366531.357433:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286758727296 00000100:00100000:0.0:1789366531.357438:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286758727296 00010000:00010000:0.0:1789366531.357450:0:5802:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9638827f7600/0x8da3486b955f2eee lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8da3486b955f2ee7 expref: 15 pid: 5810 timeout: 256 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789366531.357486:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1789366531.357493:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963785f29180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8cde4528-5832-4854-a387-4adacc3dd0ab+15:3284:x1876286758727296:12345-0@lo:103: 00010000:00010000:0.0:1789366531.357501:0:5802:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789366531.357505:0:5802:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9638827f7600/0x8da3486b955f2eee lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8da3486b955f2ee7 expref: 15 pid: 5810 timeout: 256 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366531.357514:0:5802:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9638827f7600/0x8da3486b955f2eee lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x8da3486b955f2ee7 expref: 15 pid: 5810 timeout: 256 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366531.357524:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9638827f7600/0x8da3486b955f2eee lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x8da3486b955f2ee7 expref: 15 pid: 5810 timeout: 256 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366531.357540:0:5802:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff963880031e00/0x8da3486b955f2f3b lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366531.357549:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff963880031e00/0x8da3486b955f2f3b lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366531.357563:0:5802:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff963880031e00/0x8da3486b955f2f3b lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366531.357571:0:5802:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff963880031e00/0x8da3486b955f2f3b lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366531.357578:0:5802:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff963880031e00/0x8da3486b955f2f3b lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366531.357585:0:5802:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff963880031e00/0x8da3486b955f2f3b lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366531.357601:0:5802:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff963880031e00 already unused, calling callback (ffffffffc16df520) 00010000:00010000:0.0:1789366531.357606:0:5802:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff963880031e00/0x8da3486b955f2f3b lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366531.357614:0:5802:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff963880031e00/0x8da3486b955f2f3b lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366531.357622:0:5802:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff963880031e00/0x8da3486b955f2f3b lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366531.357632:0:5802:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789366531.357665:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963785f29180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8cde4528-5832-4854-a387-4adacc3dd0ab+14:3284:x1876286758727296:12345-0@lo:103: Request processed in 173us (283us total) trans 0 rc 0/0 00000100:00100000:0.0:1789366531.357673:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00010000:0.0:1789366531.357705:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff96388148fe00/0x8da3486b955f2ea8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x8da3486b955f2ea1 expref: 13 pid: 5808 timeout: 256 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789366531.357715:0:5810:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9638b4f1b480 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5810:1876286758726912:0@lo:104: 00010000:00010000:0.0:1789366531.357742:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff96388148e200/0x8da3486b955f2e7e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x8da3486b955f2e77 expref: 12 pid: 5808 timeout: 256 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789366531.357750:0:5810:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9638b4f18000 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5810:1876286758727040:0@lo:104: 00010000:00010000:0.0:1789366531.357767:0:5810:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff963880031e00/0x8da3486b955f2f3b lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366531.357777:0:5810:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff963880031e00/0x8da3486b955f2f3b lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366531.357783:0:5810:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff963880031e00/0x8da3486b955f2f3b lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366531.357797:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff963880031e00/0x8da3486b955f2f3b lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1789366531.357813:0:5810:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:2.0:1789366531.357821:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9638b4f1bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8cde4528-5832-4854-a387-4adacc3dd0ab:3284:1876286758727296:0@lo:103: 00010000:00010000:0.0:1789366531.357861:0:6675:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789366531.357999:0:5805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789366531.377780:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638b4e38850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8cde4528-5832-4854-a387-4adacc3dd0ab+11:7601:x1876286758726400:12345-0@lo:253: Request processed in 30281us (30556us total) trans 0 rc 0/0 00000100:00100000:0.0:1789366531.377795:0:7601:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9638bf5a9180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8cde4528-5832-4854-a387-4adacc3dd0ab:7601:1876286758726400:0@lo:253: 00000100:00100000:3.0:1789366531.377815:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 10000000:01000000:0.0:1789366531.377818:0:7601:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:0.0:1789366531.377822:0:7601:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1789366531.377823:0:7601:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1789366531.377825:0:7601:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789366531.377826:0:7601:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0001_UUID 00000020:01000004:0.0:1789366531.377827:0:7601:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789366531.377828:0:7601:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789366531.377829:0:7601:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1789366531.377831:0:7601:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:0.0:1789366531.377832:0:7601:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789366531.377833:0:7601:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1789366531.377856:0:7601:0:(tgt_mount.c:101:server_register_mount()) register mount ffff963883577000 from lustre-OST0001 10000000:01000000:0.0:1789366531.377881:0:7601:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:0.0:1789366531.377884:0:7601:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:0.0:1789366531.377891:0:7601:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff963882f5cd40 local copy 10000000:01000000:0.0:1789366531.377894:0:7601:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1789366531.377935:0:7601:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.123@tcp lock: ffff963880031e00/0x8da3486b955f2f42 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366531.377948:0:7601:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.202.123@tcp lock: ffff963880031e00/0x8da3486b955f2f42 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366531.377958:0:7601:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.123@tcp lock: ffff963880031e00/0x8da3486b955f2f42 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789366531.377980:0:7601:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff963785f29500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8cde4528-5832-4854-a387-4adacc3dd0ab:7601:1876286758727808:0@lo:101: 00000100:00100000:0.0:1789366531.378029:0:7601:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789366531.378085:0:7601:0:(client.c:2716:ptlrpc_set_wait()) set ffff963883ba5d80 going to sleep for 11 seconds 00000100:00100000:2.0:1789366531.378186:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286758727808 00000100:00100000:2.0:1789366531.378194:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286758727808 00000100:00100000:2.0:1789366531.378240:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1789366531.378250:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638b4e38050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8cde4528-5832-4854-a387-4adacc3dd0ab+11:7601:x1876286758727808:12345-0@lo:101: 00010000:00010000:2.0:1789366531.378267:0:5808:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789366531.378283:0:5808:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9638a0741600/0x8da3486b955f2f49 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x8da3486b955f2f42 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366531.378311:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9638a0741600/0x8da3486b955f2f49 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8da3486b955f2f42 expref: 12 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366531.378324:0:5808:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9638a0741600/0x8da3486b955f2f49 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8da3486b955f2f42 expref: 12 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366531.378346:0:5808:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9638a0741600, rc 0) 00000100:00100000:2.0:1789366531.378381:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638b4e38050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8cde4528-5832-4854-a387-4adacc3dd0ab+12:7601:x1876286758727808:12345-0@lo:101: Request processed in 132us (351us total) trans 0 rc 0/0 00000100:00100000:2.0:1789366531.378388:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1789366531.378398:0:7601:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff963785f29500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8cde4528-5832-4854-a387-4adacc3dd0ab:7601:1876286758727808:0@lo:101: 00010000:00010000:0.0:1789366531.378410:0:7601:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.123@tcp lock: ffff963880031e00/0x8da3486b955f2f42 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x8da3486b955f2f49 expref: -99 pid: 7601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366531.378418:0:7601:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.123@tcp lock: ffff963880031e00/0x8da3486b955f2f42 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x8da3486b955f2f49 expref: -99 pid: 7601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789366531.378489:0:7601:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff963785f29500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8cde4528-5832-4854-a387-4adacc3dd0ab:7601:1876286758727936:0@lo:501: 00000100:00100000:0.0:1789366531.378508:0:7601:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789366531.378521:0:7601:0:(client.c:2716:ptlrpc_set_wait()) set ffff963883ba5d80 going to sleep for 11 seconds 00000100:00100000:3.0:1789366531.378547:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286758727936 00000100:00100000:3.0:1789366531.378553:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286758727936 00000100:00100000:3.0:1789366531.378584:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1789366531.378592:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638987e6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8cde4528-5832-4854-a387-4adacc3dd0ab+12:7601:x1876286758727936:12345-0@lo:501: 00000100:00100000:3.0:1789366531.378810:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638987e6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8cde4528-5832-4854-a387-4adacc3dd0ab+12:7601:x1876286758727936:12345-0@lo:501: Request processed in 218us (299us total) trans 0 rc -2/-2 00000100:00100000:3.0:1789366531.378818:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1789366531.378837:0:7601:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff963785f29500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8cde4528-5832-4854-a387-4adacc3dd0ab:7601:1876286758727936:0@lo:501: 10000000:01000000:0.0:1789366531.378854:0:7601:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.202.123@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:0.0:1789366531.378884:0:7601:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.202.123@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:0.0:1789366531.378890:0:7601:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.123@tcp lock: ffff963880031e00/0x8da3486b955f2f42 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x8da3486b955f2f49 expref: -99 pid: 7601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366531.378900:0:7601:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.123@tcp lock: ffff963880031e00/0x8da3486b955f2f42 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x8da3486b955f2f49 expref: -99 pid: 7601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366531.378908:0:7601:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.123@tcp lock: ffff963880031e00/0x8da3486b955f2f42 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x8da3486b955f2f49 expref: -99 pid: 7601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366531.378932:0:7601:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1789366531.378953:0:7601:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff963883577000 10000000:01000000:0.0:1789366531.378959:0:7601:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1789366531.378965:0:7601:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 00010000:00010000:1.0:1789366531.378966:0:5804:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 10000000:01000000:0.0:1789366531.378974:0:7601:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:1.0:1789366531.378976:0:5804:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.123@tcp lock: ffff963880031e00/0x8da3486b955f2f42 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0x8da3486b955f2f49 expref: -99 pid: 7601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789366531.378980:0:7601:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:0.0:1789366531.378986:0:7601:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:1.0:1789366531.378989:0:5804:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff963880031e00 already unused, calling callback (ffffffffc1cc7c20) 10000000:00010000:1.0:1789366531.378995:0:5804:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.123@tcp lock: ffff963880031e00/0x8da3486b955f2f42 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0x8da3486b955f2f49 expref: -99 pid: 7601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366531.379002:0:7601:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.123@tcp lock: ffff963880031400/0x8da3486b955f2f50 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366531.379012:0:7601:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.123@tcp lock: ffff963880031400/0x8da3486b955f2f50 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366531.379014:0:5804:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.123@tcp lock: ffff963880031e00/0x8da3486b955f2f42 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x8400000000 nid: local remote: 0x8da3486b955f2f49 expref: -99 pid: 7601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366531.379027:0:7601:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.123@tcp lock: ffff963880031400/0x8da3486b955f2f50 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789366531.379044:0:5804:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.123@tcp lock: ffff963880031e00/0x8da3486b955f2f42 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x9400000000 nid: local remote: 0x8da3486b955f2f49 expref: -99 pid: 7601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789366531.379049:0:5804:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1789366531.379067:0:5804:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.123@tcp lock: ffff963880031e00/0x8da3486b955f2f42 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x4809400000020 nid: local remote: 0x8da3486b955f2f49 expref: -99 pid: 7601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366531.379072:0:5804:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789366531.379092:0:5804:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.123@tcp lock: ffff963880031e00/0x8da3486b955f2f42 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x8da3486b955f2f49 expref: -99 pid: 7601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366531.379100:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.123@tcp lock: ffff963880031e00/0x8da3486b955f2f42 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x8da3486b955f2f49 expref: -99 pid: 7601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789366531.379103:0:7601:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff963785f29500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8cde4528-5832-4854-a387-4adacc3dd0ab:7601:1876286758728064:0@lo:101: 00000100:00100000:2.0:1789366531.379115:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9638987e8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8cde4528-5832-4854-a387-4adacc3dd0ab:3285:1876286758728192:0@lo:103: 00010000:00010000:1.0:1789366531.379115:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789366531.379118:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789366531.379121:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789366531.379143:0:7601:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789366531.379158:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789366531.379186:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286758728064 00000100:00100000:1.0:1789366531.379188:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286758728192 00000100:00100000:0.0:1789366531.379190:0:7601:0:(client.c:2716:ptlrpc_set_wait()) set ffff963883ba5300 going to sleep for 11 seconds 00000100:00100000:1.0:1789366531.379192:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286758728192 00000100:00100000:3.0:1789366531.379194:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286758728064 00000100:00100000:1.0:1789366531.379230:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789366531.379235:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1789366531.379240:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638b6ea3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8cde4528-5832-4854-a387-4adacc3dd0ab+13:3285:x1876286758728192:12345-0@lo:103: 00000100:00100000:3.0:1789366531.379248:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638b4e84050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8cde4528-5832-4854-a387-4adacc3dd0ab+13:7601:x1876286758728064:12345-0@lo:101: 00010000:00010000:1.0:1789366531.379249:0:5801:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789366531.379259:0:5808:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789366531.379262:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9638a0741600/0x8da3486b955f2f49 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x8da3486b955f2f42 expref: 13 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366531.379271:0:5808:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9638832d3800/0x8da3486b955f2f57 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x8da3486b955f2f50 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366531.379271:0:5801:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789366531.379290:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9638832d3800/0x8da3486b955f2f57 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8da3486b955f2f50 expref: 13 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366531.379302:0:5808:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9638832d3800/0x8da3486b955f2f57 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8da3486b955f2f50 expref: 13 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789366531.379303:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638b6ea3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8cde4528-5832-4854-a387-4adacc3dd0ab+13:3285:x1876286758728192:12345-0@lo:103: Request processed in 66us (145us total) trans 0 rc 0/0 00000100:00100000:1.0:1789366531.379319:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00010000:3.0:1789366531.379320:0:5808:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9638832d3800, rc 0) 00000100:00100000:2.0:1789366531.379356:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9638987e8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8cde4528-5832-4854-a387-4adacc3dd0ab:3285:1876286758728192:0@lo:103: 00000100:00100000:3.0:1789366531.379378:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638b4e84050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8cde4528-5832-4854-a387-4adacc3dd0ab+12:7601:x1876286758728064:12345-0@lo:101: Request processed in 134us (234us total) trans 0 rc 0/0 00000100:00100000:3.0:1789366531.379386:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1789366531.379407:0:7601:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff963785f29500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8cde4528-5832-4854-a387-4adacc3dd0ab:7601:1876286758728064:0@lo:101: 00010000:00010000:0.0:1789366531.379421:0:7601:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.123@tcp lock: ffff963880031400/0x8da3486b955f2f50 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8da3486b955f2f57 expref: -99 pid: 7601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366531.379430:0:7601:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.123@tcp lock: ffff963880031400/0x8da3486b955f2f50 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x8da3486b955f2f57 expref: -99 pid: 7601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789366531.379483:0:7601:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff963785f29500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8cde4528-5832-4854-a387-4adacc3dd0ab:7601:1876286758728320:0@lo:501: 00000100:00100000:0.0:1789366531.379522:0:7601:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789366531.379541:0:7601:0:(client.c:2716:ptlrpc_set_wait()) set ffff963883ba5300 going to sleep for 11 seconds 00000100:00100000:3.0:1789366531.379578:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286758728320 00000100:00100000:3.0:1789366531.379583:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286758728320 00000100:00100000:3.0:1789366531.379616:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1789366531.379623:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638b4e85450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8cde4528-5832-4854-a387-4adacc3dd0ab+12:7601:x1876286758728320:12345-0@lo:501: 00000100:00100000:3.0:1789366531.379803:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638b4e85450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8cde4528-5832-4854-a387-4adacc3dd0ab+12:7601:x1876286758728320:12345-0@lo:501: Request processed in 179us (279us total) trans 0 rc 0/0 00000100:00100000:3.0:1789366531.379811:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1789366531.379820:0:7601:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff963785f29500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8cde4528-5832-4854-a387-4adacc3dd0ab:7601:1876286758728320:0@lo:501: 00000100:00100000:0.0:1789366531.379853:0:7601:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff963785f29500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8cde4528-5832-4854-a387-4adacc3dd0ab:7601:1876286758728448:0@lo:503: 00000100:00100000:0.0:1789366531.379896:0:7601:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789366531.379934:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286758728448 00000100:00100000:3.0:1789366531.379938:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286758728448 00000100:00100000:0.0:1789366531.379938:0:7601:0:(client.c:2716:ptlrpc_set_wait()) set ffff963883ba5300 going to sleep for 11 seconds 00000100:00100000:3.0:1789366531.379964:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1789366531.379981:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638b4e84c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8cde4528-5832-4854-a387-4adacc3dd0ab+12:7601:x1876286758728448:12345-0@lo:503: 00000100:00100000:3.0:1789366531.380142:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638b4e84c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8cde4528-5832-4854-a387-4adacc3dd0ab+12:7601:x1876286758728448:12345-0@lo:503: Request processed in 164us (246us total) trans 0 rc 0/0 00000100:00100000:3.0:1789366531.380147:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1789366531.380175:0:7601:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff963785f29500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8cde4528-5832-4854-a387-4adacc3dd0ab:7601:1876286758728448:0@lo:503: 00000040:00080000:0.0:1789366531.380546:0:7601:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1789366531.380618:0:7601:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff963785f29500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8cde4528-5832-4854-a387-4adacc3dd0ab:7601:1876286758728576:0@lo:502: 00000100:00100000:0.0:1789366531.380651:0:7601:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789366531.380671:0:7601:0:(client.c:2716:ptlrpc_set_wait()) set ffff963883ba5300 going to sleep for 11 seconds 00000100:00100000:3.0:1789366531.380690:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286758728576 00000100:00100000:3.0:1789366531.380695:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286758728576 00000100:00100000:3.0:1789366531.380755:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1789366531.380764:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638b4e85c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8cde4528-5832-4854-a387-4adacc3dd0ab+12:7601:x1876286758728576:12345-0@lo:502: 00000100:00100000:3.0:1789366531.380902:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638b4e85c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8cde4528-5832-4854-a387-4adacc3dd0ab+12:7601:x1876286758728576:12345-0@lo:502: Request processed in 139us (250us total) trans 0 rc 0/0 00000100:00100000:3.0:1789366531.380911:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1789366531.380926:0:7601:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff963785f29500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8cde4528-5832-4854-a387-4adacc3dd0ab:7601:1876286758728576:0@lo:502: 00000040:00080000:0.0:1789366531.381168:0:7601:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:0.0:1789366531.381214:0:7601:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:0.0:1789366531.381249:0:7601:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:0.0:1789366531.381301:0:7601:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:0.0:1789366531.381356:0:7601:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:0.0:1789366531.381392:0:7601:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:0.0:1789366531.381414:0:7601:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff963785f29500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8cde4528-5832-4854-a387-4adacc3dd0ab:7601:1876286758728704:0@lo:502: 00000100:00100000:0.0:1789366531.381447:0:7601:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789366531.381476:0:7601:0:(client.c:2716:ptlrpc_set_wait()) set ffff963883ba5300 going to sleep for 11 seconds 00000100:00100000:3.0:1789366531.381492:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286758728704 00000100:00100000:3.0:1789366531.381499:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286758728704 00000100:00100000:3.0:1789366531.381529:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1789366531.381534:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638b4e87850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8cde4528-5832-4854-a387-4adacc3dd0ab+12:7601:x1876286758728704:12345-0@lo:502: 00000100:00100000:3.0:1789366531.381653:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638b4e87850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8cde4528-5832-4854-a387-4adacc3dd0ab+12:7601:x1876286758728704:12345-0@lo:502: Request processed in 117us (204us total) trans 0 rc 0/0 00000100:00100000:3.0:1789366531.381660:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1789366531.381677:0:7601:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff963785f29500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8cde4528-5832-4854-a387-4adacc3dd0ab:7601:1876286758728704:0@lo:502: 00000040:00080000:0.0:1789366531.381782:0:7601:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:0.0:1789366531.381792:0:7601:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 7 count 8 00000020:01000000:3.0:1789366531.382195:0:7607:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1789366531.382210:0:7607:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-ost2/ost2 00000020:00000080:3.0:1789366531.382217:0:7607:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789366531.382220:0:7607:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-OST0001 add ost 00000020:00000080:3.0:1789366531.382227:0:7607:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1789366531.382253:0:7607:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff963785d63380) 00000020:00000080:3.0:1789366531.382279:0:7607:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type obdfilter with refcount 2 00000020:00000080:3.0:1789366531.382287:0:7607:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1789366531.382383:0:7607:0:(tgt_mount.c:153:server_get_mount()) get mount ffff963883577000 from lustre-OST0001, refs=2 00080000:01000000:3.0:1789366531.382392:0:7607:0:(osd_handler.c:1574:osd_obd_connect()) connect #1 00000020:00000080:3.0:1789366531.382399:0:7607:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x8da3486b955f2f65 00010000:00010000:3.0:1789366531.385712:0:7607:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-3 is initialized 00000001:02000400:3.0:1789366531.386056:0:7607:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0001: new disk, initializing 00000001:00000004:3.0:1789366531.387894:0:7607:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 0 40000000:02000000:3.0:1789366531.388070:0:7607:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0001: No data found on store. Initialize space. 00080000:10000000:3.0:1789366531.390263:0:7607:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000001:0x3:0x0] (8/8/3) registered 00080000:10000000:3.0:1789366531.390678:0:7607:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000020:00000080:0.0:1789366531.391957:0:7607:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:0.0:1789366531.391970:0:7607:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789366531.391978:0:7607:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789366531.391981:0:7607:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-OST0001 add ost 00000020:01000000:0.0:1789366531.391987:0:7607:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789366531.391992:0:7607:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789366531.391994:0:7607:0:(obd_config.c:1563:class_process_config()) marker 21 (0x1) lustre sys.timeout 00000020:00000080:0.0:1789366531.391999:0:7607:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1789366531.392001:0:7607:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1789366531.392074:0:7607:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789366531.392088:0:7607:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789366531.392090:0:7607:0:(obd_config.c:1563:class_process_config()) marker 21 (0x2) lustre sys.timeout 00000040:00080000:0.0:1789366531.392095:0:7607:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:1.0:1789366531.392176:0:7601:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-7 (rc=0) 10000000:01000000:1.0:1789366531.392211:0:7601:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.123@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:1.0:1789366531.392238:0:7601:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.123@tcp lock: ffff963880031400/0x8da3486b955f2f50 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8da3486b955f2f57 expref: -99 pid: 7601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366531.392252:0:7601:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.123@tcp lock: ffff963880031400/0x8da3486b955f2f50 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8da3486b955f2f57 expref: -99 pid: 7601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789366531.392263:0:7601:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff963883577000 from 1 10000000:01000000:1.0:1789366531.392267:0:7601:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1789366531.392340:0:7601:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.123@tcp lock: ffff96388148fc00/0x8da3486b955f2f6c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366531.392351:0:7601:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.123@tcp lock: ffff96388148fc00/0x8da3486b955f2f6c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366531.392365:0:7601:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.123@tcp lock: ffff96388148fc00/0x8da3486b955f2f6c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789366531.392393:0:7601:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9638987ea300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8cde4528-5832-4854-a387-4adacc3dd0ab:7601:1876286758728832:0@lo:101: 00000100:00100000:1.0:1789366531.392490:0:7601:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789366531.392547:0:7601:0:(client.c:2716:ptlrpc_set_wait()) set ffff96388a1a0c00 going to sleep for 11 seconds 00000100:00100000:2.0:1789366531.392563:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286758728832 00000100:00100000:2.0:1789366531.392574:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286758728832 00000100:00100000:2.0:1789366531.392623:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1789366531.392635:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638b4e87c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8cde4528-5832-4854-a387-4adacc3dd0ab+12:7601:x1876286758728832:12345-0@lo:101: 00010000:00010000:2.0:1789366531.392653:0:5810:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789366531.392668:0:5810:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9638a0740a00/0x8da3486b955f2f73 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x8da3486b955f2f6c expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366531.392698:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9638a0740a00/0x8da3486b955f2f73 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8da3486b955f2f6c expref: 13 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366531.392709:0:5810:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9638a0740a00/0x8da3486b955f2f73 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8da3486b955f2f6c expref: 13 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366531.392741:0:5810:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9638a0740a00, rc 0) 00000100:00100000:2.0:1789366531.392793:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638b4e87c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8cde4528-5832-4854-a387-4adacc3dd0ab+13:7601:x1876286758728832:12345-0@lo:101: Request processed in 160us (304us total) trans 0 rc 0/0 00000100:00100000:2.0:1789366531.392801:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1789366531.392819:0:7601:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9638987ea300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8cde4528-5832-4854-a387-4adacc3dd0ab:7601:1876286758728832:0@lo:101: 00010000:00010000:1.0:1789366531.392837:0:7601:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.123@tcp lock: ffff96388148fc00/0x8da3486b955f2f6c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x8da3486b955f2f73 expref: -99 pid: 7601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366531.392848:0:7601:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.123@tcp lock: ffff96388148fc00/0x8da3486b955f2f6c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x8da3486b955f2f73 expref: -99 pid: 7601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789366531.392945:0:7601:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9638987ea300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8cde4528-5832-4854-a387-4adacc3dd0ab:7601:1876286758728960:0@lo:501: 00000100:00100000:1.0:1789366531.392984:0:7601:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789366531.393006:0:7601:0:(client.c:2716:ptlrpc_set_wait()) set ffff96388a1a0c00 going to sleep for 11 seconds 00000100:00100000:2.0:1789366531.393041:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286758728960 00000100:00100000:2.0:1789366531.393047:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286758728960 00000100:00100000:2.0:1789366531.393078:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1789366531.393086:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638b4e86c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8cde4528-5832-4854-a387-4adacc3dd0ab+13:7601:x1876286758728960:12345-0@lo:501: 00000100:00100000:2.0:1789366531.393357:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638b4e86c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8cde4528-5832-4854-a387-4adacc3dd0ab+13:7601:x1876286758728960:12345-0@lo:501: Request processed in 270us (370us total) trans 0 rc 0/0 00000100:00100000:2.0:1789366531.393365:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1789366531.393420:0:7601:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9638987ea300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8cde4528-5832-4854-a387-4adacc3dd0ab:7601:1876286758728960:0@lo:501: 00000100:00100000:0.0:1789366531.393453:0:7601:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff963785f29500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8cde4528-5832-4854-a387-4adacc3dd0ab:7601:1876286758729088:0@lo:503: 00000100:00100000:0.0:1789366531.393496:0:7601:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789366531.393517:0:7601:0:(client.c:2716:ptlrpc_set_wait()) set ffff963883ba5300 going to sleep for 11 seconds 00000100:00100000:2.0:1789366531.393530:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286758729088 00000100:00100000:2.0:1789366531.393540:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286758729088 00000100:00100000:2.0:1789366531.393585:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1789366531.393592:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638b4e84450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8cde4528-5832-4854-a387-4adacc3dd0ab+13:7601:x1876286758729088:12345-0@lo:503: 00000100:00100000:2.0:1789366531.393987:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638b4e84450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8cde4528-5832-4854-a387-4adacc3dd0ab+13:7601:x1876286758729088:12345-0@lo:503: Request processed in 395us (490us total) trans 0 rc 0/0 00000100:00100000:2.0:1789366531.393995:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1789366531.394014:0:7601:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff963785f29500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8cde4528-5832-4854-a387-4adacc3dd0ab:7601:1876286758729088:0@lo:503: 00000040:00080000:0.0:1789366531.394350:0:7601:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1789366531.394428:0:7601:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff963785f29500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8cde4528-5832-4854-a387-4adacc3dd0ab:7601:1876286758729216:0@lo:502: 00000100:00100000:0.0:1789366531.394470:0:7601:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789366531.394502:0:7601:0:(client.c:2716:ptlrpc_set_wait()) set ffff963883ba5300 going to sleep for 11 seconds 00000100:00100000:2.0:1789366531.394677:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286758729216 00000100:00100000:2.0:1789366531.394682:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286758729216 00000100:00100000:2.0:1789366531.394707:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1789366531.394733:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638b4e87050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8cde4528-5832-4854-a387-4adacc3dd0ab+13:7601:x1876286758729216:12345-0@lo:502: 00000100:00100000:2.0:1789366531.394895:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638b4e87050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8cde4528-5832-4854-a387-4adacc3dd0ab+13:7601:x1876286758729216:12345-0@lo:502: Request processed in 181us (425us total) trans 0 rc 0/0 00000100:00100000:2.0:1789366531.394901:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1789366531.394928:0:7601:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff963785f29500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8cde4528-5832-4854-a387-4adacc3dd0ab:7601:1876286758729216:0@lo:502: 00000040:00080000:0.0:1789366531.395220:0:7601:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:0.0:1789366531.395325:0:7601:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:0.0:1789366531.395361:0:7601:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff963785f29500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8cde4528-5832-4854-a387-4adacc3dd0ab:7601:1876286758729344:0@lo:502: 00000100:00100000:0.0:1789366531.395506:0:7601:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789366531.395537:0:7601:0:(client.c:2716:ptlrpc_set_wait()) set ffff963883ba5300 going to sleep for 11 seconds 00000100:00100000:2.0:1789366531.395673:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286758729344 00000100:00100000:2.0:1789366531.395678:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286758729344 00000100:00100000:2.0:1789366531.395701:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1789366531.395708:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638b4e85850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8cde4528-5832-4854-a387-4adacc3dd0ab+13:7601:x1876286758729344:12345-0@lo:502: 00000100:00100000:3.0:1789366531.395957:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638b4e85850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8cde4528-5832-4854-a387-4adacc3dd0ab+13:7601:x1876286758729344:12345-0@lo:502: Request processed in 247us (449us total) trans 0 rc 0/0 00000100:00100000:3.0:1789366531.395965:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1789366531.396042:0:7601:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff963785f29500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8cde4528-5832-4854-a387-4adacc3dd0ab:7601:1876286758729344:0@lo:502: 00000040:00080000:0.0:1789366531.396142:0:7601:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:0.0:1789366531.396159:0:7601:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:3.0:1789366531.396980:0:7611:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789366531.396991:0:7611:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789366531.396994:0:7611:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1789366531.397003:0:7611:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff963883577000 00000020:00000080:3.0:1789366531.397006:0:7611:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1789366531.397032:0:7611:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789366531.397036:0:7611:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789366531.397038:0:7611:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:3.0:1789366531.397042:0:7611:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:2.0:1789366531.397109:0:7601:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:2.0:1789366531.397144:0:7601:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.123@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1789366531.397166:0:7601:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.123@tcp lock: ffff96388148fc00/0x8da3486b955f2f6c lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x8da3486b955f2f73 expref: -99 pid: 7601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366531.397181:0:7601:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.123@tcp lock: ffff96388148fc00/0x8da3486b955f2f6c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x8da3486b955f2f73 expref: -99 pid: 7601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789366531.397240:0:7601:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1789366531.397243:0:7601:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff963883577000 10000000:01000000:2.0:1789366531.397247:0:7601:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff963883577000 10000000:01000000:2.0:1789366531.397258:0:7601:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1789366531.397265:0:7601:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff963883577000 from 1 10000000:01000000:2.0:1789366531.397268:0:7601:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1789366531.397374:0:7601:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.123@tcp lock: ffff9638a0741600/0x8da3486b955f2f7a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366531.397384:0:7601:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.123@tcp lock: ffff9638a0741600/0x8da3486b955f2f7a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366531.397395:0:7601:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.123@tcp lock: ffff9638a0741600/0x8da3486b955f2f7a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789366531.397413:0:7601:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9638b6ea2680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8cde4528-5832-4854-a387-4adacc3dd0ab:7601:1876286758729472:0@lo:101: 00000100:00100000:2.0:1789366531.397457:0:7601:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789366531.397516:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286758729472 00000100:00100000:3.0:1789366531.397523:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286758729472 00000100:00100000:2.0:1789366531.397538:0:7601:0:(client.c:2716:ptlrpc_set_wait()) set ffff96389883e300 going to sleep for 11 seconds 00000100:00100000:3.0:1789366531.397564:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1789366531.397573:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638b4e86450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8cde4528-5832-4854-a387-4adacc3dd0ab+13:7601:x1876286758729472:12345-0@lo:101: 00010000:00010000:3.0:1789366531.397597:0:5808:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789366531.397612:0:5808:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9638832d3e00/0x8da3486b955f2f81 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x8da3486b955f2f7a expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366531.397636:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9638832d3e00/0x8da3486b955f2f81 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8da3486b955f2f7a expref: 14 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366531.397648:0:5808:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9638832d3e00/0x8da3486b955f2f81 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8da3486b955f2f7a expref: 14 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366531.397657:0:5808:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9638832d3e00, rc 0) 00000100:00100000:3.0:1789366531.397698:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638b4e86450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8cde4528-5832-4854-a387-4adacc3dd0ab+14:7601:x1876286758729472:12345-0@lo:101: Request processed in 125us (240us total) trans 0 rc 0/0 00000100:00100000:3.0:1789366531.397704:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1789366531.397764:0:7601:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9638b6ea2680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8cde4528-5832-4854-a387-4adacc3dd0ab:7601:1876286758729472:0@lo:101: 00010000:00010000:2.0:1789366531.397778:0:7601:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.123@tcp lock: ffff9638a0741600/0x8da3486b955f2f7a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8da3486b955f2f81 expref: -99 pid: 7601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366531.397790:0:7601:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.123@tcp lock: ffff9638a0741600/0x8da3486b955f2f7a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x8da3486b955f2f81 expref: -99 pid: 7601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789366531.397862:0:7601:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9638b6ea2680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8cde4528-5832-4854-a387-4adacc3dd0ab:7601:1876286758729600:0@lo:501: 00000100:00100000:2.0:1789366531.397889:0:7601:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789366531.397915:0:7601:0:(client.c:2716:ptlrpc_set_wait()) set ffff96389883e300 going to sleep for 11 seconds 00000100:00100000:3.0:1789366531.397926:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286758729600 00000100:00100000:3.0:1789366531.397932:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286758729600 00000100:00100000:3.0:1789366531.397963:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1789366531.397970:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638b4e86050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8cde4528-5832-4854-a387-4adacc3dd0ab+14:7601:x1876286758729600:12345-0@lo:501: 00000100:00100000:3.0:1789366531.398175:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638b4e86050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8cde4528-5832-4854-a387-4adacc3dd0ab+14:7601:x1876286758729600:12345-0@lo:501: Request processed in 204us (284us total) trans 0 rc 0/0 00000100:00100000:3.0:1789366531.398182:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1789366531.398227:0:7601:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9638b6ea2680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8cde4528-5832-4854-a387-4adacc3dd0ab:7601:1876286758729600:0@lo:501: 00000100:00100000:2.0:1789366531.398255:0:7601:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9638b6ea2680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8cde4528-5832-4854-a387-4adacc3dd0ab:7601:1876286758729728:0@lo:503: 00000100:00100000:2.0:1789366531.398295:0:7601:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789366531.398322:0:7601:0:(client.c:2716:ptlrpc_set_wait()) set ffff96389883e300 going to sleep for 11 seconds 00000100:00100000:3.0:1789366531.398343:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286758729728 00000100:00100000:3.0:1789366531.398349:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286758729728 00000100:00100000:3.0:1789366531.398378:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1789366531.398385:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638b4e86850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8cde4528-5832-4854-a387-4adacc3dd0ab+14:7601:x1876286758729728:12345-0@lo:503: 00000100:00100000:3.0:1789366531.398528:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638b4e86850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8cde4528-5832-4854-a387-4adacc3dd0ab+14:7601:x1876286758729728:12345-0@lo:503: Request processed in 143us (232us total) trans 0 rc 0/0 00000100:00100000:3.0:1789366531.398536:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1789366531.398581:0:7601:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9638b6ea2680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8cde4528-5832-4854-a387-4adacc3dd0ab:7601:1876286758729728:0@lo:503: 00000040:00080000:2.0:1789366531.398873:0:7601:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1789366531.398915:0:7601:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9638b6ea2680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8cde4528-5832-4854-a387-4adacc3dd0ab:7601:1876286758729856:0@lo:502: 00000100:00100000:2.0:1789366531.398940:0:7601:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789366531.398959:0:7601:0:(client.c:2716:ptlrpc_set_wait()) set ffff96389883e300 going to sleep for 11 seconds 00000100:00100000:1.0:1789366531.398977:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286758729856 00000100:00100000:1.0:1789366531.398984:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286758729856 00000100:00100000:1.0:1789366531.399013:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1789366531.399022:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638b4e87450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8cde4528-5832-4854-a387-4adacc3dd0ab+14:7601:x1876286758729856:12345-0@lo:502: 00000100:00100000:1.0:1789366531.399184:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638b4e87450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8cde4528-5832-4854-a387-4adacc3dd0ab+14:7601:x1876286758729856:12345-0@lo:502: Request processed in 164us (241us total) trans 0 rc 0/0 00000100:00100000:1.0:1789366531.399193:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1789366531.399213:0:7601:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9638b6ea2680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8cde4528-5832-4854-a387-4adacc3dd0ab:7601:1876286758729856:0@lo:502: 00000040:00080000:2.0:1789366531.399398:0:7601:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:2.0:1789366531.399430:0:7601:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:2.0:1789366531.399448:0:7601:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:2.0:1789366531.399471:0:7601:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:2.0:1789366531.399490:0:7601:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:2.0:1789366531.399519:0:7601:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:2.0:1789366531.399557:0:7601:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:2.0:1789366531.399592:0:7601:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:2.0:1789366531.399644:0:7601:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:2.0:1789366531.399686:0:7601:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:2.0:1789366531.399766:0:7601:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:3.0:1789366531.399947:0:7601:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:3.0:1789366531.399991:0:7601:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:3.0:1789366531.400029:0:7601:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:3.0:1789366531.400106:0:7601:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:3.0:1789366531.400148:0:7601:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:3.0:1789366531.400200:0:7601:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:3.0:1789366531.400277:0:7601:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:3.0:1789366531.400317:0:7601:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:3.0:1789366531.400371:0:7601:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:3.0:1789366531.400422:0:7601:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:3.0:1789366531.400457:0:7601:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:3.0:1789366531.400489:0:7601:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:3.0:1789366531.400565:0:7601:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:3.0:1789366531.400603:0:7601:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 128 off12440 00000040:00080000:3.0:1789366531.400641:0:7601:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12664 00000040:00080000:3.0:1789366531.400690:0:7601:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12888 00000040:00080000:3.0:1789366531.400768:0:7601:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off12968 00000040:00080000:3.0:1789366531.400808:0:7601:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13192 00000040:00080000:3.0:1789366531.400854:0:7601:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13416 00000040:00080000:3.0:1789366531.400891:0:7601:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 88 off13504 00000040:00080000:3.0:1789366531.400922:0:7601:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 128 off13632 00000040:00080000:3.0:1789366531.400952:0:7601:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 144 off13776 00000040:00080000:3.0:1789366531.400998:0:7601:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 128 off13904 00000040:00080000:3.0:1789366531.401032:0:7601:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 224 off14128 00000040:00080000:3.0:1789366531.401077:0:7601:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14352 00000040:00080000:3.0:1789366531.401112:0:7601:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].37, 80 off14432 00000100:00100000:3.0:1789366531.401151:0:7601:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9638bf5ab100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8cde4528-5832-4854-a387-4adacc3dd0ab:7601:1876286758729984:0@lo:502: 00000100:00100000:3.0:1789366531.401216:0:7601:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789366531.401259:0:7601:0:(client.c:2716:ptlrpc_set_wait()) set ffff963884dfde40 going to sleep for 11 seconds 00000100:00100000:2.0:1789366531.401285:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286758729984 00000100:00100000:2.0:1789366531.401294:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286758729984 00000100:00100000:2.0:1789366531.401349:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1789366531.401359:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638b4e85050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8cde4528-5832-4854-a387-4adacc3dd0ab+14:7601:x1876286758729984:12345-0@lo:502: 00000100:00100000:2.0:1789366531.401584:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638b4e85050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8cde4528-5832-4854-a387-4adacc3dd0ab+14:7601:x1876286758729984:12345-0@lo:502: Request processed in 227us (367us total) trans 0 rc 0/0 00000100:00100000:2.0:1789366531.401592:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1789366531.401625:0:7601:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9638bf5ab100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8cde4528-5832-4854-a387-4adacc3dd0ab:7601:1876286758729984:0@lo:502: 00000040:00080000:3.0:1789366531.401708:0:7601:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].38, 224 off14656 00000040:00080000:3.0:1789366531.401760:0:7601:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 38 count 39 00000020:01000004:0.0:1789366531.402282:0:7612:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:0.0:1789366531.402303:0:7612:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff9638b4f2cd40) 00000020:00000080:0.0:1789366531.402344:0:7612:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type lwp with refcount 2 00000020:01000004:0.0:1789366531.402420:0:7612:0:(tgt_mount.c:153:server_get_mount()) get mount ffff963883577000 from lustre-OST0001, refs=3 00000020:01000004:0.0:1789366531.402423:0:7612:0:(tgt_mount.c:187:server_put_mount()) put mount ffff963883577000 from lustre-OST0001, refs=3 00000020:01000004:0.0:1789366531.402425:0:7612:0:(obd_mount.c:710:lustre_put_lsi()) put ffff963883577000 3 00010000:00080000:0.0:1789366531.402456:0:7612:0:(ldlm_lib.c:102:import_set_conn()) imp ffff963883576800@lustre-MDT0000-lwp-OST0001: add connection 192.168.202.123@tcp at head 00010000:00010000:0.0:1789366531.403929:0:7612:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-4 is initialized 00000020:00000080:0.0:1789366531.404117:0:7612:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:0.0:1789366531.404145:0:7612:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1789366531.404156:0:7612:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0x8da3486b955f2f8f 00000100:00080000:0.0:1789366531.404167:0:7612:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1789366531.404176:0:7612:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff963883576800 using connection 192.168.202.123@tcp/0@lo 00000100:00100000:0.0:1789366531.404213:0:7612:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff963785f29500 x1876286758730112/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1789366531.404239:0:7612:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00100000:1.0:1789366531.404269:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff963785f29500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3283:1876286758730112:0@lo:38: 00000100:00100000:1.0:1789366531.404368:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789366531.404405:0:3286:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9638b6ea2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3286:1876286758730240:0@lo:400: 00000100:00100000:2.0:1789366531.404435:0:3287:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9638b6ea1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3287:1876286758730368:0@lo:400: 00000100:00100000:0.0:1789366531.404446:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789366531.404472:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286758730112 00000100:00100000:2.0:1789366531.404476:0:3287:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789366531.404481:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286758730112 00000100:00100000:0.0:1789366531.404503:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286758730240 00000100:00100000:0.0:1789366531.404508:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286758730240 00000100:00100000:2.0:1789366531.404512:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9638b6ea1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3284:1876286758730496:0@lo:400: 00000100:00100000:1.0:1789366531.404522:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286758730368 00000100:00100000:1.0:1789366531.404527:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286758730368 00000100:00100000:0.0:1789366531.404546:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1789366531.404555:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789366531.404557:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963785f28e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3286:x1876286758730240:12345-0@lo:400: 00000100:00100000:1.0:1789366531.404573:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1789366531.404586:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638b6ea2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3287:x1876286758730368:12345-0@lo:400: 00000100:00100000:2.0:1789366531.404597:0:5816:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 4 min 3 max 116 00000100:00100000:2.0:1789366531.404607:0:5816:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_004' 00000100:00100000:0.0:1789366531.404610:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963785f28e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3286:x1876286758730240:12345-0@lo:400: Request processed in 55us (165us total) trans 0 rc 0/0 00000100:00100000:0.0:1789366531.404618:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00080000:2.0:1789366531.404619:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789366531.404635:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286758730496 00000100:00100000:0.0:1789366531.404636:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1789366531.404639:0:6659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286758730496 00000100:00100000:0.0:1789366531.404641:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638987eb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3283:x1876286758730112:12345-0@lo:38: 00000100:00100000:1.0:1789366531.404647:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638b6ea2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3287:x1876286758730368:12345-0@lo:400: Request processed in 63us (170us total) trans 0 rc 0/0 00000100:00100000:1.0:1789366531.404657:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:0.0:1789366531.404668:0:5817:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 106 last 0 00000100:00100000:2.0:1789366531.404681:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789366531.404688:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638b6ea1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3284:x1876286758730496:12345-0@lo:400: 00000020:00000080:0.0:1789366531.404708:0:5817:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0x8da3486b955f2f96 00000100:00100000:2.0:1789366531.404747:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638b6ea1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3284:x1876286758730496:12345-0@lo:400: Request processed in 60us (191us total) trans 0 rc 0/0 00000004:00100000:0.0:1789366531.404751:0:5817:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00100000:2.0:1789366531.404753:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:2.0:1789366531.404772:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789366531.404784:0:5817:0:(import.c:65:import_set_state_nolock()) ffff9638b7021800 : changing import state from RECOVER to FULL 00010000:00080000:2.0:1789366531.404797:0:3287:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9638b6ea1c00 x1876286758730368/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789366547 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789366531.404810:0:3287:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9638b6ea1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3287:1876286758730368:0@lo:400: 00000100:00100000:0.0:1789366531.404820:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638987eb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3283:x1876286758730112:12345-0@lo:38: Request processed in 179us (454us total) trans 0 rc 0/0 00000100:00100000:0.0:1789366531.404834:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:1.0:1789366531.404872:0:3284:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9638b6ea1180 x1876286758730496/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789366547 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789366531.404883:0:3284:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967298 gen 2 00010000:00080000:0.0:1789366531.404885:0:3286:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9638b6ea2680 x1876286758730240/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789366547 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789366531.404898:0:3286:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9638b6ea2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3286:1876286758730240:0@lo:400: 00000100:00100000:1.0:1789366531.404901:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9638b6ea1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3284:1876286758730496:0@lo:400: 00010000:00080000:0.0:1789366531.404944:0:3283:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff963785f29500 x1876286758730112/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789366541 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789366531.404958:0:3283:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1789366531.404964:0:3283:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 1 00000100:00080000:0.0:1789366531.404972:0:3283:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:0.0:1789366531.404977:0:3283:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1789366531.404979:0:3283:0:(import.c:65:import_set_state_nolock()) ffff963883576800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1789366531.404985:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff963785f29500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3283:1876286758730112:0@lo:38: 00000100:00100000:2.0:1789366531.405112:0:7613:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9638b6ea1c00 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:7613:1876286758730624:0@lo:901: 00000040:00080000:0.0:1789366531.405149:0:7612:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000100:00100000:2.0:1789366531.405151:0:7613:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789366531.405185:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286758730624 00000100:00100000:2.0:1789366531.405190:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286758730624 00000100:00080000:1.0:1789366531.405210:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789366531.405227:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000020:01000000:1.0:1789366531.405234:0:7601:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-38 (rc=0) 00000100:00100000:2.0:1789366531.405239:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638b6ea2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:7613:x1876286758730624:12345-0@lo:901: 10000000:01000000:1.0:1789366531.405269:0:7601:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.123@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1789366531.405306:0:7601:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.123@tcp lock: ffff9638a0741600/0x8da3486b955f2f7a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8da3486b955f2f81 expref: -99 pid: 7601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366531.405318:0:7601:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.123@tcp lock: ffff9638a0741600/0x8da3486b955f2f7a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8da3486b955f2f81 expref: -99 pid: 7601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1789366531.405385:0:7601:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1789366531.405387:0:7601:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1789366531.405389:0:7601:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789366531.405390:0:7601:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789366531.405391:0:7601:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789366531.405393:0:7601:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789366531.405394:0:7601:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1789366531.405396:0:7601:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1789366531.405398:0:7601:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1789366531.405399:0:7601:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789366531.405401:0:7601:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1789366531.405407:0:7601:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020062 00000020:01000004:1.0:1789366531.405409:0:7601:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1789366531.405411:0:7601:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1789366531.405412:0:7601:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789366531.405413:0:7601:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789366531.405414:0:7601:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789366531.405415:0:7601:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789366531.405416:0:7601:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1789366531.405417:0:7601:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1789366531.405417:0:7601:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1789366531.405418:0:7601:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789366531.405419:0:7601:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1789366531.405443:0:7601:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:1.0:1789366531.405451:0:7601:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9638987e8380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8cde4528-5832-4854-a387-4adacc3dd0ab:7601:1876286758730752:0@lo:253: 00000100:00100000:1.0:1789366531.405495:0:7601:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789366531.405541:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286758730752 00000100:00100000:1.0:1789366531.405544:0:7601:0:(client.c:2716:ptlrpc_set_wait()) set ffff96388a1a0600 going to sleep for 11 seconds 00000100:00100000:0.0:1789366531.405547:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286758730752 00000100:00100000:0.0:1789366531.405585:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1789366531.405594:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638b4e83450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8cde4528-5832-4854-a387-4adacc3dd0ab+14:7601:x1876286758730752:12345-0@lo:253: 20000000:01000000:0.0:1789366531.405626:0:5811:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:0.0:1789366531.405644:0:5811:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:2.0:1789366531.405699:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638b6ea2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:7613:x1876286758730624:12345-0@lo:901: Request processed in 463us (545us total) trans 0 rc 0/0 00000100:00100000:2.0:1789366531.405705:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789366531.405745:0:7613:0:(client.c:2716:ptlrpc_set_wait()) set ffff96389883e3c0 going to sleep for 11 seconds 00010000:00080000:2.0:1789366531.405762:0:7613:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9638b6ea1c00 x1876286758730624/t0(0) o901->lustre-MDT0000-lwp-OST0001@0@lo:29/10 lens 248/4320 e 0 to 0 dl 1789366547 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789366531.405785:0:7613:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9638b6ea1c00 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:7613:1876286758730624:0@lo:901: 20000000:01000000:3.0:1789366531.422985:0:5811:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1789366531.423007:0:5811:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:0.0:1789366531.423022:0:5831:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1789366531.423029:0:5831:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1789366531.423114:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff963880030e00/0x8da3486b955f2f9d lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366531.423137:0:5831:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9638827f6400/0x8da3486b955f2ee0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8da3486b955f2ed9 expref: 14 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366531.423167:0:5831:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff963880030e00/0x8da3486b955f2f9d lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366531.423219:0:5831:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9638827f6400/0x8da3486b955f2ee0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x8da3486b955f2ed9 expref: 14 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366531.423237:0:5831:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9638827f6400/0x8da3486b955f2ee0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x8da3486b955f2ed9 expref: 14 pid: 5810 timeout: 256 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789366531.423257:0:5831:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff963785f29500 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5831:1876286758730880:0@lo:104: 00000100:00100000:0.0:1789366531.423371:0:5831:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789366531.423451:0:5831:0:(client.c:2716:ptlrpc_set_wait()) set ffff963883ba5c00 going to sleep for 11 seconds 00000100:00100000:2.0:1789366531.423508:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286758730880 00000100:00100000:2.0:1789366531.423519:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286758730880 00000100:00100000:2.0:1789366531.423583:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1789366531.423596:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963785f2a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8cde4528-5832-4854-a387-4adacc3dd0ab+3:5831:x1876286758730880:12345-0@lo:104: 00010000:00010000:2.0:1789366531.423613:0:5799:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.123@tcp lock: ffff96388148f600/0x8da3486b955f2ed9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x8da3486b955f2ee0 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366531.423695:0:5799:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1789366531.423703:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963785f2a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8cde4528-5832-4854-a387-4adacc3dd0ab+3:5831:x1876286758730880:12345-0@lo:104: Request processed in 109us (332us total) trans 0 rc 0/0 00000100:00100000:2.0:1789366531.423711:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1789366531.423747:0:5831:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff963785f29500 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5831:1876286758730880:0@lo:104: 00010000:00010000:3.0:1789366531.423777:0:5831:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff963880030e00/0x8da3486b955f2f9d lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366531.423782:0:6675:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789366531.423793:0:6675:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.123@tcp lock: ffff96388148f600/0x8da3486b955f2ed9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x8da3486b955f2ee0 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366531.423803:0:6675:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96388148f600 already unused, calling callback (ffffffffc1cc7c20) 10000000:00010000:2.0:1789366531.423808:0:6675:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.123@tcp lock: ffff96388148f600/0x8da3486b955f2ed9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x8da3486b955f2ee0 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366531.423819:0:6675:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.123@tcp lock: ffff96388148f600/0x8da3486b955f2ed9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x8da3486b955f2ee0 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789366531.423828:0:6675:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.123@tcp lock: ffff96388148f600/0x8da3486b955f2ed9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x8da3486b955f2ee0 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789366531.423834:0:6675:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1789366531.423871:0:6675:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.123@tcp lock: ffff96388148f600/0x8da3486b955f2ed9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8da3486b955f2ee0 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366531.423885:0:6675:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789366531.423915:0:6675:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.123@tcp lock: ffff96388148f600/0x8da3486b955f2ed9 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8da3486b955f2ee0 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789366531.423916:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9638b6ea1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8cde4528-5832-4854-a387-4adacc3dd0ab:3285:1876286758731008:0@lo:103: 00010000:00010000:2.0:1789366531.423930:0:6675:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.123@tcp lock: ffff96388148f600/0x8da3486b955f2ed9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8da3486b955f2ee0 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366531.423951:0:6675:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789366531.423953:0:6675:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789366531.423957:0:6675:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789366531.423961:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789366531.425572:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286758731008 00000100:00100000:0.0:1789366531.425583:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286758731008 00010000:00010000:0.0:1789366531.425617:0:5803:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9638827f6400/0x8da3486b955f2ee0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8da3486b955f2ed9 expref: 15 pid: 5810 timeout: 256 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789366531.425659:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1789366531.425668:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638bf5ab100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8cde4528-5832-4854-a387-4adacc3dd0ab+15:3285:x1876286758731008:12345-0@lo:103: 00010000:00010000:0.0:1789366531.425684:0:5803:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789366531.425690:0:5803:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9638827f6400/0x8da3486b955f2ee0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8da3486b955f2ed9 expref: 15 pid: 5810 timeout: 256 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366531.425704:0:5803:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9638827f6400/0x8da3486b955f2ee0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x8da3486b955f2ed9 expref: 15 pid: 5810 timeout: 256 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366531.425745:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9638827f6400/0x8da3486b955f2ee0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x8da3486b955f2ed9 expref: 15 pid: 5810 timeout: 256 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366531.425781:0:5803:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff963880030e00/0x8da3486b955f2f9d lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366531.425791:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff963880030e00/0x8da3486b955f2f9d lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1789366531.425809:0:5803:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.002780806s 00010000:00010000:0.0:1789366531.425815:0:5803:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff963880030e00/0x8da3486b955f2f9d lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366531.425823:0:5803:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff963880030e00/0x8da3486b955f2f9d lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366531.425833:0:5803:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff963880030e00/0x8da3486b955f2f9d lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366531.425841:0:5803:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff963880030e00/0x8da3486b955f2f9d lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366531.425848:0:5803:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff963880030e00 already unused, calling callback (ffffffffc16df520) 00010000:00010000:0.0:1789366531.425854:0:5803:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff963880030e00/0x8da3486b955f2f9d lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366531.425864:0:5803:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff963880030e00/0x8da3486b955f2f9d lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366531.425886:0:5803:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff963880030e00/0x8da3486b955f2f9d lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366531.425899:0:5803:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789366531.425915:0:5831:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff963880030e00/0x8da3486b955f2f9d lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366531.425927:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff963880030e00/0x8da3486b955f2f9d lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366531.425935:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff963880030e00/0x8da3486b955f2f9d lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789366531.425971:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638bf5ab100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8cde4528-5832-4854-a387-4adacc3dd0ab+14:3285:x1876286758731008:12345-0@lo:103: Request processed in 303us (2011us total) trans 0 rc 0/0 00000100:00100000:0.0:1789366531.425980:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1789366531.426291:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9638b6ea1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8cde4528-5832-4854-a387-4adacc3dd0ab:3285:1876286758731008:0@lo:103: 00000100:00100000:3.0:1789366531.434447:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638b4e83450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8cde4528-5832-4854-a387-4adacc3dd0ab+13:7601:x1876286758730752:12345-0@lo:253: Request processed in 28842us (28939us total) trans 0 rc 0/0 00000100:00100000:3.0:1789366531.434466:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1789366531.434481:0:7601:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9638987e8380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8cde4528-5832-4854-a387-4adacc3dd0ab:7601:1876286758730752:0@lo:253: 10000000:01000000:1.0:1789366531.434505:0:7601:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:1.0:1789366531.434522:0:7601:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1789366531.434525:0:7601:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1789366531.434526:0:7601:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789366531.434528:0:7601:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789366531.434529:0:7601:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789366531.434531:0:7601:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789366531.434532:0:7601:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1789366531.434534:0:7601:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1789366531.434536:0:7601:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1789366531.434538:0:7601:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789366531.434540:0:7601:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1789366531.434560:0:7601:0:(tgt_mount.c:2698:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:1.0:1789366531.441516:0:7601:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:1.0:1789366531.441703:0:7601:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:1.0:1789366531.441916:0:7601:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:1.0:1789366531.442097:0:7601:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:1.0:1789366531.442294:0:7601:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:1.0:1789366531.442539:0:7601:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:3.0:1789366531.444273:0:7601:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00002000:00080000:3.0:1789366531.543169:0:7601:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:3.0:1789366531.543180:0:7601:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:3.0:1789366531.543243:0:7601:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1789366531.543324:0:7601:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.123@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1789366531.543360:0:7601:0:(tgt_mount.c:2464:server_fill_super_common()) Server sb, dev=49 00000080:00000004:3.0:1789366531.543394:0:7601:0:(super25.c:182:lustre_fill_super()) lustre-ost2/ost2: Mount complete 00010000:00010000:3.0:1789366531.959962:0:5805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789366532.535884:0:3286:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9638b6ea1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3286:1876286758731136:0@lo:13: 00000100:00100000:0.0:1789366532.535950:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789366532.536022:0:6662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286758731136 00000100:00100000:3.0:1789366532.536030:0:6662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286758731136 00000100:00100000:3.0:1789366532.536080:0:6662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789366532.536087:0:6662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963785f2b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3286:x1876286758731136:12345-0@lo:13: 00002000:00000024:3.0:1789366532.536115:0:6662:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789366532.536153:0:6662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963785f2b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3286:x1876286758731136:12345-0@lo:13: Request processed in 67us (204us total) trans 0 rc 0/0 00000100:00100000:3.0:1789366532.536158:0:6662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1789366532.536189:0:3286:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9638b6ea1c00 x1876286758731136/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789366548 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789366532.536207:0:3286:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9638b6ea1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3286:1876286758731136:0@lo:13: 00010000:00010000:1.0:1789366532.984816:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1789366533.548105:0:7955:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg223-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:2.0:1789366534.007852:0:6675:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789366535.031860:0:5805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1789366535.031868:0:5813:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1789366535.031874:0:5813:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff963885b46000 from 30 10000000:01000000:1.0:1789366535.031879:0:5813:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1789366535.031931:0:5813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.123@tcp lock: ffff96388148f800/0x8da3486b955f2fa4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366535.031943:0:5813:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.123@tcp lock: ffff96388148f800/0x8da3486b955f2fa4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366535.031954:0:5813:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.123@tcp lock: ffff96388148f800/0x8da3486b955f2fa4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789366535.031977:0:5813:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9638987e8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8cde4528-5832-4854-a387-4adacc3dd0ab:5813:1876286758731264:0@lo:101: 00000100:00100000:1.0:1789366535.032042:0:5813:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789366535.032102:0:5813:0:(client.c:2716:ptlrpc_set_wait()) set ffff9638b6da0f00 going to sleep for 11 seconds 00000100:00100000:2.0:1789366535.032115:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286758731264 00000100:00100000:2.0:1789366535.032124:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286758731264 00000100:00100000:2.0:1789366535.032174:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1789366535.032183:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638b4e81050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8cde4528-5832-4854-a387-4adacc3dd0ab+13:5813:x1876286758731264:12345-0@lo:101: 00010000:00010000:2.0:1789366535.032197:0:5808:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789366535.032207:0:5808:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9638a0741400/0x8da3486b955f2fab lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x8da3486b955f2fa4 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366535.032227:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9638a0741400/0x8da3486b955f2fab lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8da3486b955f2fa4 expref: 14 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366535.032235:0:5808:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9638a0741400/0x8da3486b955f2fab lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8da3486b955f2fa4 expref: 14 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366535.032242:0:5808:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9638a0741400, rc 0) 00000100:00100000:2.0:1789366535.032277:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638b4e81050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8cde4528-5832-4854-a387-4adacc3dd0ab+14:5813:x1876286758731264:12345-0@lo:101: Request processed in 97us (236us total) trans 0 rc 0/0 00000100:00100000:2.0:1789366535.032288:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1789366535.032329:0:5813:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9638987e8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8cde4528-5832-4854-a387-4adacc3dd0ab:5813:1876286758731264:0@lo:101: 00010000:00010000:1.0:1789366535.032342:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.123@tcp lock: ffff96388148f800/0x8da3486b955f2fa4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x8da3486b955f2fab expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366535.032350:0:5813:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.123@tcp lock: ffff96388148f800/0x8da3486b955f2fa4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x8da3486b955f2fab expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789366535.032388:0:5813:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9638987e8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8cde4528-5832-4854-a387-4adacc3dd0ab:5813:1876286758731392:0@lo:501: 00000100:00100000:1.0:1789366535.032406:0:5813:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789366535.032425:0:5813:0:(client.c:2716:ptlrpc_set_wait()) set ffff9638b6da0f00 going to sleep for 11 seconds 00000100:00100000:3.0:1789366535.032469:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286758731392 00000100:00100000:3.0:1789366535.032475:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286758731392 00000100:00100000:3.0:1789366535.032506:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1789366535.032515:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638b4e80850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8cde4528-5832-4854-a387-4adacc3dd0ab+14:5813:x1876286758731392:12345-0@lo:501: 00000100:00100000:3.0:1789366535.032846:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638b4e80850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8cde4528-5832-4854-a387-4adacc3dd0ab+14:5813:x1876286758731392:12345-0@lo:501: Request processed in 333us (437us total) trans 0 rc 0/0 00000100:00100000:3.0:1789366535.032851:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1789366535.032876:0:5813:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9638987e8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8cde4528-5832-4854-a387-4adacc3dd0ab:5813:1876286758731392:0@lo:501: 00000100:00100000:1.0:1789366535.032898:0:5813:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9638987e8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8cde4528-5832-4854-a387-4adacc3dd0ab:5813:1876286758731520:0@lo:503: 00000100:00100000:1.0:1789366535.032926:0:5813:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789366535.032954:0:5813:0:(client.c:2716:ptlrpc_set_wait()) set ffff9638b6da0f00 going to sleep for 11 seconds 00000100:00100000:2.0:1789366535.032968:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286758731520 00000100:00100000:2.0:1789366535.032972:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286758731520 00000100:00100000:2.0:1789366535.032994:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1789366535.033000:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638b4e80050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8cde4528-5832-4854-a387-4adacc3dd0ab+14:5813:x1876286758731520:12345-0@lo:503: 00000100:00100000:2.0:1789366535.033237:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638b4e80050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8cde4528-5832-4854-a387-4adacc3dd0ab+14:5813:x1876286758731520:12345-0@lo:503: Request processed in 236us (308us total) trans 0 rc 0/0 00000100:00100000:2.0:1789366535.033243:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1789366535.033263:0:5813:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9638987e8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8cde4528-5832-4854-a387-4adacc3dd0ab:5813:1876286758731520:0@lo:503: 00000100:00100000:1.0:1789366535.033604:0:8059:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9638987e8380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8cde4528-5832-4854-a387-4adacc3dd0ab:8059:1876286758731648:0@lo:502: 00000100:00100000:1.0:1789366535.033635:0:8059:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789366535.033654:0:8059:0:(client.c:2716:ptlrpc_set_wait()) set ffff9638b6da0840 going to sleep for 11 seconds 00000100:00100000:3.0:1789366535.033675:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286758731648 00000100:00100000:3.0:1789366535.033679:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286758731648 00000100:00100000:3.0:1789366535.033707:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1789366535.033734:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638b4e81450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8cde4528-5832-4854-a387-4adacc3dd0ab+14:8059:x1876286758731648:12345-0@lo:502: 00000100:00100000:3.0:1789366535.033940:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638b4e81450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8cde4528-5832-4854-a387-4adacc3dd0ab+14:8059:x1876286758731648:12345-0@lo:502: Request processed in 225us (304us total) trans 0 rc 0/0 00000100:00100000:3.0:1789366535.033946:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1789366535.033975:0:8059:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9638987e8380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8cde4528-5832-4854-a387-4adacc3dd0ab:8059:1876286758731648:0@lo:502: 00000100:00100000:1.0:1789366535.034018:0:8059:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9638987e8380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8cde4528-5832-4854-a387-4adacc3dd0ab:8059:1876286758731776:0@lo:502: 00000100:00100000:1.0:1789366535.034048:0:8059:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789366535.034075:0:8059:0:(client.c:2716:ptlrpc_set_wait()) set ffff9638b6da0840 going to sleep for 11 seconds 00000100:00100000:2.0:1789366535.034087:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286758731776 00000100:00100000:2.0:1789366535.034092:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286758731776 00000100:00100000:2.0:1789366535.034114:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1789366535.034120:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638b4e80c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8cde4528-5832-4854-a387-4adacc3dd0ab+14:8059:x1876286758731776:12345-0@lo:502: 00000100:00100000:2.0:1789366535.034240:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638b4e80c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8cde4528-5832-4854-a387-4adacc3dd0ab+14:8059:x1876286758731776:12345-0@lo:502: Request processed in 120us (191us total) trans 0 rc 0/0 00000100:00100000:2.0:1789366535.034247:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1789366535.034264:0:8059:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9638987e8380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8cde4528-5832-4854-a387-4adacc3dd0ab:8059:1876286758731776:0@lo:502: 00000040:00080000:1.0:1789366535.034282:0:8059:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:3.0:1789366535.034376:0:5813:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:3.0:1789366535.034394:0:5813:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.123@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1789366535.034401:0:5813:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.123@tcp lock: ffff96388148f800/0x8da3486b955f2fa4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x8da3486b955f2fab expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366535.034411:0:5813:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.123@tcp lock: ffff96388148f800/0x8da3486b955f2fa4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x8da3486b955f2fab expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789366535.034431:0:5813:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:3.0:1789366535.034433:0:5813:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 8 10000000:01000000:3.0:1789366535.034435:0:5813:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:3.0:1789366535.034455:0:5813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.123@tcp lock: ffff9638832d2200/0x8da3486b955f2fb2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366535.034461:0:5813:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.123@tcp lock: ffff9638832d2200/0x8da3486b955f2fb2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366535.034467:0:5813:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.123@tcp lock: ffff9638832d2200/0x8da3486b955f2fb2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789366535.034475:0:5813:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9638bf5aaa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8cde4528-5832-4854-a387-4adacc3dd0ab:5813:1876286758731904:0@lo:101: 00000100:00100000:3.0:1789366535.034498:0:5813:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789366535.034522:0:5813:0:(client.c:2716:ptlrpc_set_wait()) set ffff9638850bc300 going to sleep for 11 seconds 00000100:00100000:0.0:1789366535.034555:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286758731904 00000100:00100000:0.0:1789366535.034562:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286758731904 00000100:00100000:0.0:1789366535.034590:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1789366535.034600:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638b4e81c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8cde4528-5832-4854-a387-4adacc3dd0ab+14:5813:x1876286758731904:12345-0@lo:101: 00010000:00010000:0.0:1789366535.034608:0:5811:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789366535.034623:0:5811:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff963880031200/0x8da3486b955f2fb9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x8da3486b955f2fb2 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366535.034650:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff963880031200/0x8da3486b955f2fb9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8da3486b955f2fb2 expref: 15 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366535.034660:0:5811:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff963880031200/0x8da3486b955f2fb9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8da3486b955f2fb2 expref: 15 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366535.034667:0:5811:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff963880031200, rc 0) 00000100:00100000:0.0:1789366535.034709:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638b4e81c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8cde4528-5832-4854-a387-4adacc3dd0ab+15:5813:x1876286758731904:12345-0@lo:101: Request processed in 111us (209us total) trans 0 rc 0/0 00000100:00100000:0.0:1789366535.034744:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1789366535.034749:0:5813:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9638bf5aaa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8cde4528-5832-4854-a387-4adacc3dd0ab:5813:1876286758731904:0@lo:101: 00010000:00010000:3.0:1789366535.034767:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.123@tcp lock: ffff9638832d2200/0x8da3486b955f2fb2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x8da3486b955f2fb9 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366535.034776:0:5813:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.123@tcp lock: ffff9638832d2200/0x8da3486b955f2fb2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x8da3486b955f2fb9 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789366535.034813:0:5813:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9638bf5aaa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8cde4528-5832-4854-a387-4adacc3dd0ab:5813:1876286758732032:0@lo:501: 00000100:00100000:3.0:1789366535.034837:0:5813:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789366535.034859:0:5813:0:(client.c:2716:ptlrpc_set_wait()) set ffff9638850bc300 going to sleep for 11 seconds 00000100:00100000:2.0:1789366535.034877:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286758732032 00000100:00100000:2.0:1789366535.034882:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286758732032 00000100:00100000:2.0:1789366535.034911:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1789366535.034918:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638b4e83850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8cde4528-5832-4854-a387-4adacc3dd0ab+15:5813:x1876286758732032:12345-0@lo:501: 00000100:00100000:2.0:1789366535.035074:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638b4e83850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8cde4528-5832-4854-a387-4adacc3dd0ab+15:5813:x1876286758732032:12345-0@lo:501: Request processed in 156us (235us total) trans 0 rc 0/0 00000100:00100000:2.0:1789366535.035080:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1789366535.035111:0:5813:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9638bf5aaa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8cde4528-5832-4854-a387-4adacc3dd0ab:5813:1876286758732032:0@lo:501: 00000100:00100000:3.0:1789366535.035132:0:5813:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9638bf5aaa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8cde4528-5832-4854-a387-4adacc3dd0ab:5813:1876286758732160:0@lo:503: 00000100:00100000:3.0:1789366535.035169:0:5813:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789366535.035190:0:5813:0:(client.c:2716:ptlrpc_set_wait()) set ffff9638850bc300 going to sleep for 11 seconds 00000100:00100000:0.0:1789366535.035255:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286758732160 00000100:00100000:0.0:1789366535.035260:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286758732160 00000100:00100000:0.0:1789366535.035282:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1789366535.035287:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638b4e83c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8cde4528-5832-4854-a387-4adacc3dd0ab+15:5813:x1876286758732160:12345-0@lo:503: 00000100:00100000:0.0:1789366535.035535:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638b4e83c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8cde4528-5832-4854-a387-4adacc3dd0ab+15:5813:x1876286758732160:12345-0@lo:503: Request processed in 248us (365us total) trans 0 rc 0/0 00000100:00100000:0.0:1789366535.035540:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:3.0:1789366535.035659:0:5813:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9638bf5aaa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8cde4528-5832-4854-a387-4adacc3dd0ab:5813:1876286758732160:0@lo:503: 00000100:00100000:0.0:1789366535.035948:0:8060:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff963785f28380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8cde4528-5832-4854-a387-4adacc3dd0ab:8060:1876286758732288:0@lo:502: 00000100:00100000:0.0:1789366535.035980:0:8060:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789366535.036006:0:8060:0:(client.c:2716:ptlrpc_set_wait()) set ffff96388a342780 going to sleep for 11 seconds 00000100:00100000:2.0:1789366535.036023:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286758732288 00000100:00100000:2.0:1789366535.036029:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286758732288 00000100:00100000:2.0:1789366535.036056:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1789366535.036063:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638b4e82c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8cde4528-5832-4854-a387-4adacc3dd0ab+15:8060:x1876286758732288:12345-0@lo:502: 00000100:00100000:2.0:1789366535.036244:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638b4e82c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8cde4528-5832-4854-a387-4adacc3dd0ab+15:8060:x1876286758732288:12345-0@lo:502: Request processed in 182us (262us total) trans 0 rc 0/0 00000100:00100000:2.0:1789366535.036252:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1789366535.036281:0:8060:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff963785f28380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8cde4528-5832-4854-a387-4adacc3dd0ab:8060:1876286758732288:0@lo:502: 00000020:01000000:0.0:1789366535.036312:0:8060:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789366535.036320:0:8060:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789366535.036322:0:8060:0:(obd_config.c:1563:class_process_config()) marker 23 (0x1) lustre sys.timeout 00000020:00000080:0.0:1789366535.036328:0:8060:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1789366535.036330:0:8060:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:0.0:1789366535.036344:0:8060:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff963785f28380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8cde4528-5832-4854-a387-4adacc3dd0ab:8060:1876286758732416:0@lo:502: 00000100:00100000:0.0:1789366535.036372:0:8060:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789366535.036390:0:8060:0:(client.c:2716:ptlrpc_set_wait()) set ffff96388a342780 going to sleep for 11 seconds 00000100:00100000:3.0:1789366535.036424:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286758732416 00000100:00100000:3.0:1789366535.036427:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286758732416 00000100:00100000:3.0:1789366535.036449:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1789366535.036455:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638b4e80450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8cde4528-5832-4854-a387-4adacc3dd0ab+15:8060:x1876286758732416:12345-0@lo:502: 00000100:00100000:3.0:1789366535.036550:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638b4e80450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8cde4528-5832-4854-a387-4adacc3dd0ab+15:8060:x1876286758732416:12345-0@lo:502: Request processed in 95us (176us total) trans 0 rc 0/0 00000100:00100000:3.0:1789366535.036557:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1789366535.036576:0:8060:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff963785f28380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8cde4528-5832-4854-a387-4adacc3dd0ab:8060:1876286758732416:0@lo:502: 00000020:01000000:0.0:1789366535.036592:0:8060:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789366535.036596:0:8060:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789366535.036598:0:8060:0:(obd_config.c:1563:class_process_config()) marker 23 (0x2) lustre sys.timeout 00000040:00080000:0.0:1789366535.036601:0:8060:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 11 count 11 00000020:01000000:3.0:1789366535.036661:0:5813:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 8-10 (rc=0) 10000000:01000000:3.0:1789366535.036678:0:5813:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.123@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:3.0:1789366535.036684:0:5813:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.123@tcp lock: ffff9638832d2200/0x8da3486b955f2fb2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x8da3486b955f2fb9 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366535.036693:0:5813:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.123@tcp lock: ffff9638832d2200/0x8da3486b955f2fb2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x8da3486b955f2fb9 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789366535.036701:0:5813:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1789366535.036702:0:5813:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff963884956000 from 30 10000000:01000000:3.0:1789366535.036704:0:5813:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1789366535.036737:0:5813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.123@tcp lock: ffff9638832d3a00/0x8da3486b955f2fc0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366535.036745:0:5813:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.123@tcp lock: ffff9638832d3a00/0x8da3486b955f2fc0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366535.036754:0:5813:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.123@tcp lock: ffff9638832d3a00/0x8da3486b955f2fc0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789366535.036775:0:5813:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9638bf5aaa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8cde4528-5832-4854-a387-4adacc3dd0ab:5813:1876286758732544:0@lo:101: 00000100:00100000:3.0:1789366535.036809:0:5813:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789366535.036832:0:5813:0:(client.c:2716:ptlrpc_set_wait()) set ffff9638850bc3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789366535.036846:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286758732544 00000100:00100000:2.0:1789366535.036850:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286758732544 00000100:00100000:2.0:1789366535.036872:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1789366535.036878:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638b4e83050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8cde4528-5832-4854-a387-4adacc3dd0ab+15:5813:x1876286758732544:12345-0@lo:101: 00010000:00010000:2.0:1789366535.036886:0:5808:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789366535.036897:0:5808:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9638a0740400/0x8da3486b955f2fc7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x8da3486b955f2fc0 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366535.036914:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9638a0740400/0x8da3486b955f2fc7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8da3486b955f2fc0 expref: 16 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366535.036921:0:5808:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9638a0740400/0x8da3486b955f2fc7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8da3486b955f2fc0 expref: 16 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366535.036926:0:5808:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9638a0740400, rc 0) 00000100:00100000:2.0:1789366535.036952:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638b4e83050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8cde4528-5832-4854-a387-4adacc3dd0ab+16:5813:x1876286758732544:12345-0@lo:101: Request processed in 75us (144us total) trans 0 rc 0/0 00000100:00100000:2.0:1789366535.036956:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1789366535.036994:0:5813:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9638bf5aaa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8cde4528-5832-4854-a387-4adacc3dd0ab:5813:1876286758732544:0@lo:101: 00010000:00010000:3.0:1789366535.037005:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.123@tcp lock: ffff9638832d3a00/0x8da3486b955f2fc0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x8da3486b955f2fc7 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366535.037013:0:5813:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.123@tcp lock: ffff9638832d3a00/0x8da3486b955f2fc0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x8da3486b955f2fc7 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789366535.037056:0:5813:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9638bf5aaa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8cde4528-5832-4854-a387-4adacc3dd0ab:5813:1876286758732672:0@lo:501: 00000100:00100000:3.0:1789366535.037079:0:5813:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789366535.037100:0:5813:0:(client.c:2716:ptlrpc_set_wait()) set ffff9638850bc3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789366535.037122:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286758732672 00000100:00100000:0.0:1789366535.037127:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286758732672 00000100:00100000:0.0:1789366535.037159:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1789366535.037167:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638b4e81850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8cde4528-5832-4854-a387-4adacc3dd0ab+16:5813:x1876286758732672:12345-0@lo:501: 00000100:00100000:0.0:1789366535.037356:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638b4e81850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8cde4528-5832-4854-a387-4adacc3dd0ab+16:5813:x1876286758732672:12345-0@lo:501: Request processed in 189us (274us total) trans 0 rc 0/0 00000100:00100000:0.0:1789366535.037364:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1789366535.037387:0:5813:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9638bf5aaa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8cde4528-5832-4854-a387-4adacc3dd0ab:5813:1876286758732672:0@lo:501: 00000100:00100000:3.0:1789366535.037415:0:5813:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9638bf5aaa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8cde4528-5832-4854-a387-4adacc3dd0ab:5813:1876286758732800:0@lo:503: 00000100:00100000:3.0:1789366535.037445:0:5813:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789366535.037464:0:5813:0:(client.c:2716:ptlrpc_set_wait()) set ffff9638850bc3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789366535.037489:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286758732800 00000100:00100000:2.0:1789366535.037494:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286758732800 00000100:00100000:2.0:1789366535.037520:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1789366535.037526:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638b4e82450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8cde4528-5832-4854-a387-4adacc3dd0ab+16:5813:x1876286758732800:12345-0@lo:503: 00000100:00100000:2.0:1789366535.037642:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638b4e82450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8cde4528-5832-4854-a387-4adacc3dd0ab+16:5813:x1876286758732800:12345-0@lo:503: Request processed in 115us (196us total) trans 0 rc 0/0 00000100:00100000:2.0:1789366535.037648:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1789366535.037676:0:5813:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9638bf5aaa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8cde4528-5832-4854-a387-4adacc3dd0ab:5813:1876286758732800:0@lo:503: 00000100:00100000:1.0:1789366535.038068:0:8061:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9638987e8380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8cde4528-5832-4854-a387-4adacc3dd0ab:8061:1876286758732928:0@lo:502: 00000100:00100000:1.0:1789366535.038103:0:8061:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789366535.038129:0:8061:0:(client.c:2716:ptlrpc_set_wait()) set ffff9638b6da0180 going to sleep for 11 seconds 00000100:00100000:0.0:1789366535.038134:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286758732928 00000100:00100000:0.0:1789366535.038140:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286758732928 00000100:00100000:0.0:1789366535.038167:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1789366535.038174:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638b4e82050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8cde4528-5832-4854-a387-4adacc3dd0ab+16:8061:x1876286758732928:12345-0@lo:502: 00000100:00100000:0.0:1789366535.038318:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638b4e82050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8cde4528-5832-4854-a387-4adacc3dd0ab+16:8061:x1876286758732928:12345-0@lo:502: Request processed in 144us (213us total) trans 0 rc 0/0 00000100:00100000:0.0:1789366535.038326:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1789366535.038350:0:8061:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9638987e8380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8cde4528-5832-4854-a387-4adacc3dd0ab:8061:1876286758732928:0@lo:502: 00000100:00100000:1.0:1789366535.038392:0:8061:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9638987e8380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8cde4528-5832-4854-a387-4adacc3dd0ab:8061:1876286758733056:0@lo:502: 00000100:00100000:1.0:1789366535.038426:0:8061:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789366535.038447:0:8061:0:(client.c:2716:ptlrpc_set_wait()) set ffff9638b6da0180 going to sleep for 11 seconds 00000100:00100000:2.0:1789366535.038475:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286758733056 00000100:00100000:2.0:1789366535.038480:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286758733056 00000100:00100000:2.0:1789366535.038506:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:2.0:1789366535.038514:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638b4e82850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8cde4528-5832-4854-a387-4adacc3dd0ab+16:8061:x1876286758733056:12345-0@lo:502: 00000100:00100000:2.0:1789366535.038643:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638b4e82850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8cde4528-5832-4854-a387-4adacc3dd0ab+16:8061:x1876286758733056:12345-0@lo:502: Request processed in 130us (216us total) trans 0 rc 0/0 00000100:00100000:2.0:1789366535.038650:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1789366535.038715:0:8061:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9638987e8380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8cde4528-5832-4854-a387-4adacc3dd0ab:8061:1876286758733056:0@lo:502: 00000040:00080000:1.0:1789366535.038749:0:8061:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:3.0:1789366535.038830:0:5813:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:3.0:1789366535.038847:0:5813:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.123@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1789366535.038858:0:5813:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.123@tcp lock: ffff9638832d3a00/0x8da3486b955f2fc0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x8da3486b955f2fc7 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366535.038867:0:5813:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.123@tcp lock: ffff9638832d3a00/0x8da3486b955f2fc0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x8da3486b955f2fc7 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789366535.038880:0:5813:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1789366535.038882:0:5813:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff963884956000 from 5 10000000:01000000:3.0:1789366535.038884:0:5813:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1789366535.038897:0:5813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.123@tcp lock: ffff9638832d3000/0x8da3486b955f2fce lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366535.038902:0:5813:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.123@tcp lock: ffff9638832d3000/0x8da3486b955f2fce lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366535.038908:0:5813:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.123@tcp lock: ffff9638832d3000/0x8da3486b955f2fce lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789366535.038915:0:5813:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9638bf5aaa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8cde4528-5832-4854-a387-4adacc3dd0ab:5813:1876286758733184:0@lo:101: 00000100:00100000:3.0:1789366535.038933:0:5813:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789366535.038952:0:5813:0:(client.c:2716:ptlrpc_set_wait()) set ffff9638850bc3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789366535.038975:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286758733184 00000100:00100000:0.0:1789366535.038980:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286758733184 00000100:00100000:0.0:1789366535.039004:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1789366535.039010:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638b4e3cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8cde4528-5832-4854-a387-4adacc3dd0ab+16:5813:x1876286758733184:12345-0@lo:101: 00010000:00010000:0.0:1789366535.039028:0:5811:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789366535.039039:0:5811:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff963880031e00/0x8da3486b955f2fd5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x8da3486b955f2fce expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366535.039057:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff963880031e00/0x8da3486b955f2fd5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8da3486b955f2fce expref: 17 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366535.039066:0:5811:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff963880031e00/0x8da3486b955f2fd5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8da3486b955f2fce expref: 17 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366535.039073:0:5811:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff963880031e00, rc 0) 00000100:00100000:0.0:1789366535.039110:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638b4e3cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8cde4528-5832-4854-a387-4adacc3dd0ab+17:5813:x1876286758733184:12345-0@lo:101: Request processed in 100us (174us total) trans 0 rc 0/0 00000100:00100000:0.0:1789366535.039116:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:3.0:1789366535.039184:0:5813:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9638bf5aaa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8cde4528-5832-4854-a387-4adacc3dd0ab:5813:1876286758733184:0@lo:101: 00010000:00010000:3.0:1789366535.039194:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.123@tcp lock: ffff9638832d3000/0x8da3486b955f2fce lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8da3486b955f2fd5 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366535.039202:0:5813:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.123@tcp lock: ffff9638832d3000/0x8da3486b955f2fce lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x8da3486b955f2fd5 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789366535.039237:0:5813:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9638bf5aaa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8cde4528-5832-4854-a387-4adacc3dd0ab:5813:1876286758733312:0@lo:256: 00000100:00100000:3.0:1789366535.039263:0:5813:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789366535.039283:0:5813:0:(client.c:2716:ptlrpc_set_wait()) set ffff9638850bc3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789366535.039350:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286758733312 00000100:00100000:2.0:1789366535.039354:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286758733312 00000100:00100000:2.0:1789366535.039378:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1789366535.039393:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638b4e3dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8cde4528-5832-4854-a387-4adacc3dd0ab+17:5813:x1876286758733312:12345-0@lo:256: 20000000:01000000:2.0:1789366535.039405:0:5808:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1789366535.039420:0:5808:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1789366535.039423:0:5808:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 5 00000100:00100000:2.0:1789366535.039589:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638b4e3dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8cde4528-5832-4854-a387-4adacc3dd0ab+17:5813:x1876286758733312:12345-0@lo:256: Request processed in 195us (324us total) trans 0 rc 0/0 00000100:00100000:2.0:1789366535.039596:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:3.0:1789366535.039661:0:5813:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9638bf5aaa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8cde4528-5832-4854-a387-4adacc3dd0ab:5813:1876286758733312:0@lo:256: 10000000:01000000:3.0:1789366535.039698:0:5813:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.123@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1789366535.039707:0:5813:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.123@tcp lock: ffff9638832d3000/0x8da3486b955f2fce lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8da3486b955f2fd5 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366535.039748:0:5813:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.123@tcp lock: ffff9638832d3000/0x8da3486b955f2fce lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8da3486b955f2fd5 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789366535.039757:0:5813:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:3.0:1789366535.039759:0:5813:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 25 10000000:01000000:3.0:1789366535.039761:0:5813:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:3.0:1789366535.039776:0:5813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.123@tcp lock: ffff9638832d3c00/0x8da3486b955f2fdc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366535.039782:0:5813:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.123@tcp lock: ffff9638832d3c00/0x8da3486b955f2fdc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366535.039789:0:5813:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.123@tcp lock: ffff9638832d3c00/0x8da3486b955f2fdc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789366535.039799:0:5813:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9638bf5aaa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8cde4528-5832-4854-a387-4adacc3dd0ab:5813:1876286758733440:0@lo:101: 00000100:00100000:3.0:1789366535.039819:0:5813:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789366535.039829:0:5813:0:(client.c:2716:ptlrpc_set_wait()) set ffff9638850bc3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789366535.039895:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286758733440 00000100:00100000:0.0:1789366535.039899:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286758733440 00000100:00100000:0.0:1789366535.039922:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1789366535.039927:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638b4e3f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8cde4528-5832-4854-a387-4adacc3dd0ab+17:5813:x1876286758733440:12345-0@lo:101: 00010000:00010000:0.0:1789366535.039933:0:5811:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789366535.039941:0:5811:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff963880030e00/0x8da3486b955f2fe3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x8da3486b955f2fdc expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366535.039953:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff963880030e00/0x8da3486b955f2fe3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8da3486b955f2fdc expref: 18 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366535.039961:0:5811:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff963880030e00/0x8da3486b955f2fe3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8da3486b955f2fdc expref: 18 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366535.039968:0:5811:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff963880030e00, rc 0) 00000100:00100000:0.0:1789366535.039998:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638b4e3f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8cde4528-5832-4854-a387-4adacc3dd0ab+18:5813:x1876286758733440:12345-0@lo:101: Request processed in 70us (177us total) trans 0 rc 0/0 00000100:00100000:0.0:1789366535.040003:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1789366535.040056:0:5813:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9638bf5aaa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8cde4528-5832-4854-a387-4adacc3dd0ab:5813:1876286758733440:0@lo:101: 00010000:00010000:3.0:1789366535.040066:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.123@tcp lock: ffff9638832d3c00/0x8da3486b955f2fdc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x8da3486b955f2fe3 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366535.040073:0:5813:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.123@tcp lock: ffff9638832d3c00/0x8da3486b955f2fdc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x8da3486b955f2fe3 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789366535.040104:0:5813:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9638bf5aaa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8cde4528-5832-4854-a387-4adacc3dd0ab:5813:1876286758733568:0@lo:501: 00000100:00100000:3.0:1789366535.040131:0:5813:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789366535.040152:0:5813:0:(client.c:2716:ptlrpc_set_wait()) set ffff9638850bc3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789366535.040171:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286758733568 00000100:00100000:2.0:1789366535.040177:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286758733568 00000100:00100000:2.0:1789366535.040201:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1789366535.040206:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638b4e3fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8cde4528-5832-4854-a387-4adacc3dd0ab+18:5813:x1876286758733568:12345-0@lo:501: 00000100:00100000:2.0:1789366535.040385:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638b4e3fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8cde4528-5832-4854-a387-4adacc3dd0ab+18:5813:x1876286758733568:12345-0@lo:501: Request processed in 176us (251us total) trans 0 rc 0/0 00000100:00100000:2.0:1789366535.040392:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:3.0:1789366535.040414:0:5813:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9638bf5aaa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8cde4528-5832-4854-a387-4adacc3dd0ab:5813:1876286758733568:0@lo:501: 00000100:00100000:3.0:1789366535.040440:0:5813:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9638bf5aaa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8cde4528-5832-4854-a387-4adacc3dd0ab:5813:1876286758733696:0@lo:503: 00000100:00100000:3.0:1789366535.040470:0:5813:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789366535.040490:0:5813:0:(client.c:2716:ptlrpc_set_wait()) set ffff9638850bc3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789366535.040502:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286758733696 00000100:00100000:0.0:1789366535.040507:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286758733696 00000100:00100000:0.0:1789366535.040534:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1789366535.040541:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638b4e3ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8cde4528-5832-4854-a387-4adacc3dd0ab+18:5813:x1876286758733696:12345-0@lo:503: 00000100:00100000:0.0:1789366535.040840:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638b4e3ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8cde4528-5832-4854-a387-4adacc3dd0ab+18:5813:x1876286758733696:12345-0@lo:503: Request processed in 299us (368us total) trans 0 rc 0/0 00000100:00100000:0.0:1789366535.040848:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1789366535.040880:0:5813:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9638bf5aaa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8cde4528-5832-4854-a387-4adacc3dd0ab:5813:1876286758733696:0@lo:503: 00000100:00100000:0.0:1789366535.041169:0:8062:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff963785f28380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8cde4528-5832-4854-a387-4adacc3dd0ab:8062:1876286758733824:0@lo:502: 00000100:00100000:0.0:1789366535.041199:0:8062:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789366535.041219:0:8062:0:(client.c:2716:ptlrpc_set_wait()) set ffff96389883e0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789366535.041238:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286758733824 00000100:00100000:2.0:1789366535.041244:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286758733824 00000100:00100000:2.0:1789366535.041273:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1789366535.041280:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638b4e3c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8cde4528-5832-4854-a387-4adacc3dd0ab+18:8062:x1876286758733824:12345-0@lo:502: 00000100:00100000:2.0:1789366535.041472:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638b4e3c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8cde4528-5832-4854-a387-4adacc3dd0ab+18:8062:x1876286758733824:12345-0@lo:502: Request processed in 193us (273us total) trans 0 rc 0/0 00000100:00100000:2.0:1789366535.041478:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:0.0:1789366535.041499:0:8062:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff963785f28380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8cde4528-5832-4854-a387-4adacc3dd0ab:8062:1876286758733824:0@lo:502: 00000020:01000000:0.0:1789366535.041524:0:8062:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1789366535.041529:0:8062:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-mdt1/mdt1 00000020:00000080:0.0:1789366535.041533:0:8062:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789366535.041534:0:8062:0:(obd_config.c:1563:class_process_config()) marker 18 (0x1) lustre-OST0001 add osc 00000020:00000080:0.0:1789366535.041537:0:8062:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1789366535.041540:0:8062:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.202.123@tcp to nid 0x20000c0a8ca7b (192.168.202.123@tcp) 00000020:01000000:0.0:1789366535.041566:0:8062:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:0.0:1789366535.041568:0:8062:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1789366535.041581:0:8062:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff9638b4f299c0) 00000020:00000080:0.0:1789366535.041593:0:8062:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type osp with refcount 2 00000020:00000080:0.0:1789366535.041596:0:8062:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1789366535.041643:0:8062:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:0.0:1789366535.041652:0:8062:0:(osd_handler.c:1574:osd_obd_connect()) connect #6 00000020:00000080:0.0:1789366535.041657:0:8062:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x8da3486b955f2ff1 00010000:00080000:0.0:1789366535.041676:0:8062:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9638829e4000@lustre-OST0001-osc-MDT0000: add connection 192.168.202.123@tcp at head 00010000:00010000:0.0:1789366535.041864:0:8062:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-5 is initialized 00000040:01000000:0.0:1789366535.042097:0:8062:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:01000000:0.0:1789366535.042105:0:8062:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:0.0:1789366535.042500:0:8062:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1789366535.042626:0:8062:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1789366535.042657:0:8062:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].1, 64 off8256 00000040:00080000:0.0:1789366535.042690:0:8062:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1, 64 off8256 00000040:00080000:1.0:1789366535.042968:0:8063:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1789366535.042973:0:8063:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x6:0x0] at index 1 of catalog [0x1:0x5:0x0] 00000020:00000080:0.0:1789366535.043369:0:8062:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1789366535.043377:0:8062:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:0.0:1789366535.043402:0:8062:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:0.0:1789366535.043417:0:8062:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x8da3486b955f2ff8 00000100:00080000:0.0:1789366535.043424:0:8062:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1789366535.043432:0:8062:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9638829e4000 using connection 192.168.202.123@tcp/0@lo 00000100:00100000:0.0:1789366535.043456:0:8062:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff963785f28380 x1876286758733952/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1789366535.043488:0:8062:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00100000:1.0:1789366535.043513:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff963785f28380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3283:1876286758733952:0@lo:8: 00000020:01000000:0.0:1789366535.043538:0:8062:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789366535.043544:0:8062:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789366535.043547:0:8062:0:(obd_config.c:1563:class_process_config()) marker 18 (0x2) lustre-OST0001 add osc 00000020:01000000:0.0:1789366535.043550:0:8062:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789366535.043555:0:8062:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789366535.043558:0:8062:0:(obd_config.c:1563:class_process_config()) marker 22 (0x1) lustre sys.timeout 00000100:00100000:1.0:1789366535.043564:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00000080:0.0:1789366535.043565:0:8062:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1789366535.043569:0:8062:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:2.0:1789366535.043590:0:3287:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9638bf5aaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3287:1876286758734080:0@lo:400: 00000100:00100000:0.0:1789366535.043595:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286758733952 00000100:00100000:0.0:1789366535.043601:0:6661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286758733952 00000100:00100000:2.0:1789366535.043634:0:3287:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789366535.043640:0:3286:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9638bf5a8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3286:1876286758734464:0@lo:400: 00000100:00100000:0.0:1789366535.043645:0:6661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1789366535.043655:0:6661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638987e8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3283:x1876286758733952:12345-0@lo:8: 00000100:00100000:1.0:1789366535.043674:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286758734080 00010000:00080000:0.0:1789366535.043677:0:6661:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 110 last 0 00000100:00100000:1.0:1789366535.043680:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286758734080 00000100:00100000:3.0:1789366535.043686:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00000080:0.0:1789366535.043709:0:6661:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x8da3486b955f2fff 00000100:00100000:1.0:1789366535.043741:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286758734464 00000100:00100000:1.0:1789366535.043746:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286758734464 00002000:00100000:0.0:1789366535.043747:0:6661:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff9638b737a800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a06 ocd_grant: 0 ocd_index: 1 ocd_group 0 00000100:00100000:2.0:1789366535.043753:0:7132:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00002000:00080000:0.0:1789366535.043755:0:6661:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00000100:00100000:3.0:1789366535.043758:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9638bf5a8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3284:1876286758734208:0@lo:400: 00000001:00000004:0.0:1789366535.043761:0:6661:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00000100:00100000:2.0:1789366535.043767:0:7132:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638b6ea0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3287:x1876286758734080:12345-0@lo:400: 00000100:00100000:1.0:1789366535.043784:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1789366535.043792:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789366535.043797:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638bf5aa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3286:x1876286758734464:12345-0@lo:400: 00000100:00100000:3.0:1789366535.043818:0:3284:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789366535.043824:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9638bf5abb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3284:1876286758734336:0@lo:400: 00000100:00100000:2.0:1789366535.043839:0:7132:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638b6ea0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3287:x1876286758734080:12345-0@lo:400: Request processed in 74us (204us total) trans 0 rc 0/0 00000100:00100000:2.0:1789366535.043848:0:7132:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1789366535.043858:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638bf5aa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3286:x1876286758734464:12345-0@lo:400: Request processed in 63us (174us total) trans 0 rc 0/0 00000100:00100000:3.0:1789366535.043867:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789366535.043869:0:7132:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286758734208 00000100:00100000:1.0:1789366535.043871:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1789366535.043875:0:7132:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286758734208 00002000:00100000:0.0:1789366535.043890:0:6661:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00000100:00100000:1.0:1789366535.043915:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1789366535.043921:0:6660:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:1.0:1789366535.043928:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638bf5a8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3284:x1876286758734208:12345-0@lo:400: 00000100:00100000:3.0:1789366535.043929:0:6660:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00010000:00080000:2.0:1789366535.043953:0:3287:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9638bf5aaa00 x1876286758734080/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789366551 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00010000:00080000:3.0:1789366535.043966:0:3286:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9638bf5a8a80 x1876286758734464/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789366551 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789366535.043967:0:3287:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9638bf5aaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3287:1876286758734080:0@lo:400: 00000100:00100000:1.0:1789366535.043981:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638bf5a8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3284:x1876286758734208:12345-0@lo:400: Request processed in 56us (187us total) trans 0 rc 0/0 00000100:00100000:3.0:1789366535.043985:0:3286:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9638bf5a8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3286:1876286758734464:0@lo:400: 00000100:00100000:1.0:1789366535.044005:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:3.0:1789366535.044018:0:3284:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9638bf5a8000 x1876286758734208/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789366551 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789366535.044027:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9638bf5a8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3284:1876286758734208:0@lo:400: 00000100:00080000:1.0:1789366535.044031:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00002000:00080000:0.0:1789366535.044097:0:6661:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1789366535.044118:0:6661:0:(import.c:65:import_set_state_nolock()) ffff9638b737a000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789366535.044165:0:6661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638987e8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3283:x1876286758733952:12345-0@lo:8: Request processed in 511us (605us total) trans 0 rc 0/0 00000100:00100000:0.0:1789366535.044172:0:6661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1789366535.044189:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286758734336 00000100:00100000:0.0:1789366535.044193:0:6661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286758734336 00010000:00080000:1.0:1789366535.044197:0:3283:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff963785f28380 x1876286758733952/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1789366545 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789366535.044207:0:3283:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1789366535.044214:0:3283:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 1 00000100:00080000:1.0:1789366535.044222:0:3283:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:1.0:1789366535.044228:0:3283:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:1.0:1789366535.044231:0:3283:0:(import.c:65:import_set_state_nolock()) ffff9638829e4000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1789366535.044236:0:6661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789366535.044243:0:6660:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:0.0:1789366535.044248:0:6661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638bf5a9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3284:x1876286758734336:12345-0@lo:400: 00000004:00080000:1.0:1789366535.044257:0:3283:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:1.0:1789366535.044266:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff963785f28380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3283:1876286758733952:0@lo:8: 00000100:00100000:0.0:1789366535.044326:0:6661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638bf5a9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3284:x1876286758734336:12345-0@lo:400: Request processed in 80us (460us total) trans 0 rc 0/0 00000100:00100000:0.0:1789366535.044335:0:6661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1789366535.044339:0:3284:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9638bf5abb80 x1876286758734336/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789366551 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1789366535.044362:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789366535.044364:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9638bf5abb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3284:1876286758734336:0@lo:400: 00000004:00080000:1.0:1789366535.044374:0:8063:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000100:00100000:0.0:1789366535.044386:0:8062:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff963785f2b800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8cde4528-5832-4854-a387-4adacc3dd0ab:8062:1876286758734592:0@lo:502: 00000100:00100000:0.0:1789366535.044431:0:8062:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789366535.044463:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286758734592 00000100:00100000:0.0:1789366535.044468:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286758734592 00000100:00100000:0.0:1789366535.044508:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1789366535.044519:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638b4e3f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8cde4528-5832-4854-a387-4adacc3dd0ab+18:8062:x1876286758734592:12345-0@lo:502: 00000004:00080000:1.0:1789366535.044549:0:8063:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 110508830060ns, next at 0ns, rc = 0 00000100:00100000:0.0:1789366535.044783:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638b4e3f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8cde4528-5832-4854-a387-4adacc3dd0ab+18:8062:x1876286758734592:12345-0@lo:502: Request processed in 266us (351us total) trans 0 rc 0/0 00000100:00100000:0.0:1789366535.044791:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1789366535.044836:0:8062:0:(client.c:2716:ptlrpc_set_wait()) set ffff963884ad30c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789366535.044849:0:8062:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff963785f2b800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8cde4528-5832-4854-a387-4adacc3dd0ab:8062:1876286758734592:0@lo:502: 00000020:01000000:0.0:1789366535.044867:0:8062:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789366535.044871:0:8062:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789366535.044873:0:8062:0:(obd_config.c:1563:class_process_config()) marker 22 (0x2) lustre sys.timeout 00000040:00080000:0.0:1789366535.044876:0:8062:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00000020:01000000:3.0:1789366535.044943:0:5813:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 25-33 (rc=0) 10000000:01000000:3.0:1789366535.044967:0:5813:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.123@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:3.0:1789366535.044977:0:5813:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.123@tcp lock: ffff9638832d3c00/0x8da3486b955f2fdc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x8da3486b955f2fe3 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366535.044988:0:5813:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.123@tcp lock: ffff9638832d3c00/0x8da3486b955f2fdc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x8da3486b955f2fe3 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789366535.044999:0:5813:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:3.0:1789366535.045002:0:5813:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff963882f5cd40 from 1 10000000:01000000:3.0:1789366535.045005:0:5813:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1789366535.045030:0:5813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.123@tcp lock: ffff9638832d2a00/0x8da3486b955f3006 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366535.045039:0:5813:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.123@tcp lock: ffff9638832d2a00/0x8da3486b955f3006 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366535.045048:0:5813:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.123@tcp lock: ffff9638832d2a00/0x8da3486b955f3006 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789366535.045059:0:5813:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9638bf5abb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8cde4528-5832-4854-a387-4adacc3dd0ab:5813:1876286758734720:0@lo:101: 00000100:00100000:3.0:1789366535.045097:0:5813:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789366535.045121:0:5813:0:(client.c:2716:ptlrpc_set_wait()) set ffff9638850bc900 going to sleep for 11 seconds 00000100:00100000:3.0:1789366535.045141:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286758734720 00000100:00100000:3.0:1789366535.045145:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286758734720 00000100:00100000:3.0:1789366535.045179:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:3.0:1789366535.045187:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638b4e3d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8cde4528-5832-4854-a387-4adacc3dd0ab+18:5813:x1876286758734720:12345-0@lo:101: 00010000:00010000:3.0:1789366535.045206:0:5808:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789366535.045220:0:5808:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9638832d3600/0x8da3486b955f300d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x8da3486b955f3006 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366535.045242:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9638832d3600/0x8da3486b955f300d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8da3486b955f3006 expref: 19 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366535.045255:0:5808:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9638832d3600/0x8da3486b955f300d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8da3486b955f3006 expref: 19 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366535.045263:0:5808:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9638832d3600, rc 0) 00000100:00100000:3.0:1789366535.045317:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638b4e3d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8cde4528-5832-4854-a387-4adacc3dd0ab+19:5813:x1876286758734720:12345-0@lo:101: Request processed in 131us (218us total) trans 0 rc 0/0 00000100:00100000:3.0:1789366535.045325:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:3.0:1789366535.045472:0:5813:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9638bf5abb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8cde4528-5832-4854-a387-4adacc3dd0ab:5813:1876286758734720:0@lo:101: 00010000:00010000:3.0:1789366535.045488:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.123@tcp lock: ffff9638832d2a00/0x8da3486b955f3006 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x8da3486b955f300d expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366535.045499:0:5813:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.123@tcp lock: ffff9638832d2a00/0x8da3486b955f3006 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x8da3486b955f300d expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789366535.045542:0:5813:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9638bf5abb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8cde4528-5832-4854-a387-4adacc3dd0ab:5813:1876286758734848:0@lo:501: 00000100:00100000:3.0:1789366535.045567:0:5813:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789366535.045586:0:5813:0:(client.c:2716:ptlrpc_set_wait()) set ffff9638850bc900 going to sleep for 11 seconds 00000100:00100000:2.0:1789366535.045593:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286758734848 00000100:00100000:2.0:1789366535.045598:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286758734848 00000100:00100000:2.0:1789366535.045625:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1789366535.045634:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638b4e3e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8cde4528-5832-4854-a387-4adacc3dd0ab+19:5813:x1876286758734848:12345-0@lo:501: 00000100:00100000:2.0:1789366535.045869:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638b4e3e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8cde4528-5832-4854-a387-4adacc3dd0ab+19:5813:x1876286758734848:12345-0@lo:501: Request processed in 236us (299us total) trans 0 rc -2/-2 00000100:00100000:2.0:1789366535.045877:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1789366535.045891:0:5813:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9638bf5abb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8cde4528-5832-4854-a387-4adacc3dd0ab:5813:1876286758734848:0@lo:501: 10000000:01000000:3.0:1789366535.045919:0:5813:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.123@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:3.0:1789366535.045925:0:5813:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.123@tcp lock: ffff9638832d2a00/0x8da3486b955f3006 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x8da3486b955f300d expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366535.045939:0:5813:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.123@tcp lock: ffff9638832d2a00/0x8da3486b955f3006 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x8da3486b955f300d expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1789366535.053351:0:8064:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x100010000:0x1:0x0] 00000100:00100000:3.0:1789366535.053359:0:3287:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff963785f2b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3287:1876286758734976:0@lo:13: 00000100:00100000:0.0:1789366535.053414:0:8064:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff963785f2aa00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8064:1876286758735104:0@lo:7: 00000100:00100000:3.0:1789366535.053421:0:3287:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789366535.053458:0:8064:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789366535.053467:0:7134:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286758734976 00000100:00100000:1.0:1789366535.053475:0:7134:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286758734976 00000100:00100000:0.0:1789366535.053484:0:8064:0:(client.c:2716:ptlrpc_set_wait()) set ffff963887166f00 going to sleep for 11 seconds 00000100:00100000:2.0:1789366535.053492:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286758735104 00000100:00100000:2.0:1789366535.053497:0:6660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286758735104 00000100:00080000:0.0:1789366535.053512:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789366535.053566:0:8065:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1789366535.053569:0:6663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789366535.053579:0:8065:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963785f2b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:8064:x1876286758735104:12345-0@lo:7: 00000100:00100000:1.0:1789366535.053584:0:6663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638bf5abb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3287:x1876286758734976:12345-0@lo:13: 00002000:00000024:1.0:1789366535.053619:0:6663:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3860856832 avail 3858759680 00000100:00100000:1.0:1789366535.053689:0:6663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638bf5abb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3287:x1876286758734976:12345-0@lo:13: Request processed in 110us (268us total) trans 0 rc 0/0 00000100:00100000:1.0:1789366535.053696:0:6663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:0.0:1789366535.053771:0:3287:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff963785f2b800 x1876286758734976/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789366551 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789366535.053791:0:3287:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff963785f2b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3287:1876286758734976:0@lo:13: 00002000:00080000:2.0:1789366535.061193:0:8065:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x0 00002000:00080000:2.0:1789366535.061201:0:8065:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x100010000:0x0:0x0] 00000100:00100000:2.0:1789366535.061290:0:8065:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963785f2b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:8064:x1876286758735104:12345-0@lo:7: Request processed in 7709us (7828us total) trans 0 rc 0/0 00010000:00080000:1.0:1789366535.061326:0:8064:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff963785f2aa00 x1876286758735104/t0(0) o7->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1789366551 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789366535.061341:0:8064:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff963785f2aa00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8064:1876286758735104:0@lo:7: 00000004:00080000:1.0:1789366535.061356:0:8064:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0000: Got last_fid [0x100010000:0x0:0x0] 00000100:00100000:1.0:1789366535.061392:0:8064:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9638987eb800 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8064:1876286758735232:0@lo:5: 00000100:00100000:1.0:1789366535.061433:0:8064:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789366535.061475:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286758735232 00000100:00100000:1.0:1789366535.061477:0:8064:0:(client.c:2716:ptlrpc_set_wait()) set ffff9638b6da0cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1789366535.061483:0:6661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286758735232 00000100:00100000:0.0:1789366535.061531:0:6661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1789366535.061543:0:6661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638987eaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:8064:x1876286758735232:12345-0@lo:5: 00002000:00080000:0.0:1789366535.061567:0:6661:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:0.0:1789366535.061570:0:6661:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 1 objects in group 0x0 at 1 00010000:00080000:1.0:1789366535.061847:0:8064:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9638987eb800 x1876286758735232/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1789366551 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789366535.061855:0:6661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638987eaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+8:8064:x1876286758735232:12345-0@lo:5: Request processed in 313us (419us total) trans 4294967297 rc 0/0 00000100:00100000:1.0:1789366535.061867:0:8064:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9638987eb800 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8064:1876286758735232:0@lo:5: 00000100:00100000:0.0:1789366535.061867:0:6661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000004:00080000:1.0:1789366535.061881:0:8064:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x100010000:0x1:0x0] from OST, last_created [0x100010000:0x1:0x0]last_used is [0x100010000:0x1:0x0] 00000100:00100000:2.0:1789366535.061886:0:8065:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1789366535.061907:0:8064:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9638987eb480 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8064:1876286758735360:0@lo:700: 00000100:00100000:1.0:1789366535.061932:0:8064:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789366535.061950:0:8064:0:(client.c:2716:ptlrpc_set_wait()) set ffff9638b6da0cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1789366535.061961:0:6667:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286758735360 00000100:00100000:0.0:1789366535.061965:0:6667:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286758735360 00000100:00100000:0.0:1789366535.061994:0:6667:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789366535.062002:0:6667:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638987e8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+7:8064:x1876286758735360:12345-0@lo:700: 00000100:00100000:0.0:1789366535.062023:0:6667:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff963785f2b800 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:6667:1876286758735488:0@lo:700: 00000100:00100000:0.0:1789366535.062044:0:6667:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789366535.062062:0:6667:0:(client.c:2716:ptlrpc_set_wait()) set ffff9638871660c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789366535.062094:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286758735488 00000100:00100000:2.0:1789366535.062099:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286758735488 00000100:00100000:2.0:1789366535.062132:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789366535.062139:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963785f28000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:6667:x1876286758735488:12345-0@lo:700: 00000004:00080000:1.0:1789366535.062279:0:5837:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 40000000:02000000:2.0:1789366535.069028:0:5822:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:1:ost 00000100:00100000:2.0:1789366535.071682:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963785f28000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:6667:x1876286758735488:12345-0@lo:700: Request processed in 9539us (9631us total) trans 0 rc 0/0 00000100:00100000:2.0:1789366535.071695:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1789366535.071749:0:6667:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff963785f2b800 x1876286758735488/t0(0) o700->lustre-MDT0000-lwp-OST0001@0@lo:32/10 lens 264/248 e 0 to 0 dl 1789366551 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789366535.071766:0:6667:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff963785f2b800 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:6667:1876286758735488:0@lo:700: 40000000:02000000:0.0:1789366535.071780:0:6667:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0001-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:1:ost] 00000001:00080000:0.0:1789366535.088311:0:7617:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967297 is committed 00000001:00100000:0.0:1789366535.088325:0:7617:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:3.0:1789366535.088387:0:6667:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638987e8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:8064:x1876286758735360:12345-0@lo:700: Request processed in 26379us (26448us total) trans 0 rc 0/0 00000100:00100000:3.0:1789366535.088401:0:6667:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1789366535.088407:0:8064:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9638987eb480 x1876286758735360/t0(0) o700->lustre-OST0001-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1789366551 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789366535.088416:0:8064:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:1.0:1789366535.088431:0:8064:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9638987eb480 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8064:1876286758735360:0@lo:700: 00000004:02000040:1.0:1789366535.095195:0:8064:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x280000400 00000100:00100000:1.0:1789366535.097137:0:8064:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9638987eb480 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8064:1876286758735616:0@lo:5: 00000100:00100000:1.0:1789366535.097192:0:8064:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789366535.097241:0:8064:0:(client.c:2716:ptlrpc_set_wait()) set ffff9638b6da0600 going to sleep for 11 seconds 00000100:00100000:2.0:1789366535.097256:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286758735616 00000100:00100000:2.0:1789366535.097265:0:6660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286758735616 00000100:00100000:2.0:1789366535.097322:0:6660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1789366535.097329:0:6660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638987eb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:8064:x1876286758735616:12345-0@lo:5: 00002000:00080000:2.0:1789366535.100781:0:6660:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x280000400 00002000:00080000:2.0:1789366535.100799:0:6660:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x280000400 at 2 00000100:00100000:2.0:1789366535.102345:0:6660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638987eb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:8064:x1876286758735616:12345-0@lo:5: Request processed in 5014us (5149us total) trans 4294967298 rc 0/0 00000100:00100000:2.0:1789366535.102354:0:6660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:1.0:1789366535.102399:0:8064:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9638987eb480 x1876286758735616/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1789366551 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789366535.102416:0:8064:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9638987eb480 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8064:1876286758735616:0@lo:5: 00000004:00080000:1.0:1789366535.102430:0:8064:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x280000400:0x1:0x0]-[0x280000400:0x21:0x0] 00000001:00080000:1.0:1789366535.886082:0:7617:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967298 is committed 00000100:00100000:2.0:1789366536.050331:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:3.0:1789366536.050405:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751375488 00000100:00100000:3.0:1789366536.050415:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751375488 00000100:00100000:3.0:1789366536.050455:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 104 00000100:00100000:3.0:1789366536.050465:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638b4e3e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:2353:x1876286751375488:12345-192.168.202.23@tcp:250: 00010000:00080000:3.0:1789366536.050492:0:5808:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from 14a2847b-91d8-4d87-b71b-010443acc91a@192.168.202.23@tcp t0 exp 0000000000000000 cur 111 last 0 00000020:00000080:3.0:1789366536.050518:0:5808:0:(genops.c:1385:class_connect()) connect: client 14a2847b-91d8-4d87-b71b-010443acc91a, cookie 0x8da3486b955f3014 00000100:00080000:3.0:1789366536.050661:0:5808:0:(import.c:65:import_set_state_nolock()) ffff96378672b800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789366536.050739:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638b4e3e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:14a2847b-91d8-4d87-b71b-010443acc91a+5:2353:x1876286751375488:12345-192.168.202.23@tcp:250: Request processed in 273us (415us total) trans 0 rc 0/0 00000100:00100000:3.0:1789366536.050749:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 104 00000100:00100000:3.0:1789366536.051880:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:0.0:1789366536.051931:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751375616 00000100:00100000:0.0:1789366536.051938:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751375616 00000100:00100000:0.0:1789366536.051984:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 105 00000100:00100000:0.0:1789366536.051996:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638b4e3e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:14a2847b-91d8-4d87-b71b-010443acc91a+5:5569:x1876286751375616:12345-192.168.202.23@tcp:101: 00010000:00010000:0.0:1789366536.052019:0:5811:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789366536.052035:0:5811:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff963880030000/0x8da3486b955f301b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0xda917a494d06be69 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366536.052060:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff963880030000/0x8da3486b955f301b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.202.23@tcp remote: 0xda917a494d06be69 expref: 6 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366536.052071:0:5811:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff963880030000/0x8da3486b955f301b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.202.23@tcp remote: 0xda917a494d06be69 expref: 6 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366536.052081:0:5811:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff963880030000, rc 0) 00000100:00100000:0.0:1789366536.052121:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638b4e3e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:14a2847b-91d8-4d87-b71b-010443acc91a+6:5569:x1876286751375616:12345-192.168.202.23@tcp:101: Request processed in 129us (240us total) trans 0 rc 0/0 00000100:00100000:0.0:1789366536.052128:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 105 00000100:00100000:0.0:1789366536.053686:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:2.0:1789366536.053785:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751375744 00000100:00100000:2.0:1789366536.053792:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751375744 00000100:00100000:2.0:1789366536.053830:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 106 00000100:00100000:2.0:1789366536.053842:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638b4e3f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:14a2847b-91d8-4d87-b71b-010443acc91a+6:5569:x1876286751375744:12345-192.168.202.23@tcp:501: 00000100:00100000:2.0:1789366536.054171:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638b4e3f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:14a2847b-91d8-4d87-b71b-010443acc91a+6:5569:x1876286751375744:12345-192.168.202.23@tcp:501: Request processed in 332us (489us total) trans 0 rc -2/-2 00000100:00100000:2.0:1789366536.054180:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 106 00010000:00010000:1.0:1789366536.057479:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789366536.057628:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:0.0:1789366536.057682:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751375872 00000100:00100000:0.0:1789366536.057692:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751375872 00000100:00100000:0.0:1789366536.057743:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 107 00000100:00100000:0.0:1789366536.057752:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638b4e3d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:14a2847b-91d8-4d87-b71b-010443acc91a+6:5569:x1876286751375872:12345-192.168.202.23@tcp:101: 00010000:00010000:0.0:1789366536.057765:0:5811:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789366536.057779:0:5811:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff963880030600/0x8da3486b955f3022 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0xda917a494d06be70 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366536.057800:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff963880030600/0x8da3486b955f3022 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.202.23@tcp remote: 0xda917a494d06be70 expref: 7 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366536.057810:0:5811:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff963880030600/0x8da3486b955f3022 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.202.23@tcp remote: 0xda917a494d06be70 expref: 7 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366536.057829:0:5811:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff963880030600, rc 0) 00000100:00100000:0.0:1789366536.057879:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638b4e3d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:14a2847b-91d8-4d87-b71b-010443acc91a+7:5569:x1876286751375872:12345-192.168.202.23@tcp:101: Request processed in 127us (254us total) trans 0 rc 0/0 00000100:00100000:0.0:1789366536.057887:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 107 00000100:00100000:3.0:1789366536.058762:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:0.0:1789366536.058799:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751376000 00000100:00100000:0.0:1789366536.058803:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751376000 00000100:00100000:0.0:1789366536.058840:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 108 00000100:00100000:0.0:1789366536.058849:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638b4e3c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:14a2847b-91d8-4d87-b71b-010443acc91a+7:5569:x1876286751376000:12345-192.168.202.23@tcp:501: 00000100:00100000:0.0:1789366536.059333:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638b4e3c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:14a2847b-91d8-4d87-b71b-010443acc91a+8:5569:x1876286751376000:12345-192.168.202.23@tcp:501: Request processed in 483us (572us total) trans 0 rc 0/0 00000100:00100000:0.0:1789366536.059340:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 108 00000100:00100000:0.0:1789366536.060193:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:2.0:1789366536.060233:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751376128 00000100:00100000:2.0:1789366536.060238:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751376128 00000100:00100000:2.0:1789366536.060279:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 109 00000100:00100000:2.0:1789366536.060303:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638b4e3c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:14a2847b-91d8-4d87-b71b-010443acc91a+8:5569:x1876286751376128:12345-192.168.202.23@tcp:503: 00000100:00100000:2.0:1789366536.060753:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638b4e3c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:14a2847b-91d8-4d87-b71b-010443acc91a+8:5569:x1876286751376128:12345-192.168.202.23@tcp:503: Request processed in 464us (560us total) trans 0 rc 0/0 00000100:00100000:2.0:1789366536.060762:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 109 00000100:00100000:0.0:1789366536.062216:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:3.0:1789366536.062252:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751376256 00000100:00100000:3.0:1789366536.062258:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751376256 00000100:00100000:3.0:1789366536.062303:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 110 00000100:00100000:3.0:1789366536.062311:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638b4e3d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:14a2847b-91d8-4d87-b71b-010443acc91a+8:5587:x1876286751376256:12345-192.168.202.23@tcp:502: 00000100:00100000:3.0:1789366536.062560:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638b4e3d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:14a2847b-91d8-4d87-b71b-010443acc91a+8:5587:x1876286751376256:12345-192.168.202.23@tcp:502: Request processed in 250us (348us total) trans 0 rc 0/0 00000100:00100000:3.0:1789366536.062574:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 110 00000100:00100000:3.0:1789366536.073417:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:2.0:1789366536.073551:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751376384 00000100:00100000:2.0:1789366536.073561:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751376384 00000100:00100000:2.0:1789366536.073607:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 111 00000100:00100000:2.0:1789366536.073616:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638b4e39450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:14a2847b-91d8-4d87-b71b-010443acc91a+8:5587:x1876286751376384:12345-192.168.202.23@tcp:502: 00000100:00100000:2.0:1789366536.073864:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638b4e39450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:14a2847b-91d8-4d87-b71b-010443acc91a+8:5587:x1876286751376384:12345-192.168.202.23@tcp:502: Request processed in 248us (456us total) trans 0 rc 0/0 00000100:00100000:2.0:1789366536.073873:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 111 00000100:00100000:0.0:1789366536.075397:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:3.0:1789366536.075437:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751376512 00000100:00100000:3.0:1789366536.075445:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751376512 00000100:00100000:3.0:1789366536.075478:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 112 00000100:00100000:3.0:1789366536.075489:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638b4e38c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:14a2847b-91d8-4d87-b71b-010443acc91a+8:5569:x1876286751376512:12345-192.168.202.23@tcp:101: 00010000:00010000:3.0:1789366536.075502:0:5810:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789366536.075518:0:5810:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9638832d2400/0x8da3486b955f3029 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xda917a494d06be9a expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366536.075543:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9638832d2400/0x8da3486b955f3029 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.202.23@tcp remote: 0xda917a494d06be9a expref: 9 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366536.075556:0:5810:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9638832d2400/0x8da3486b955f3029 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.202.23@tcp remote: 0xda917a494d06be9a expref: 9 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366536.075567:0:5810:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9638832d2400, rc 0) 00000100:00100000:3.0:1789366536.075616:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638b4e38c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:14a2847b-91d8-4d87-b71b-010443acc91a+9:5569:x1876286751376512:12345-192.168.202.23@tcp:101: Request processed in 129us (231us total) trans 0 rc 0/0 00000100:00100000:3.0:1789366536.075624:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 112 00000100:00100000:1.0:1789366536.077599:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:0.0:1789366536.077741:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751376640 00000100:00100000:0.0:1789366536.077749:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751376640 00000100:00100000:0.0:1789366536.077794:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 113 00000100:00100000:0.0:1789366536.077805:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638b4e39c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:14a2847b-91d8-4d87-b71b-010443acc91a+9:5569:x1876286751376640:12345-192.168.202.23@tcp:256: 20000000:01000000:0.0:1789366536.077826:0:5808:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:0.0:1789366536.077842:0:5808:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:0.0:1789366536.077847:0:5808:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:0.0:1789366536.077850:0:5808:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:0.0:1789366536.077853:0:5808:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 5 00000100:00100000:0.0:1789366536.078799:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638b4e39c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:14a2847b-91d8-4d87-b71b-010443acc91a+9:5569:x1876286751376640:12345-192.168.202.23@tcp:256: Request processed in 993us (1198us total) trans 0 rc 0/0 00000100:00100000:0.0:1789366536.078809:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 113 00000100:00100000:0.0:1789366536.080537:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:1.0:1789366536.080573:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751376768 00000100:00100000:1.0:1789366536.080580:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751376768 00000100:00100000:1.0:1789366536.080624:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 114 00000100:00100000:1.0:1789366536.080635:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638b4e3b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:14a2847b-91d8-4d87-b71b-010443acc91a+9:5569:x1876286751376768:12345-192.168.202.23@tcp:101: 00010000:00010000:1.0:1789366536.080649:0:5810:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789366536.080667:0:5810:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff96388148f400/0x8da3486b955f3030 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xda917a494d06bea1 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366536.080693:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff96388148f400/0x8da3486b955f3030 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.202.23@tcp remote: 0xda917a494d06bea1 expref: 10 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366536.080706:0:5810:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff96388148f400/0x8da3486b955f3030 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.202.23@tcp remote: 0xda917a494d06bea1 expref: 10 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366536.080715:0:5810:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96388148f400, rc 0) 00000100:00100000:1.0:1789366536.080780:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638b4e3b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:14a2847b-91d8-4d87-b71b-010443acc91a+10:5569:x1876286751376768:12345-192.168.202.23@tcp:101: Request processed in 148us (246us total) trans 0 rc 0/0 00000100:00100000:1.0:1789366536.080787:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 114 00000100:00100000:0.0:1789366536.081473:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:2.0:1789366536.081513:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751376896 00000100:00100000:2.0:1789366536.081519:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751376896 00000100:00100000:2.0:1789366536.081554:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 115 00000100:00100000:2.0:1789366536.081563:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638b4e3bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:14a2847b-91d8-4d87-b71b-010443acc91a+10:5569:x1876286751376896:12345-192.168.202.23@tcp:501: 00000100:00100000:2.0:1789366536.081789:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638b4e3bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:14a2847b-91d8-4d87-b71b-010443acc91a+10:5569:x1876286751376896:12345-192.168.202.23@tcp:501: Request processed in 227us (315us total) trans 0 rc 0/0 00000100:00100000:2.0:1789366536.081798:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 115 00000100:00100000:0.0:1789366536.082471:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:1.0:1789366536.082513:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751377024 00000100:00100000:1.0:1789366536.082519:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751377024 00000100:00100000:1.0:1789366536.082558:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 116 00000100:00100000:1.0:1789366536.082567:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638b4e3ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:14a2847b-91d8-4d87-b71b-010443acc91a+10:5569:x1876286751377024:12345-192.168.202.23@tcp:503: 00000100:00100000:1.0:1789366536.082893:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638b4e3ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:14a2847b-91d8-4d87-b71b-010443acc91a+10:5569:x1876286751377024:12345-192.168.202.23@tcp:503: Request processed in 326us (423us total) trans 0 rc 0/0 00000100:00100000:1.0:1789366536.082900:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 116 00000100:00100000:0.0:1789366536.084892:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:2.0:1789366536.084946:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751377152 00000100:00100000:2.0:1789366536.084952:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751377152 00000100:00100000:2.0:1789366536.084991:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 117 00000100:00100000:2.0:1789366536.085002:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638b4e38450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:14a2847b-91d8-4d87-b71b-010443acc91a+10:5590:x1876286751377152:12345-192.168.202.23@tcp:502: 00000100:00100000:2.0:1789366536.085205:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638b4e38450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:14a2847b-91d8-4d87-b71b-010443acc91a+10:5590:x1876286751377152:12345-192.168.202.23@tcp:502: Request processed in 206us (315us total) trans 0 rc 0/0 00000100:00100000:2.0:1789366536.085213:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 117 00000100:00100000:0.0:1789366536.086514:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:1.0:1789366536.086568:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751377280 00000100:00100000:1.0:1789366536.086573:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751377280 00000100:00100000:1.0:1789366536.086604:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 118 00000100:00100000:1.0:1789366536.086610:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638b4e3b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:14a2847b-91d8-4d87-b71b-010443acc91a+10:5590:x1876286751377280:12345-192.168.202.23@tcp:502: 00000100:00100000:1.0:1789366536.086763:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638b4e3b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:14a2847b-91d8-4d87-b71b-010443acc91a+10:5590:x1876286751377280:12345-192.168.202.23@tcp:502: Request processed in 151us (248us total) trans 0 rc 0/0 00000100:00100000:1.0:1789366536.086775:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 118 00000100:00100000:2.0:1789366536.094453:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:1.0:1789366536.094511:0:7132:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751377408 00000100:00100000:1.0:1789366536.094520:0:7132:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751377408 00000100:00100000:1.0:1789366536.094573:0:7132:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 4 00000100:00100000:1.0:1789366536.094587:0:7132:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638b6ea0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2353:x1876286751377408:12345-192.168.202.23@tcp:38: 00010000:00080000:1.0:1789366536.094615:0:7132:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from 0ab23baa-a205-44ad-bf17-f7b47295d82b@192.168.202.23@tcp t0 exp 0000000000000000 cur 111 last 0 00000020:00000080:1.0:1789366536.094657:0:7132:0:(genops.c:1385:class_connect()) connect: client 0ab23baa-a205-44ad-bf17-f7b47295d82b, cookie 0x8da3486b955f3037 00000004:00100000:1.0:1789366536.094685:0:7132:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000001:00000004:1.0:1789366536.094690:0:7132:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000100:00080000:0.0:1789366536.102406:0:7132:0:(import.c:65:import_set_state_nolock()) ffff9638b7379800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789366536.102477:0:7132:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638b6ea0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0ab23baa-a205-44ad-bf17-f7b47295d82b+6:2353:x1876286751377408:12345-192.168.202.23@tcp:38: Request processed in 7894us (8032us total) trans 0 rc 0/0 00000100:00100000:0.0:1789366536.102488:0:7132:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 4 00010000:00010000:2.0:1789366537.080742:0:6675:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789366537.106029:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:1.0:1789366537.106130:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751377536 00000100:00100000:1.0:1789366537.106140:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751377536 00000100:00100000:1.0:1789366537.106228:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 5 00000100:00100000:1.0:1789366537.106239:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963785f2b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0ab23baa-a205-44ad-bf17-f7b47295d82b+6:0:x1876286751377536:12345-192.168.202.23@tcp:41: 00000100:00080000:0.0:1789366537.106315:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00000024:1.0:1789366537.106351:0:5816:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261778432 avail 2259681280 00000100:00100000:1.0:1789366537.106692:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963785f2b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0ab23baa-a205-44ad-bf17-f7b47295d82b+6:0:x1876286751377536:12345-192.168.202.23@tcp:41: Request processed in 454us (670us total) trans 0 rc 0/0 00000100:00100000:1.0:1789366537.106701:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 5 00000100:00100000:2.0:1789366537.107254:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:3.0:1789366537.108421:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751377664 00000100:00100000:3.0:1789366537.108431:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751377664 00000100:00100000:3.0:1789366537.108544:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 6 00000100:00100000:3.0:1789366537.108554:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638b6ea1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0ab23baa-a205-44ad-bf17-f7b47295d82b+6:5569:x1876286751377664:12345-192.168.202.23@tcp:41: 00000004:00000024:3.0:1789366537.108577:0:5815:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261778432 avail 2259681280 00000100:00100000:3.0:1789366537.108650:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638b6ea1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0ab23baa-a205-44ad-bf17-f7b47295d82b+6:5569:x1876286751377664:12345-192.168.202.23@tcp:41: Request processed in 98us (1398us total) trans 0 rc 0/0 00000100:00100000:3.0:1789366537.108682:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 6 00000100:00100000:1.0:1789366537.110382:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:0.0:1789366537.110477:0:7132:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751377792 00000100:00100000:0.0:1789366537.110485:0:7132:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751377792 00000100:00100000:0.0:1789366537.110646:0:7132:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 7 00000100:00100000:0.0:1789366537.110668:0:7132:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638987e9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0ab23baa-a205-44ad-bf17-f7b47295d82b+6:5569:x1876286751377792:12345-192.168.202.23@tcp:40: 00000100:00100000:0.0:1789366537.110928:0:7132:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638987e9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0ab23baa-a205-44ad-bf17-f7b47295d82b+6:5569:x1876286751377792:12345-192.168.202.23@tcp:40: Request processed in 272us (551us total) trans 0 rc 0/0 00000100:00100000:0.0:1789366537.110936:0:7132:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 7 00000100:00100000:1.0:1789366537.113181:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:0.0:1789366537.113294:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751377920 00000100:00100000:0.0:1789366537.113302:0:6661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751377920 00000100:00100000:0.0:1789366537.113391:0:6661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 8 00000100:00100000:0.0:1789366537.113401:0:6661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638987ebb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2353:x1876286751377920:12345-192.168.202.23@tcp:8: 00010000:00080000:0.0:1789366537.113430:0:6661:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 0ab23baa-a205-44ad-bf17-f7b47295d82b@192.168.202.23@tcp t0 exp 0000000000000000 cur 112 last 0 00000020:00000080:0.0:1789366537.113456:0:6661:0:(genops.c:1385:class_connect()) connect: client 0ab23baa-a205-44ad-bf17-f7b47295d82b, cookie 0x8da3486b955f303e 00002000:00100000:0.0:1789366537.113467:0:6661:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 0ab23baa-a205-44ad-bf17-f7b47295d82b/ffff9638b737b000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a06 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1789366537.113490:0:6661:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:0.0:1789366537.113885:0:6661:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1789366537.113913:0:6661:0:(import.c:65:import_set_state_nolock()) ffff9638b737d800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789366537.113981:0:6661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638987ebb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0ab23baa-a205-44ad-bf17-f7b47295d82b+6:2353:x1876286751377920:12345-192.168.202.23@tcp:8: Request processed in 579us (806us total) trans 0 rc 0/0 00000100:00100000:0.0:1789366537.113990:0:6661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 8 00000100:00100000:3.0:1789366537.114200:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:1.0:1789366537.114702:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751378176 00000100:00100000:1.0:1789366537.114708:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751378176 00000100:00100000:1.0:1789366537.114779:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 119 00000100:00100000:1.0:1789366537.114796:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638b4e39850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:14a2847b-91d8-4d87-b71b-010443acc91a+10:2355:x1876286751378176:12345-192.168.202.23@tcp:400: 00000100:00100000:1.0:1789366537.114832:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638b4e39850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:14a2847b-91d8-4d87-b71b-010443acc91a+10:2355:x1876286751378176:12345-192.168.202.23@tcp:400: Request processed in 38us (633us total) trans 0 rc 0/0 00000100:00100000:1.0:1789366537.114839:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 119 00000100:00100000:1.0:1789366537.116227:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:0.0:1789366537.116326:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751378048 00000100:00100000:0.0:1789366537.116332:0:6659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751378048 00000100:00100000:0.0:1789366537.116414:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 9 00000100:00100000:0.0:1789366537.116421:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638987ea300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2353:x1876286751378048:12345-192.168.202.23@tcp:8: 00010000:00080000:0.0:1789366537.116446:0:6659:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 0ab23baa-a205-44ad-bf17-f7b47295d82b@192.168.202.23@tcp t0 exp 0000000000000000 cur 112 last 0 00000020:00000080:0.0:1789366537.116473:0:6659:0:(genops.c:1385:class_connect()) connect: client 0ab23baa-a205-44ad-bf17-f7b47295d82b, cookie 0x8da3486b955f3045 00002000:00100000:0.0:1789366537.116484:0:6659:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 0ab23baa-a205-44ad-bf17-f7b47295d82b/ffff9638b737d000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a06 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1789366537.116505:0:6659:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:0.0:1789366537.116846:0:6659:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1789366537.116871:0:6659:0:(import.c:65:import_set_state_nolock()) ffff9638b737f000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789366537.116961:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638987ea300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0ab23baa-a205-44ad-bf17-f7b47295d82b+6:2353:x1876286751378048:12345-192.168.202.23@tcp:8: Request processed in 539us (738us total) trans 0 rc 0/0 00000100:00100000:0.0:1789366537.116969:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 9 00000100:00100000:3.0:1789366537.117386:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:2.0:1789366537.117445:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751378304 00000100:00100000:2.0:1789366537.117450:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751378304 00000100:00100000:2.0:1789366537.117493:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 0 00000100:00100000:2.0:1789366537.117502:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638bf5a8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0ab23baa-a205-44ad-bf17-f7b47295d82b+6:5569:x1876286751378304:12345-192.168.202.23@tcp:33: 00000004:00080000:1.0:1789366537.128806:0:5818:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 11158us 00000004:00200000:1.0:1789366537.152058:0:5818:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000100:00100000:1.0:1789366537.152171:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638bf5a8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0ab23baa-a205-44ad-bf17-f7b47295d82b+6:5569:x1876286751378304:12345-192.168.202.23@tcp:33: Request processed in 34664us (34779us total) trans 0 rc 0/0 00000100:00100000:1.0:1789366537.152186:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 0 00000100:00100000:3.0:1789366537.287980:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:1.0:1789366537.288148:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751378432 00000100:00100000:1.0:1789366537.288158:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751378432 00000100:00100000:1.0:1789366537.288226:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 8 00000100:00100000:1.0:1789366537.288237:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638bf5a8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0ab23baa-a205-44ad-bf17-f7b47295d82b+6:5607:x1876286751378432:12345-192.168.202.23@tcp:101: 00010000:00010000:1.0:1789366537.288257:0:5816:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789366537.288293:0:5816:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96388148fa00/0x8da3486b955f304c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xda917a494d06becb expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366537.288355:0:5816:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96388148e000/0x8da3486b955f3053 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366537.288369:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96388148e000/0x8da3486b955f3053 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366537.288385:0:5816:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96388148e000/0x8da3486b955f3053 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789366537.288417:0:5816:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:1.0:1789366537.288433:0:5816:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1789366537.288451:0:5816:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff96388148e000/0x8da3486b955f3053 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366537.288476:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96388148fa00/0x8da3486b955f304c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.23@tcp remote: 0xda917a494d06becb expref: 8 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366537.288497:0:5816:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96388148e000/0x8da3486b955f3053 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.23@tcp remote: 0xda917a494d06becb expref: 7 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366537.288505:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff963887f88700) 00010000:00010000:1.0:1789366537.288520:0:5816:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789366537.288524:0:5816:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96388148e000, rc 0) 00000100:00100000:1.0:1789366537.288697:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638bf5a8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0ab23baa-a205-44ad-bf17-f7b47295d82b+7:5607:x1876286751378432:12345-192.168.202.23@tcp:101: Request processed in 461us (726us total) trans 0 rc 0/0 00000100:00100000:1.0:1789366537.288705:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 8 00000100:00100000:0.0:1789366537.655908:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9638b6ea1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3284:1876286758735744:0@lo:13: 00000100:00100000:0.0:1789366537.655980:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789366537.656172:0:6662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286758735744 00000100:00100000:2.0:1789366537.656181:0:6662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286758735744 00000100:00100000:2.0:1789366537.656243:0:6662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1789366537.656253:0:6662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963785f29f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1876286758735744:12345-0@lo:13: 00002000:00000024:2.0:1789366537.656303:0:6662:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00080000:1.0:1789366537.656331:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789366537.656374:0:6662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963785f29f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1876286758735744:12345-0@lo:13: Request processed in 121us (394us total) trans 0 rc 0/0 00000100:00100000:2.0:1789366537.656382:0:6662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:2.0:1789366537.656429:0:3284:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9638b6ea1c00 x1876286758735744/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789366553 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789366537.656446:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9638b6ea1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3284:1876286758735744:0@lo:13: 00010000:00010000:3.0:1789366538.104525:0:5805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789366538.723822:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:3.0:1789366538.723908:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751378560 00000100:00100000:3.0:1789366538.723920:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751378560 00000100:00100000:3.0:1789366538.723986:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 9 00000100:00100000:3.0:1789366538.724000:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638b6ea1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0ab23baa-a205-44ad-bf17-f7b47295d82b+7:5659:x1876286751378560:12345-192.168.202.23@tcp:41: 00000004:00000024:3.0:1789366538.724046:0:5815:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261778432 avail 2259681280 00000100:00100000:3.0:1789366538.724118:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638b6ea1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0ab23baa-a205-44ad-bf17-f7b47295d82b+7:5659:x1876286751378560:12345-192.168.202.23@tcp:41: Request processed in 122us (303us total) trans 0 rc 0/0 00000100:00100000:3.0:1789366538.724128:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 9 00000100:00100000:2.0:1789366538.725506:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:1.0:1789366538.725610:0:6663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751378688 00000100:00100000:1.0:1789366538.725618:0:6663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751378688 00000100:00100000:1.0:1789366538.725669:0:6663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 4 00000100:00100000:1.0:1789366538.725680:0:6663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638b6ea1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:0ab23baa-a205-44ad-bf17-f7b47295d82b+6:5659:x1876286751378688:12345-192.168.202.23@tcp:13: 00000100:00080000:0.0:1789366538.725688:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00000024:1.0:1789366538.725712:0:6663:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789366538.725768:0:6663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638b6ea1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:0ab23baa-a205-44ad-bf17-f7b47295d82b+6:5659:x1876286751378688:12345-192.168.202.23@tcp:13: Request processed in 92us (265us total) trans 0 rc 0/0 00000100:00100000:1.0:1789366538.725773:0:6663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 4 00000100:00100000:2.0:1789366538.726685:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:3.0:1789366538.726753:0:6662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751378816 00000100:00100000:3.0:1789366538.726759:0:6662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751378816 00000100:00100000:3.0:1789366538.726817:0:6662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 5 00000100:00080000:0.0:1789366538.726823:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789366538.726829:0:6662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638b6ea2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:0ab23baa-a205-44ad-bf17-f7b47295d82b+6:5659:x1876286751378816:12345-192.168.202.23@tcp:13: 00002000:00000024:3.0:1789366538.726852:0:6662:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789366538.726896:0:6662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638b6ea2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:0ab23baa-a205-44ad-bf17-f7b47295d82b+6:5659:x1876286751378816:12345-192.168.202.23@tcp:13: Request processed in 70us (212us total) trans 0 rc 0/0 00000100:00100000:3.0:1789366538.726904:0:6662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 5 00010000:00010000:0.0:1789366539.128127:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1789366539.747326:0:6685:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 0ab23baa-a205-44ad-bf17-f7b47295d82b 00000001:02000400:0.0:1789366539.898530:0:8264:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:2.0:1789366540.153318:0:6675:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789366540.217084:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff963785f2bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8cde4528-5832-4854-a387-4adacc3dd0ab:3285:1876286758735872:0@lo:400: 00000100:00100000:0.0:1789366540.217159:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789366540.217216:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff963785f28a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3285:1876286758736384:0@lo:400: 00000100:00100000:0.0:1789366540.217244:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789366540.217281:0:3285:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789366540.217288:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff963785f2ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3285:1876286758736256:0@lo:400: 00000100:00100000:0.0:1789366540.217317:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789366540.217363:0:3286:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff963785f29880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3286:1876286758736000:0@lo:400: 00000100:00100000:0.0:1789366540.217387:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789366540.217407:0:3286:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff963785f2a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3286:1876286758736512:0@lo:400: 00000100:00100000:0.0:1789366540.217429:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789366540.217456:0:3286:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1789366540.217463:0:3286:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff963785f28700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3286:1876286758736128:0@lo:400: 00000100:00100000:0.0:1789366540.217486:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789366540.217508:0:3286:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9638bf5a9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3286:1876286758736640:0@lo:13: 00000100:00100000:0.0:1789366540.217533:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789366540.217567:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286758735872 00000100:00100000:0.0:1789366540.217574:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286758735872 00000100:00100000:3.0:1789366540.217615:0:8065:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286758736256 00000100:00100000:0.0:1789366540.217621:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:3.0:1789366540.217623:0:8065:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286758736256 00000100:00100000:0.0:1789366540.217632:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638b4e3a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8cde4528-5832-4854-a387-4adacc3dd0ab+19:3285:x1876286758735872:12345-0@lo:400: 00000100:00100000:3.0:1789366540.217670:0:8065:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286758736512 00000100:00100000:3.0:1789366540.217674:0:8065:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286758736512 00000100:00100000:0.0:1789366540.217682:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638b4e3a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8cde4528-5832-4854-a387-4adacc3dd0ab+19:3285:x1876286758735872:12345-0@lo:400: Request processed in 52us (523us total) trans 0 rc 0/0 00000100:00100000:0.0:1789366540.217690:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:3.0:1789366540.217700:0:8065:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789366540.217709:0:8065:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963785f28380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3285:x1876286758736256:12345-0@lo:400: 00000100:00100000:0.0:1789366540.217754:0:7132:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286758736384 00000100:00100000:0.0:1789366540.217759:0:7132:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286758736384 00000100:00100000:3.0:1789366540.217780:0:8065:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963785f28380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3285:x1876286758736256:12345-0@lo:400: Request processed in 73us (462us total) trans 0 rc 0/0 00000100:00100000:3.0:1789366540.217788:0:8065:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1789366540.217790:0:7132:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286758736000 00000100:00100000:0.0:1789366540.217795:0:7132:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286758736000 00000100:00100000:3.0:1789366540.217807:0:8065:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1789366540.217816:0:8065:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638b4f18a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3286:x1876286758736512:12345-0@lo:400: 00000100:00100000:0.0:1789366540.217817:0:7132:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286758736128 00000100:00100000:0.0:1789366540.217821:0:7132:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286758736128 00000100:00100000:0.0:1789366540.217842:0:7132:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1789366540.217856:0:7132:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963785f2aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3285:x1876286758736384:12345-0@lo:400: 00000100:00100000:3.0:1789366540.217861:0:8065:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638b4f18a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3286:x1876286758736512:12345-0@lo:400: Request processed in 46us (430us total) trans 0 rc 0/0 00000100:00100000:3.0:1789366540.217870:0:8065:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1789366540.217894:0:7132:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963785f2aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3285:x1876286758736384:12345-0@lo:400: Request processed in 39us (649us total) trans 0 rc 0/0 00000100:00100000:0.0:1789366540.217902:0:7132:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1789366540.217920:0:7132:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1789366540.217927:0:7132:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963785f29500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3286:x1876286758736000:12345-0@lo:400: 00000100:00100000:0.0:1789366540.217956:0:7132:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963785f29500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3286:x1876286758736000:12345-0@lo:400: Request processed in 31us (568us total) trans 0 rc 0/0 00000100:00100000:0.0:1789366540.217962:0:7132:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1789366540.217978:0:7132:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1789366540.217983:0:7132:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638b4f18380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3286:x1876286758736128:12345-0@lo:400: 00000100:00100000:0.0:1789366540.218005:0:7132:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638b4f18380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3286:x1876286758736128:12345-0@lo:400: Request processed in 22us (520us total) trans 0 rc 0/0 00000100:00100000:0.0:1789366540.218010:0:7132:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1789366540.218038:0:6663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286758736640 00000100:00100000:0.0:1789366540.218042:0:6663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286758736640 00000100:00100000:0.0:1789366540.218062:0:6663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1789366540.218068:0:6663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638b4f1bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3286:x1876286758736640:12345-0@lo:13: 00002000:00000024:0.0:1789366540.218081:0:6663:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789366540.218110:0:6663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638b4f1bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3286:x1876286758736640:12345-0@lo:13: Request processed in 42us (578us total) trans 0 rc 0/0 00000100:00100000:0.0:1789366540.218115:0:6663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00080000:0.0:1789366540.218130:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789366540.218134:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789366540.218137:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789366540.218176:0:3286:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff963785f28700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3286:1876286758736128:0@lo:400: 00010000:00080000:0.0:1789366540.218192:0:3286:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9638bf5a9f80 x1876286758736640/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789366556 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789366540.218207:0:3286:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:0.0:1789366540.218229:0:3286:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9638bf5a9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3286:1876286758736640:0@lo:13: 00000100:00100000:0.0:1789366540.218257:0:3286:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff963785f29880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3286:1876286758736000:0@lo:400: 00010000:00080000:0.0:1789366540.218269:0:3286:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff963785f2a680 x1876286758736512/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789366556 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789366540.218276:0:3286:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff963785f2a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3286:1876286758736512:0@lo:400: 00010000:00080000:0.0:1789366540.218316:0:3285:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff963785f2ad80 x1876286758736256/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789366556 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789366540.218324:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff963785f2ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3285:1876286758736256:0@lo:400: 00000100:00100000:0.0:1789366540.218332:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff963785f2bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8cde4528-5832-4854-a387-4adacc3dd0ab:3285:1876286758735872:0@lo:400: 00000100:00100000:0.0:1789366540.218344:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff963785f28a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3285:1876286758736384:0@lo:400: 00010000:00010000:3.0:1789366541.178174:0:5805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1789366541.256149:0:7617:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 0ab23baa-a205-44ad-bf17-f7b47295d82b 00000001:00100000:0.0:1789366541.257882:0:5837:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 0ab23baa-a205-44ad-bf17-f7b47295d82b 00000020:00000080:3.0:1789366541.659599:0:8414:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffe774172b0 20000000:00000080:3.0:1789366541.659617:0:8414:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9638a74acc00 uarg=0000000000000000 20000000:01000000:3.0:1789366541.659650:0:8414:0:(mgs_llog.c:2006:mgs_parse_devname()) Device name lustre without fsname 20000000:01000000:3.0:1789366541.659653:0:8414:0:(mgs_llog.c:6069:mgs_set_conf_param()) lustre is seen as a file system name 20000000:01000000:3.0:1789366541.659656:0:8414:0:(mgs_llog.c:6100:mgs_set_conf_param()) set_conf_param fs='lustre' device='lustre' param='sys.jobid_var=procname_uid' 20000000:01000000:3.0:1789366541.659661:0:8414:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.jobid_var=procname_uid' 20000000:01000000:3.0:1789366541.659666:0:8414:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.jobid_var=procname_uid' val=procname_uid 20000000:01000000:3.0:1789366541.659677:0:8414:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:3.0:1789366541.659680:0:8414:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:3.0:1789366541.659877:0:8414:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:3.0:1789366541.659879:0:8414:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.jobid_var fl=4 00000040:00080000:3.0:1789366541.660480:0:8415:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000040:00080000:1.0:1789366541.660950:0:8414:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].39, 224 off14880 00000040:00080000:1.0:1789366541.661007:0:8414:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].40, 120 off15000 00000040:00080000:1.0:1789366541.661042:0:8414:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].41, 224 off15224 20000000:01000000:1.0:1789366541.661055:0:8414:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:1.0:1789366541.661057:0:8414:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.jobid_var fl=4 00000040:00080000:3.0:1789366541.661675:0:8416:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 8 count 8 00000040:00080000:1.0:1789366541.662101:0:8414:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9632 00000040:00080000:1.0:1789366541.662155:0:8414:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 120 off9752 00000040:00080000:1.0:1789366541.662190:0:8414:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 224 off9976 20000000:01000000:1.0:1789366541.662202:0:8414:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:1.0:1789366541.662204:0:8414:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.jobid_var fl=4 00000040:00080000:3.0:1789366541.662902:0:8417:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00000040:00080000:1.0:1789366541.663163:0:8414:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 224 off14144 00000040:00080000:1.0:1789366541.663203:0:8414:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 120 off14264 00000040:00080000:1.0:1789366541.663272:0:8414:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14488 20000000:01000000:1.0:1789366541.663286:0:8414:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:1.0:1789366541.663288:0:8414:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.jobid_var fl=4 00000040:00080000:3.0:1789366541.664079:0:8418:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 11 count 11 00000040:00080000:1.0:1789366541.664348:0:8414:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 224 off10160 00000040:00080000:1.0:1789366541.664424:0:8414:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 120 off10280 00000040:00080000:1.0:1789366541.664476:0:8414:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].13, 224 off10504 10000000:01000000:1.0:1789366541.664493:0:8414:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:1.0:1789366541.664518:0:8414:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff96388148fa00/0x8da3486b955f305a lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366541.664542:0:8414:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9638832d3800/0x8da3486b955f2f57 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8da3486b955f2f50 expref: 18 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366541.664550:0:8414:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9638832d3e00/0x8da3486b955f2f81 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8da3486b955f2f7a expref: 18 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366541.664563:0:8414:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9638a0741400/0x8da3486b955f2fab lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8da3486b955f2fa4 expref: 18 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366541.664571:0:8414:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff963880031200/0x8da3486b955f2fb9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8da3486b955f2fb2 expref: 18 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366541.664593:0:8414:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9638a0740400/0x8da3486b955f2fc7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8da3486b955f2fc0 expref: 18 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366541.664601:0:8414:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff963880030e00/0x8da3486b955f2fe3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8da3486b955f2fdc expref: 18 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366541.664608:0:8414:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9638832d3600/0x8da3486b955f300d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8da3486b955f3006 expref: 18 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366541.665019:0:8414:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff963880030000/0x8da3486b955f301b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.202.23@tcp remote: 0xda917a494d06be69 expref: 9 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366541.665030:0:8414:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff963880030600/0x8da3486b955f3022 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.202.23@tcp remote: 0xda917a494d06be70 expref: 9 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366541.665038:0:8414:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff96388148fa00/0x8da3486b955f305a lrc: 12/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366541.665075:0:8414:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff963880030600/0x8da3486b955f3022 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 192.168.202.23@tcp remote: 0xda917a494d06be70 expref: 9 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366541.665088:0:8414:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff963880030600/0x8da3486b955f3022 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 192.168.202.23@tcp remote: 0xda917a494d06be70 expref: 9 pid: 5811 timeout: 217 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789366541.665103:0:8414:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9638987e8e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8414:1876286758736768:192.168.202.23@tcp:104: 00010000:00010000:1.0:1789366541.665566:0:8414:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff963880030000/0x8da3486b955f301b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 192.168.202.23@tcp remote: 0xda917a494d06be69 expref: 9 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366541.665577:0:8414:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff963880030000/0x8da3486b955f301b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 192.168.202.23@tcp remote: 0xda917a494d06be69 expref: 9 pid: 5811 timeout: 217 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789366541.665599:0:8414:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9638987e9c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8414:1876286758736896:192.168.202.23@tcp:104: 00010000:00010000:1.0:1789366541.665634:0:8414:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9638832d3600/0x8da3486b955f300d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x8da3486b955f3006 expref: 18 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366541.665642:0:8414:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9638832d3600/0x8da3486b955f300d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x8da3486b955f3006 expref: 18 pid: 5808 timeout: 267 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789366541.665651:0:8414:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9638987ea680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8414:1876286758737024:0@lo:104: 00000100:00100000:1.0:1789366541.665689:0:8414:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789366541.665746:0:8414:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff963880030e00/0x8da3486b955f2fe3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x8da3486b955f2fdc expref: 18 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789366541.665749:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286758737024 00000100:00100000:3.0:1789366541.665758:0:6674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286758737024 00010000:00010000:1.0:1789366541.665760:0:8414:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff963880030e00/0x8da3486b955f2fe3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x8da3486b955f2fdc expref: 18 pid: 5811 timeout: 267 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789366541.665771:0:8414:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9638987ead80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8414:1876286758737152:0@lo:104: 00000100:00100000:1.0:1789366541.665795:0:8414:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789366541.665837:0:8414:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9638a0740400/0x8da3486b955f2fc7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x8da3486b955f2fc0 expref: 18 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366541.665846:0:8414:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9638a0740400/0x8da3486b955f2fc7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x8da3486b955f2fc0 expref: 18 pid: 5808 timeout: 267 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789366541.665856:0:8414:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9638987eb480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8414:1876286758737280:0@lo:104: 00000100:00100000:0.0:1789366541.665870:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286758737152 00000100:00100000:0.0:1789366541.665876:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286758737152 00000100:00100000:1.0:1789366541.665885:0:8414:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789366541.665930:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286758737280 00000100:00100000:1.0:1789366541.665934:0:5800:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1789366541.665935:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286758737280 00000100:00100000:1.0:1789366541.665952:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1789366541.665962:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638987e8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8cde4528-5832-4854-a387-4adacc3dd0ab+5:8414:x1876286758737152:12345-0@lo:104: 00000100:00100000:0.0:1789366541.665966:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1789366541.665978:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638987e8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8cde4528-5832-4854-a387-4adacc3dd0ab+5:8414:x1876286758737024:12345-0@lo:104: 00010000:00010000:1.0:1789366541.665982:0:5800:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.123@tcp lock: ffff9638832d3c00/0x8da3486b955f2fdc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x8da3486b955f2fe3 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366541.665989:0:5799:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.123@tcp lock: ffff9638832d2a00/0x8da3486b955f3006 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400000000000 nid: local remote: 0x8da3486b955f300d expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366541.666037:0:5800:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1789366541.666044:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638987e8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8cde4528-5832-4854-a387-4adacc3dd0ab+5:8414:x1876286758737152:12345-0@lo:104: Request processed in 84us (248us total) trans 0 rc 0/0 00010000:00010000:0.0:1789366541.666048:0:5799:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1789366541.666053:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1789366541.666058:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638987e8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8cde4528-5832-4854-a387-4adacc3dd0ab+5:8414:x1876286758737024:12345-0@lo:104: Request processed in 80us (367us total) trans 0 rc 0/0 00000100:00100000:0.0:1789366541.666075:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1789366541.666081:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1789366541.666090:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638b7016c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8cde4528-5832-4854-a387-4adacc3dd0ab+3:8414:x1876286758737280:12345-0@lo:104: 00010000:00010000:0.0:1789366541.666097:0:5804:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1789366541.666099:0:5800:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.123@tcp lock: ffff9638832d3a00/0x8da3486b955f2fc0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x8da3486b955f2fc7 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366541.666106:0:5804:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.123@tcp lock: ffff9638832d3c00/0x8da3486b955f2fdc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400000000000 nid: local remote: 0x8da3486b955f2fe3 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366541.666116:0:5804:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9638832d3c00 already unused, calling callback (ffffffffc1cc7c20) 10000000:00010000:0.0:1789366541.666121:0:5804:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.123@tcp lock: ffff9638832d3c00/0x8da3486b955f2fdc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0x8da3486b955f2fe3 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366541.666131:0:5804:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.123@tcp lock: ffff9638832d3c00/0x8da3486b955f2fdc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0x8da3486b955f2fe3 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366541.666135:0:5800:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 10000000:00010000:0.0:1789366541.666140:0:5804:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.123@tcp lock: ffff9638832d3c00/0x8da3486b955f2fdc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0x8da3486b955f2fe3 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789366541.666143:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638b7016c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8cde4528-5832-4854-a387-4adacc3dd0ab+3:8414:x1876286758737280:12345-0@lo:104: Request processed in 54us (258us total) trans 0 rc 0/0 10000000:01000000:0.0:1789366541.666155:0:5804:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:1.0:1789366541.666160:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00010000:0.0:1789366541.666188:0:5804:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.123@tcp lock: ffff9638832d3c00/0x8da3486b955f2fdc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8da3486b955f2fe3 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366541.666197:0:5804:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789366541.666214:0:5804:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.123@tcp lock: ffff9638832d3c00/0x8da3486b955f2fdc lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8da3486b955f2fe3 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366541.666219:0:8414:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff963880031200/0x8da3486b955f2fb9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x8da3486b955f2fb2 expref: 18 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366541.666224:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.123@tcp lock: ffff9638832d3c00/0x8da3486b955f2fdc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8da3486b955f2fe3 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366541.666246:0:8414:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff963880031200/0x8da3486b955f2fb9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x8da3486b955f2fb2 expref: 18 pid: 5811 timeout: 267 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789366541.666257:0:8414:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9638987e8700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8414:1876286758737536:0@lo:104: 00010000:00010000:0.0:1789366541.666263:0:5804:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1789366541.666268:0:5804:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.123@tcp lock: ffff9638832d2a00/0x8da3486b955f3006 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x8da3486b955f300d expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789366541.666284:0:8414:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789366541.666291:0:5804:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9638832d2a00 already unused, calling callback (ffffffffc1cc7c20) 10000000:00010000:0.0:1789366541.666294:0:5804:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.123@tcp lock: ffff9638832d2a00/0x8da3486b955f3006 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0x8da3486b955f300d expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366541.666301:0:5804:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.123@tcp lock: ffff9638832d2a00/0x8da3486b955f3006 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0x8da3486b955f300d expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789366541.666316:0:5804:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.123@tcp lock: ffff9638832d2a00/0x8da3486b955f3006 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0x8da3486b955f300d expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789366541.666322:0:5804:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1789366541.666325:0:8414:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9638a0741400/0x8da3486b955f2fab lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x8da3486b955f2fa4 expref: 18 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366541.666335:0:8414:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9638a0741400/0x8da3486b955f2fab lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x8da3486b955f2fa4 expref: 18 pid: 5808 timeout: 267 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366541.666348:0:5804:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.123@tcp lock: ffff9638832d2a00/0x8da3486b955f3006 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8da3486b955f300d expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789366541.666350:0:8414:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9638b73cf100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8414:1876286758737664:0@lo:104: 00010000:00010000:0.0:1789366541.666360:0:5804:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789366541.666368:0:5804:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.123@tcp lock: ffff9638832d2a00/0x8da3486b955f3006 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8da3486b955f300d expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366541.666375:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.123@tcp lock: ffff9638832d2a00/0x8da3486b955f3006 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8da3486b955f300d expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789366541.666381:0:8414:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789366541.666392:0:5804:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789366541.666396:0:5804:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.123@tcp lock: ffff9638832d3a00/0x8da3486b955f2fc0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x8da3486b955f2fc7 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366541.666402:0:5804:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9638832d3a00 already unused, calling callback (ffffffffc1cc7c20) 00000100:00100000:1.0:1789366541.666405:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286758737536 10000000:00010000:0.0:1789366541.666405:0:5804:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.123@tcp lock: ffff9638832d3a00/0x8da3486b955f2fc0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x8da3486b955f2fc7 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789366541.666411:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286758737536 00010000:00010000:0.0:1789366541.666424:0:5804:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.123@tcp lock: ffff9638832d3a00/0x8da3486b955f2fc0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x8da3486b955f2fc7 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789366541.666430:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286758737664 10000000:00010000:0.0:1789366541.666431:0:5804:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.123@tcp lock: ffff9638832d3a00/0x8da3486b955f2fc0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x8da3486b955f2fc7 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789366541.666434:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286758737664 10000000:01000000:0.0:1789366541.666440:0:5804:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:1.0:1789366541.666451:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00010000:00010000:0.0:1789366541.666457:0:5804:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.123@tcp lock: ffff9638832d3a00/0x8da3486b955f2fc0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8da3486b955f2fc7 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789366541.666459:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638987e8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8cde4528-5832-4854-a387-4adacc3dd0ab+4:8414:x1876286758737536:12345-0@lo:104: 00010000:00010000:1.0:1789366541.666472:0:5800:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.123@tcp lock: ffff9638832d2200/0x8da3486b955f2fb2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x8da3486b955f2fb9 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366541.666480:0:5804:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789366541.666496:0:5804:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.123@tcp lock: ffff9638832d3a00/0x8da3486b955f2fc0 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8da3486b955f2fc7 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366541.666502:0:5800:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00010000:00010000:0.0:1789366541.666504:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.123@tcp lock: ffff9638832d3a00/0x8da3486b955f2fc0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8da3486b955f2fc7 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789366541.666510:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638987e8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8cde4528-5832-4854-a387-4adacc3dd0ab+4:8414:x1876286758737536:12345-0@lo:104: Request processed in 51us (227us total) trans 0 rc 0/0 00000100:00100000:1.0:1789366541.666521:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00010000:0.0:1789366541.666524:0:5804:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789366541.666528:0:5804:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.123@tcp lock: ffff9638832d2200/0x8da3486b955f2fb2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x8da3486b955f2fb9 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789366541.666536:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1789366541.666544:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638b73cc380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8cde4528-5832-4854-a387-4adacc3dd0ab+3:8414:x1876286758737664:12345-0@lo:104: 00010000:00010000:0.0:1789366541.666549:0:5804:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9638832d2200 already unused, calling callback (ffffffffc1cc7c20) 10000000:00010000:0.0:1789366541.666554:0:5804:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.123@tcp lock: ffff9638832d2200/0x8da3486b955f2fb2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x8da3486b955f2fb9 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366541.666555:0:5800:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.123@tcp lock: ffff96388148f800/0x8da3486b955f2fa4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x8da3486b955f2fab expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366541.666569:0:5804:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.123@tcp lock: ffff9638832d2200/0x8da3486b955f2fb2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x8da3486b955f2fb9 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789366541.666578:0:5804:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.123@tcp lock: ffff9638832d2200/0x8da3486b955f2fb2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x8da3486b955f2fb9 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366541.666589:0:5800:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 10000000:01000000:0.0:1789366541.666590:0:5804:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:1.0:1789366541.666598:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638b73cc380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8cde4528-5832-4854-a387-4adacc3dd0ab+3:8414:x1876286758737664:12345-0@lo:104: Request processed in 55us (218us total) trans 0 rc 0/0 00000100:00100000:1.0:1789366541.666604:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00010000:0.0:1789366541.666609:0:5804:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.123@tcp lock: ffff9638832d2200/0x8da3486b955f2fb2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8da3486b955f2fb9 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366541.666617:0:5804:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789366541.666623:0:5804:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.123@tcp lock: ffff9638832d2200/0x8da3486b955f2fb2 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8da3486b955f2fb9 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366541.666630:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.123@tcp lock: ffff9638832d2200/0x8da3486b955f2fb2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8da3486b955f2fb9 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366541.666632:0:8414:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9638832d3e00/0x8da3486b955f2f81 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x8da3486b955f2f7a expref: 18 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366541.666651:0:5804:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789366541.666658:0:5804:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.123@tcp lock: ffff96388148f800/0x8da3486b955f2fa4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x8da3486b955f2fab expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366541.666666:0:8414:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9638832d3e00/0x8da3486b955f2f81 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x8da3486b955f2f7a expref: 18 pid: 5808 timeout: 267 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366541.666667:0:5804:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96388148f800 already unused, calling callback (ffffffffc1cc7c20) 10000000:00010000:0.0:1789366541.666674:0:5804:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.123@tcp lock: ffff96388148f800/0x8da3486b955f2fa4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x8da3486b955f2fab expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789366541.666682:0:8414:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9638b73cf800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8414:1876286758738176:0@lo:104: 00010000:00010000:0.0:1789366541.666686:0:5804:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.123@tcp lock: ffff96388148f800/0x8da3486b955f2fa4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x8da3486b955f2fab expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789366541.666694:0:5804:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.123@tcp lock: ffff96388148f800/0x8da3486b955f2fa4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x8da3486b955f2fab expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789366541.666700:0:5804:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:1.0:1789366541.666707:0:8414:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789366541.666746:0:5804:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.123@tcp lock: ffff96388148f800/0x8da3486b955f2fa4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8da3486b955f2fab expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789366541.666750:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286758738176 00000100:00100000:1.0:1789366541.666756:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286758738176 00010000:00010000:0.0:1789366541.666757:0:5804:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789366541.666770:0:5804:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.123@tcp lock: ffff96388148f800/0x8da3486b955f2fa4 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8da3486b955f2fab expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789366541.666777:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00010000:00010000:0.0:1789366541.666780:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.123@tcp lock: ffff96388148f800/0x8da3486b955f2fa4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8da3486b955f2fab expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789366541.666786:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638b73cea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8cde4528-5832-4854-a387-4adacc3dd0ab+3:8414:x1876286758738176:12345-0@lo:104: 00010000:00010000:1.0:1789366541.666794:0:5800:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.123@tcp lock: ffff9638a0741600/0x8da3486b955f2f7a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x8da3486b955f2f81 expref: -99 pid: 7601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366541.666815:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789366541.666819:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789366541.666822:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789366541.666835:0:5800:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1789366541.666836:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9638b4f18000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8cde4528-5832-4854-a387-4adacc3dd0ab:3284:1876286758737408:0@lo:103: 00000100:00100000:1.0:1789366541.666844:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638b73cea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8cde4528-5832-4854-a387-4adacc3dd0ab+3:8414:x1876286758738176:12345-0@lo:104: Request processed in 57us (136us total) trans 0 rc 0/0 00000100:00100000:1.0:1789366541.666852:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1789366541.666878:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789366541.666887:0:8414:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9638832d3800/0x8da3486b955f2f57 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x8da3486b955f2f50 expref: 18 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366541.666897:0:8414:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9638832d3800/0x8da3486b955f2f57 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x8da3486b955f2f50 expref: 18 pid: 5808 timeout: 267 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789366541.666903:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9638b4f1a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8cde4528-5832-4854-a387-4adacc3dd0ab:3284:1876286758738304:0@lo:103: 00000100:00100000:1.0:1789366541.666909:0:8414:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9638b73cf480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8414:1876286758738432:0@lo:104: 00000100:00100000:0.0:1789366541.666937:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789366541.666943:0:8414:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789366541.666965:0:3284:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789366541.666970:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286758738432 00000100:00100000:1.0:1789366541.666974:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286758738432 00000100:00100000:0.0:1789366541.666975:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9638b4f1b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8cde4528-5832-4854-a387-4adacc3dd0ab:3284:1876286758737792:0@lo:103: 00000100:00100000:1.0:1789366541.666993:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1789366541.667000:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638b73cc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8cde4528-5832-4854-a387-4adacc3dd0ab+3:8414:x1876286758738432:12345-0@lo:104: 00000100:00100000:0.0:1789366541.667008:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789366541.667017:0:5800:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.123@tcp lock: ffff963880031400/0x8da3486b955f2f50 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x8da3486b955f2f57 expref: -99 pid: 7601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789366541.667044:0:3286:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9638b4f1aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8cde4528-5832-4854-a387-4adacc3dd0ab:3286:1876286758737920:0@lo:103: 00010000:00010000:1.0:1789366541.667049:0:5800:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1789366541.667055:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638b73cc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8cde4528-5832-4854-a387-4adacc3dd0ab+3:8414:x1876286758738432:12345-0@lo:104: Request processed in 55us (114us total) trans 0 rc 0/0 00000100:00100000:1.0:1789366541.667061:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1789366541.667073:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789366541.667080:0:8414:0:(client.c:2716:ptlrpc_set_wait()) set ffff963891b10540 going to sleep for 11 seconds 00000100:00100000:0.0:1789366541.667089:0:3286:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789366541.667096:0:3286:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9638b4f1b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8cde4528-5832-4854-a387-4adacc3dd0ab:3286:1876286758738048:0@lo:103: 00000100:00100000:1.0:1789366541.667103:0:8414:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9638987ea680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8414:1876286758737024:0@lo:104: 00000100:00100000:1.0:1789366541.667114:0:8414:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9638987ead80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8414:1876286758737152:0@lo:104: 00000100:00100000:0.0:1789366541.667121:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789366541.667127:0:8414:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9638987eb480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8414:1876286758737280:0@lo:104: 00000100:00100000:1.0:1789366541.667140:0:8414:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9638987e8700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8414:1876286758737536:0@lo:104: 00000100:00100000:1.0:1789366541.667148:0:8414:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9638b73cf100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8414:1876286758737664:0@lo:104: 00000100:00100000:0.0:1789366541.667153:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286758737408 00000100:00100000:1.0:1789366541.667157:0:8414:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9638b73cf800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8414:1876286758738176:0@lo:104: 00000100:00100000:0.0:1789366541.667159:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286758737408 00000100:00100000:1.0:1789366541.667167:0:8414:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9638b73cf480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8414:1876286758738432:0@lo:104: 00010000:00010000:0.0:1789366541.667182:0:5802:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff963880030e00/0x8da3486b955f2fe3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8da3486b955f2fdc expref: 19 pid: 5811 timeout: 267 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789366541.667199:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286758738304 00000100:00100000:0.0:1789366541.667202:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286758738304 00010000:00010000:0.0:1789366541.667211:0:5802:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9638a0741400/0x8da3486b955f2fab lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8da3486b955f2fa4 expref: 20 pid: 5808 timeout: 267 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789366541.667232:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286758737792 00000100:00100000:0.0:1789366541.667249:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286758737792 00010000:00010000:0.0:1789366541.667261:0:5802:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9638832d3600/0x8da3486b955f300d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8da3486b955f3006 expref: 21 pid: 5808 timeout: 267 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789366541.667276:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286758737920 00000100:00100000:0.0:1789366541.667279:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286758737920 00010000:00010000:0.0:1789366541.667289:0:5802:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9638a0740400/0x8da3486b955f2fc7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8da3486b955f2fc0 expref: 22 pid: 5808 timeout: 267 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789366541.667298:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286758738048 00000100:00100000:0.0:1789366541.667300:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286758738048 00010000:00010000:0.0:1789366541.667309:0:5802:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff963880031200/0x8da3486b955f2fb9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8da3486b955f2fb2 expref: 23 pid: 5811 timeout: 267 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789366541.667319:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1789366541.667326:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96389861d450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8cde4528-5832-4854-a387-4adacc3dd0ab+23:3284:x1876286758737408:12345-0@lo:103: 00010000:00010000:0.0:1789366541.667335:0:5802:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789366541.667340:0:5802:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff963880030e00/0x8da3486b955f2fe3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8da3486b955f2fdc expref: 23 pid: 5811 timeout: 267 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366541.667344:0:6675:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789366541.667354:0:6675:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.123@tcp lock: ffff9638a0741600/0x8da3486b955f2f7a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x8da3486b955f2f81 expref: -99 pid: 7601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366541.667354:0:5802:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff963880030e00/0x8da3486b955f2fe3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x8da3486b955f2fdc expref: 23 pid: 5811 timeout: 267 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366541.667372:0:6675:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9638a0741600 already unused, calling callback (ffffffffc1cc7c20) 10000000:00010000:2.0:1789366541.667376:0:6675:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.123@tcp lock: ffff9638a0741600/0x8da3486b955f2f7a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x8da3486b955f2f81 expref: -99 pid: 7601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366541.667381:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff963880030e00/0x8da3486b955f2fe3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x8da3486b955f2fdc expref: 23 pid: 5811 timeout: 267 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366541.667388:0:6675:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.123@tcp lock: ffff9638a0741600/0x8da3486b955f2f7a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x8da3486b955f2f81 expref: -99 pid: 7601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789366541.667396:0:6675:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.123@tcp lock: ffff9638a0741600/0x8da3486b955f2f7a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x8da3486b955f2f81 expref: -99 pid: 7601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366541.667397:0:5802:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 10000000:01000000:2.0:1789366541.667404:0:6675:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1789366541.667421:0:6675:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.123@tcp lock: ffff9638a0741600/0x8da3486b955f2f7a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8da3486b955f2f81 expref: -99 pid: 7601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366541.667427:0:6675:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:0.0:1789366541.667437:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96389861d450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8cde4528-5832-4854-a387-4adacc3dd0ab+22:3284:x1876286758737408:12345-0@lo:103: Request processed in 111us (560us total) trans 0 rc 0/0 00010000:00010000:2.0:1789366541.667441:0:6675:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.123@tcp lock: ffff9638a0741600/0x8da3486b955f2f7a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8da3486b955f2f81 expref: -99 pid: 7601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366541.667452:0:6675:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.123@tcp lock: ffff9638a0741600/0x8da3486b955f2f7a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8da3486b955f2f81 expref: -99 pid: 7601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789366541.667459:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00010000:2.0:1789366541.667468:0:6675:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789366541.667473:0:6675:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.123@tcp lock: ffff963880031400/0x8da3486b955f2f50 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x8da3486b955f2f57 expref: -99 pid: 7601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366541.667489:0:6675:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff963880031400 already unused, calling callback (ffffffffc1cc7c20) 10000000:00010000:2.0:1789366541.667493:0:6675:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.123@tcp lock: ffff963880031400/0x8da3486b955f2f50 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x8da3486b955f2f57 expref: -99 pid: 7601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366541.667500:0:6675:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.123@tcp lock: ffff963880031400/0x8da3486b955f2f50 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x8da3486b955f2f57 expref: -99 pid: 7601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789366541.667501:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 10000000:00010000:2.0:1789366541.667511:0:6675:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.123@tcp lock: ffff963880031400/0x8da3486b955f2f50 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x8da3486b955f2f57 expref: -99 pid: 7601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789366541.667512:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638b4f19880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8cde4528-5832-4854-a387-4adacc3dd0ab+21:3284:x1876286758738304:12345-0@lo:103: 10000000:01000000:2.0:1789366541.667523:0:6675:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1789366541.667525:0:5802:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789366541.667531:0:5802:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9638a0741400/0x8da3486b955f2fab lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8da3486b955f2fa4 expref: 21 pid: 5808 timeout: 267 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366541.667538:0:6675:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.123@tcp lock: ffff963880031400/0x8da3486b955f2f50 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8da3486b955f2f57 expref: -99 pid: 7601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366541.667542:0:5802:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9638a0741400/0x8da3486b955f2fab lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x8da3486b955f2fa4 expref: 21 pid: 5808 timeout: 267 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366541.667552:0:6675:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789366541.667563:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9638a0741400/0x8da3486b955f2fab lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x8da3486b955f2fa4 expref: 21 pid: 5808 timeout: 267 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366541.667567:0:6675:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.123@tcp lock: ffff963880031400/0x8da3486b955f2f50 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8da3486b955f2f57 expref: -99 pid: 7601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366541.667573:0:5802:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789366541.667576:0:6675:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.123@tcp lock: ffff963880031400/0x8da3486b955f2f50 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8da3486b955f2f57 expref: -99 pid: 7601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366541.667594:0:6675:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789366541.667597:0:6675:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789366541.667601:0:6675:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789366541.667601:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638b4f19880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8cde4528-5832-4854-a387-4adacc3dd0ab+20:3284:x1876286758738304:12345-0@lo:103: Request processed in 89us (663us total) trans 0 rc 0/0 00000100:00100000:0.0:1789366541.667610:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1789366541.667612:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9638b6ea2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8cde4528-5832-4854-a387-4adacc3dd0ab:3285:1876286758738560:0@lo:103: 00000100:00100000:0.0:1789366541.667627:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1789366541.667635:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638b4f19f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8cde4528-5832-4854-a387-4adacc3dd0ab+19:3284:x1876286758737792:12345-0@lo:103: 00000100:00100000:2.0:1789366541.667643:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789366541.667644:0:5802:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789366541.667650:0:5802:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9638832d3600/0x8da3486b955f300d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8da3486b955f3006 expref: 19 pid: 5808 timeout: 267 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366541.667660:0:5802:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9638832d3600/0x8da3486b955f300d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x8da3486b955f3006 expref: 19 pid: 5808 timeout: 267 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789366541.667665:0:3287:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789366541.667675:0:3287:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9638b6ea0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8cde4528-5832-4854-a387-4adacc3dd0ab:3287:1876286758738688:0@lo:103: 00010000:00010000:0.0:1789366541.667678:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9638832d3600/0x8da3486b955f300d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x8da3486b955f3006 expref: 19 pid: 5808 timeout: 267 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366541.667704:0:5802:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789366541.667709:0:3287:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789366541.667760:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638b4f19f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8cde4528-5832-4854-a387-4adacc3dd0ab+18:3284:x1876286758737792:12345-0@lo:103: Request processed in 126us (753us total) trans 0 rc 0/0 00000100:00100000:0.0:1789366541.667767:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1789366541.667780:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286758738560 00000100:00100000:0.0:1789366541.667784:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286758738560 00010000:00010000:0.0:1789366541.667793:0:5802:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9638832d3e00/0x8da3486b955f2f81 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8da3486b955f2f7a expref: 18 pid: 5808 timeout: 267 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789366541.667803:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286758738688 00000100:00100000:0.0:1789366541.667806:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286758738688 00010000:00010000:0.0:1789366541.667816:0:5802:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9638832d3800/0x8da3486b955f2f57 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8da3486b955f2f50 expref: 19 pid: 5808 timeout: 267 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789366541.667829:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9638b4f1b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8cde4528-5832-4854-a387-4adacc3dd0ab:3284:1876286758737792:0@lo:103: 00000100:00100000:0.0:1789366541.667831:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1789366541.667843:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638b4f18700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8cde4528-5832-4854-a387-4adacc3dd0ab+19:3286:x1876286758737920:12345-0@lo:103: 00000100:00100000:1.0:1789366541.667845:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9638b4f18000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8cde4528-5832-4854-a387-4adacc3dd0ab:3284:1876286758737408:0@lo:103: 00010000:00010000:0.0:1789366541.667856:0:5802:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1789366541.667858:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9638b4f1a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8cde4528-5832-4854-a387-4adacc3dd0ab:3284:1876286758738304:0@lo:103: 00010000:00010000:0.0:1789366541.667865:0:5802:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9638a0740400/0x8da3486b955f2fc7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8da3486b955f2fc0 expref: 19 pid: 5808 timeout: 267 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366541.667876:0:5802:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9638a0740400/0x8da3486b955f2fc7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x8da3486b955f2fc0 expref: 19 pid: 5808 timeout: 267 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366541.667887:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9638a0740400/0x8da3486b955f2fc7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x8da3486b955f2fc0 expref: 19 pid: 5808 timeout: 267 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366541.667895:0:5802:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789366541.667925:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638b4f18700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8cde4528-5832-4854-a387-4adacc3dd0ab+18:3286:x1876286758737920:12345-0@lo:103: Request processed in 83us (853us total) trans 0 rc 0/0 00000100:00100000:0.0:1789366541.667940:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1789366541.667948:0:3286:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9638b4f1aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8cde4528-5832-4854-a387-4adacc3dd0ab:3286:1876286758737920:0@lo:103: 00000100:00100000:0.0:1789366541.667958:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1789366541.667966:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638b4f18e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8cde4528-5832-4854-a387-4adacc3dd0ab+17:3286:x1876286758738048:12345-0@lo:103: 00010000:00010000:0.0:1789366541.667973:0:5802:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789366541.667977:0:5802:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff963880031200/0x8da3486b955f2fb9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8da3486b955f2fb2 expref: 17 pid: 5811 timeout: 267 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366541.667986:0:5802:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff963880031200/0x8da3486b955f2fb9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x8da3486b955f2fb2 expref: 17 pid: 5811 timeout: 267 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366541.667995:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff963880031200/0x8da3486b955f2fb9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x8da3486b955f2fb2 expref: 17 pid: 5811 timeout: 267 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366541.668004:0:5802:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789366541.668031:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638b4f18e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8cde4528-5832-4854-a387-4adacc3dd0ab+16:3286:x1876286758738048:12345-0@lo:103: Request processed in 67us (914us total) trans 0 rc 0/0 00000100:00100000:0.0:1789366541.668038:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1789366541.668052:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1789366541.668056:0:3286:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9638b4f1b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8cde4528-5832-4854-a387-4adacc3dd0ab:3286:1876286758738048:0@lo:103: 00000100:00100000:0.0:1789366541.668064:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638b6ea1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8cde4528-5832-4854-a387-4adacc3dd0ab+15:3285:x1876286758738560:12345-0@lo:103: 00010000:00010000:0.0:1789366541.668073:0:5802:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789366541.668077:0:5802:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9638832d3e00/0x8da3486b955f2f81 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8da3486b955f2f7a expref: 15 pid: 5808 timeout: 267 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366541.668086:0:5802:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9638832d3e00/0x8da3486b955f2f81 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x8da3486b955f2f7a expref: 15 pid: 5808 timeout: 267 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366541.668095:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9638832d3e00/0x8da3486b955f2f81 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x8da3486b955f2f7a expref: 15 pid: 5808 timeout: 267 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366541.668113:0:5802:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789366541.668140:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638b6ea1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8cde4528-5832-4854-a387-4adacc3dd0ab+14:3285:x1876286758738560:12345-0@lo:103: Request processed in 81us (498us total) trans 0 rc 0/0 00000100:00100000:0.0:1789366541.668147:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1789366541.668163:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1789366541.668166:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9638b6ea2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8cde4528-5832-4854-a387-4adacc3dd0ab:3285:1876286758738560:0@lo:103: 00000100:00100000:0.0:1789366541.668173:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638b6ea3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8cde4528-5832-4854-a387-4adacc3dd0ab+13:3287:x1876286758738688:12345-0@lo:103: 00010000:00010000:0.0:1789366541.668181:0:5802:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789366541.668185:0:5802:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9638832d3800/0x8da3486b955f2f57 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8da3486b955f2f50 expref: 13 pid: 5808 timeout: 267 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366541.668194:0:5802:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9638832d3800/0x8da3486b955f2f57 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x8da3486b955f2f50 expref: 13 pid: 5808 timeout: 267 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366541.668204:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9638832d3800/0x8da3486b955f2f57 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x8da3486b955f2f50 expref: 13 pid: 5808 timeout: 267 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366541.668212:0:5802:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789366541.668253:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638b6ea3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8cde4528-5832-4854-a387-4adacc3dd0ab+12:3287:x1876286758738688:12345-0@lo:103: Request processed in 83us (545us total) trans 0 rc 0/0 00000100:00100000:0.0:1789366541.668259:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1789366541.668284:0:3287:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9638b6ea0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8cde4528-5832-4854-a387-4adacc3dd0ab:3287:1876286758738688:0@lo:103: 00010000:00010000:0.0:1789366541.668286:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789366541.668779:0:5805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789366541.669537:0:8414:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9638987e8e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8414:1876286758736768:192.168.202.23@tcp:104: 00000100:00100000:3.0:1789366541.670088:0:8414:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9638987e9c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8414:1876286758736896:192.168.202.23@tcp:104: 00010000:00010000:3.0:1789366541.670126:0:8414:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff96388148fa00/0x8da3486b955f305a lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789366541.670635:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:0.0:1789366541.670675:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751378944 00000100:00100000:0.0:1789366541.670681:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751378944 00010000:00010000:0.0:1789366541.670703:0:5802:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff963880030600/0x8da3486b955f3022 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.23@tcp remote: 0xda917a494d06be70 expref: 10 pid: 5811 timeout: 217 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789366541.670770:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 18 00000100:00100000:2.0:1789366541.670788:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96389861cc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:14a2847b-91d8-4d87-b71b-010443acc91a+10:2354:x1876286751378944:12345-192.168.202.23@tcp:103: 00000100:00100000:3.0:1789366541.670797:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00010000:00010000:2.0:1789366541.670800:0:5803:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789366541.670809:0:5803:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff963880030600/0x8da3486b955f3022 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.202.23@tcp remote: 0xda917a494d06be70 expref: 10 pid: 5811 timeout: 217 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366541.670822:0:5803:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff963880030600/0x8da3486b955f3022 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.202.23@tcp remote: 0xda917a494d06be70 expref: 10 pid: 5811 timeout: 217 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366541.670835:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff963880030600/0x8da3486b955f3022 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.202.23@tcp remote: 0xda917a494d06be70 expref: 10 pid: 5811 timeout: 217 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366541.670848:0:5803:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789366541.670860:0:5801:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:1.0:1789366541.670870:0:5801:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00000100:00100000:2.0:1789366541.670894:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96389861cc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:14a2847b-91d8-4d87-b71b-010443acc91a+9:2354:x1876286751378944:12345-192.168.202.23@tcp:103: Request processed in 114us (258us total) trans 0 rc 0/0 00000100:00100000:2.0:1789366541.670913:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 18 00000100:00100000:0.0:1789366541.670917:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751379072 00000100:00100000:0.0:1789366541.670923:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751379072 00010000:00010000:0.0:1789366541.670947:0:5802:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff963880030000/0x8da3486b955f301b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.202.23@tcp remote: 0xda917a494d06be69 expref: 9 pid: 5811 timeout: 217 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789366541.670980:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 19 00000100:00100000:2.0:1789366541.670986:0:5803:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:0.0:1789366541.670992:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638bf5ab480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:14a2847b-91d8-4d87-b71b-010443acc91a+9:2354:x1876286751379072:12345-192.168.202.23@tcp:103: 00010000:00010000:0.0:1789366541.671003:0:5802:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789366541.671008:0:5802:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff963880030000/0x8da3486b955f301b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.23@tcp remote: 0xda917a494d06be69 expref: 9 pid: 5811 timeout: 217 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366541.671020:0:5802:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff963880030000/0x8da3486b955f301b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.202.23@tcp remote: 0xda917a494d06be69 expref: 9 pid: 5811 timeout: 217 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366541.671031:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff963880030000/0x8da3486b955f301b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.202.23@tcp remote: 0xda917a494d06be69 expref: 9 pid: 5811 timeout: 217 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366541.671045:0:5802:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff96388148fa00/0x8da3486b955f305a lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366541.671054:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff96388148fa00/0x8da3486b955f305a lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366541.671065:0:5802:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff96388148fa00/0x8da3486b955f305a lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366541.671073:0:5802:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff96388148fa00/0x8da3486b955f305a lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366541.671081:0:5802:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff96388148fa00/0x8da3486b955f305a lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366541.671089:0:5802:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff96388148fa00/0x8da3486b955f305a lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366541.671101:0:5802:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96388148fa00 already unused, calling callback (ffffffffc16df520) 00010000:00010000:0.0:1789366541.671105:0:5802:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff96388148fa00/0x8da3486b955f305a lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366541.671113:0:5802:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff96388148fa00/0x8da3486b955f305a lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 8414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366541.671325:0:8414:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff96388148fa00/0x8da3486b955f305a lrc: 5/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366541.671326:0:5802:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff96388148fa00/0x8da3486b955f305a lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366541.671339:0:5802:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789366541.671349:0:8414:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff96388148fa00/0x8da3486b955f305a lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366541.671357:0:8414:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff96388148fa00/0x8da3486b955f305a lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789366541.671446:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638bf5ab480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:14a2847b-91d8-4d87-b71b-010443acc91a+8:2354:x1876286751379072:12345-192.168.202.23@tcp:103: Request processed in 456us (649us total) trans 0 rc 0/0 00000100:00100000:0.0:1789366541.671453:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 19 00010000:00010000:2.0:1789366542.200531:0:6675:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789366542.538580:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:3.0:1789366542.538750:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751379200 00000100:00100000:3.0:1789366542.538761:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751379200 00000100:00100000:3.0:1789366542.538821:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 121 00000100:00100000:3.0:1789366542.538831:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638b4e3a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:14a2847b-91d8-4d87-b71b-010443acc91a+8:2354:x1876286751379200:12345-192.168.202.23@tcp:400: 00000100:00100000:3.0:1789366542.538988:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638b4e3a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:14a2847b-91d8-4d87-b71b-010443acc91a+8:2354:x1876286751379200:12345-192.168.202.23@tcp:400: Request processed in 75us (334us total) trans 0 rc 0/0 00000100:00100000:3.0:1789366542.538996:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 121 00000100:00100000:2.0:1789366542.539139:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:0.0:1789366542.539200:0:7132:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751379328 00000100:00100000:0.0:1789366542.539210:0:7132:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751379328 00000100:00080000:1.0:1789366542.539303:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789366542.539321:0:7132:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 11 00000100:00100000:0.0:1789366542.539331:0:7132:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638b6ea1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0ab23baa-a205-44ad-bf17-f7b47295d82b+6:2354:x1876286751379328:12345-192.168.202.23@tcp:400: 00000100:00100000:0.0:1789366542.539382:0:7132:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638b6ea1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0ab23baa-a205-44ad-bf17-f7b47295d82b+6:2354:x1876286751379328:12345-192.168.202.23@tcp:400: Request processed in 52us (296us total) trans 0 rc 0/0 00000100:00100000:0.0:1789366542.539389:0:7132:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 11 00000100:00100000:2.0:1789366542.539508:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:1.0:1789366542.539633:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:3.0:1789366542.539692:0:8065:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751379584 00000100:00100000:3.0:1789366542.539697:0:8065:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751379584 00000100:00100000:2.0:1789366542.539764:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751379456 00000100:00100000:2.0:1789366542.539769:0:6660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751379456 00000100:00100000:3.0:1789366542.539786:0:8065:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 4 00000100:00100000:3.0:1789366542.539797:0:8065:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638b6ea3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0ab23baa-a205-44ad-bf17-f7b47295d82b+5:2355:x1876286751379584:12345-192.168.202.23@tcp:400: 00000100:00100000:2.0:1789366542.539808:0:6660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 5 00000100:00100000:2.0:1789366542.539818:0:6660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638b73cdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0ab23baa-a205-44ad-bf17-f7b47295d82b+5:2355:x1876286751379456:12345-192.168.202.23@tcp:400: 00000100:00100000:3.0:1789366542.539840:0:8065:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638b6ea3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0ab23baa-a205-44ad-bf17-f7b47295d82b+5:2355:x1876286751379584:12345-192.168.202.23@tcp:400: Request processed in 45us (333us total) trans 0 rc 0/0 00000100:00100000:3.0:1789366542.539849:0:8065:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 4 00000100:00100000:2.0:1789366542.539861:0:6660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638b73cdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0ab23baa-a205-44ad-bf17-f7b47295d82b+5:2355:x1876286751379456:12345-192.168.202.23@tcp:400: Request processed in 43us (227us total) trans 0 rc 0/0 00000100:00100000:2.0:1789366542.539869:0:6660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 5 00000100:00080000:1.0:1789366542.539975:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789366542.539988:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789366542.776095:0:3287:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9638b6ea0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3287:1876286758738816:0@lo:13: 10000000:01000000:3.0:1789366542.776112:0:5813:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1789366542.776117:0:5813:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff963883577000 from 39 10000000:01000000:3.0:1789366542.776121:0:5813:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1789366542.776170:0:5813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.123@tcp lock: ffff9638832d2c00/0x8da3486b955f3061 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789366542.776183:0:3287:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789366542.776185:0:5813:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.123@tcp lock: ffff9638832d2c00/0x8da3486b955f3061 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366542.776199:0:5813:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.123@tcp lock: ffff9638832d2c00/0x8da3486b955f3061 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789366542.776215:0:5813:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9638bf5ab800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8cde4528-5832-4854-a387-4adacc3dd0ab:5813:1876286758738944:0@lo:101: 00000100:00100000:2.0:1789366542.776289:0:6662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286758738816 00000100:00100000:2.0:1789366542.776297:0:6662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286758738816 00000100:00080000:1.0:1789366542.776339:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789366542.776359:0:6662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1789366542.776368:0:6662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638b4f1ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3287:x1876286758738816:12345-0@lo:13: 00002000:00000024:2.0:1789366542.776399:0:6662:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789366542.776456:0:6662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638b4f1ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3287:x1876286758738816:12345-0@lo:13: Request processed in 88us (274us total) trans 0 rc 0/0 00000100:00100000:2.0:1789366542.776465:0:6662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:0.0:1789366542.776493:0:3287:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9638b6ea0000 x1876286758738816/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789366558 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789366542.776511:0:3287:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9638b6ea0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3287:1876286758738816:0@lo:13: 00000100:00100000:3.0:1789366542.776586:0:5813:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789366542.776614:0:5813:0:(client.c:2716:ptlrpc_set_wait()) set ffff9637865bf3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789366542.776688:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286758738944 00000100:00100000:2.0:1789366542.776692:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286758738944 00000100:00100000:2.0:1789366542.776735:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:2.0:1789366542.776740:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638b4e3a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8cde4528-5832-4854-a387-4adacc3dd0ab+12:5813:x1876286758738944:12345-0@lo:101: 00010000:00010000:2.0:1789366542.776747:0:5808:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789366542.776757:0:5808:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9638a0740c00/0x8da3486b955f3068 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x8da3486b955f3061 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366542.776774:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9638a0740c00/0x8da3486b955f3068 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8da3486b955f3061 expref: 13 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366542.776792:0:5808:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9638a0740c00/0x8da3486b955f3068 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8da3486b955f3061 expref: 13 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366542.776799:0:5808:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9638a0740c00, rc 0) 00000100:00100000:2.0:1789366542.776830:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638b4e3a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8cde4528-5832-4854-a387-4adacc3dd0ab+13:5813:x1876286758738944:12345-0@lo:101: Request processed in 85us (240us total) trans 0 rc 0/0 00000100:00100000:2.0:1789366542.776836:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:3.0:1789366542.776861:0:5813:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9638bf5ab800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8cde4528-5832-4854-a387-4adacc3dd0ab:5813:1876286758738944:0@lo:101: 00010000:00010000:3.0:1789366542.776874:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.123@tcp lock: ffff9638832d2c00/0x8da3486b955f3061 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8da3486b955f3068 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366542.776885:0:5813:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.123@tcp lock: ffff9638832d2c00/0x8da3486b955f3061 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x8da3486b955f3068 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789366542.776930:0:5813:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9638bf5ab800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8cde4528-5832-4854-a387-4adacc3dd0ab:5813:1876286758739072:0@lo:501: 00000100:00100000:3.0:1789366542.776947:0:5813:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789366542.776968:0:5813:0:(client.c:2716:ptlrpc_set_wait()) set ffff9637865bf3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789366542.776983:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286758739072 00000100:00100000:0.0:1789366542.776988:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286758739072 00000100:00100000:0.0:1789366542.777016:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:0.0:1789366542.777021:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638b4e3b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8cde4528-5832-4854-a387-4adacc3dd0ab+13:5813:x1876286758739072:12345-0@lo:501: 00000100:00100000:0.0:1789366542.777239:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638b4e3b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8cde4528-5832-4854-a387-4adacc3dd0ab+13:5813:x1876286758739072:12345-0@lo:501: Request processed in 217us (290us total) trans 0 rc 0/0 00000100:00100000:0.0:1789366542.777247:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:3.0:1789366542.777283:0:5813:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9638bf5ab800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8cde4528-5832-4854-a387-4adacc3dd0ab:5813:1876286758739072:0@lo:501: 00000100:00100000:3.0:1789366542.777308:0:5813:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9638bf5ab800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8cde4528-5832-4854-a387-4adacc3dd0ab:5813:1876286758739200:0@lo:503: 00000100:00100000:3.0:1789366542.777347:0:5813:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789366542.777361:0:5813:0:(client.c:2716:ptlrpc_set_wait()) set ffff9637865bf3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789366542.777380:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286758739200 00000100:00100000:0.0:1789366542.777385:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286758739200 00000100:00100000:0.0:1789366542.777412:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:0.0:1789366542.777419:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638b4e39050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8cde4528-5832-4854-a387-4adacc3dd0ab+13:5813:x1876286758739200:12345-0@lo:503: 00000100:00100000:0.0:1789366542.777540:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638b4e39050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8cde4528-5832-4854-a387-4adacc3dd0ab+13:5813:x1876286758739200:12345-0@lo:503: Request processed in 121us (191us total) trans 0 rc 0/0 00000100:00100000:0.0:1789366542.777547:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:3.0:1789366542.777565:0:5813:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9638bf5ab800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8cde4528-5832-4854-a387-4adacc3dd0ab:5813:1876286758739200:0@lo:503: 00000100:00100000:3.0:1789366542.777867:0:8431:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9638bf5ab800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8cde4528-5832-4854-a387-4adacc3dd0ab:8431:1876286758739328:0@lo:502: 00000100:00100000:3.0:1789366542.777893:0:8431:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789366542.777918:0:8431:0:(client.c:2716:ptlrpc_set_wait()) set ffff9637865bf540 going to sleep for 11 seconds 00000100:00100000:2.0:1789366542.777932:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286758739328 00000100:00100000:2.0:1789366542.777936:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286758739328 00000100:00100000:2.0:1789366542.777958:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:2.0:1789366542.777964:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638b4e38850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8cde4528-5832-4854-a387-4adacc3dd0ab+13:8431:x1876286758739328:12345-0@lo:502: 00000100:00100000:2.0:1789366542.778111:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638b4e38850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8cde4528-5832-4854-a387-4adacc3dd0ab+13:8431:x1876286758739328:12345-0@lo:502: Request processed in 146us (215us total) trans 0 rc 0/0 00000100:00100000:2.0:1789366542.778118:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:3.0:1789366542.778180:0:8431:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9638bf5ab800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8cde4528-5832-4854-a387-4adacc3dd0ab:8431:1876286758739328:0@lo:502: 00000100:00100000:3.0:1789366542.778215:0:8431:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9638bf5ab800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8cde4528-5832-4854-a387-4adacc3dd0ab:8431:1876286758739456:0@lo:502: 00000100:00100000:3.0:1789366542.778277:0:8431:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789366542.778292:0:8431:0:(client.c:2716:ptlrpc_set_wait()) set ffff9637865bf540 going to sleep for 11 seconds 00000100:00100000:0.0:1789366542.778329:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286758739456 00000100:00100000:0.0:1789366542.778332:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286758739456 00000100:00100000:0.0:1789366542.778355:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:0.0:1789366542.778361:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638b4e38050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8cde4528-5832-4854-a387-4adacc3dd0ab+13:8431:x1876286758739456:12345-0@lo:502: 00000100:00100000:0.0:1789366542.778461:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638b4e38050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8cde4528-5832-4854-a387-4adacc3dd0ab+13:8431:x1876286758739456:12345-0@lo:502: Request processed in 100us (183us total) trans 0 rc 0/0 00000100:00100000:0.0:1789366542.778465:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:1.0:1789366542.778756:0:8431:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9638bf5ab800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8cde4528-5832-4854-a387-4adacc3dd0ab:8431:1876286758739456:0@lo:502: 00000040:00080000:1.0:1789366542.778775:0:8431:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:2.0:1789366542.778834:0:5813:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:2.0:1789366542.778851:0:5813:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.123@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1789366542.778857:0:5813:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.123@tcp lock: ffff9638832d2c00/0x8da3486b955f3061 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8da3486b955f3068 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366542.778864:0:5813:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.123@tcp lock: ffff9638832d2c00/0x8da3486b955f3061 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8da3486b955f3068 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789366542.778870:0:5813:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0001 10000000:01000000:2.0:1789366542.778871:0:5813:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 8 10000000:01000000:2.0:1789366542.778873:0:5813:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:2.0:1789366542.778889:0:5813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.123@tcp lock: ffff9638a0741600/0x8da3486b955f306f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366542.778902:0:5813:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.123@tcp lock: ffff9638a0741600/0x8da3486b955f306f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366542.778908:0:5813:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.123@tcp lock: ffff9638a0741600/0x8da3486b955f306f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789366542.778916:0:5813:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9638b6ea2a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8cde4528-5832-4854-a387-4adacc3dd0ab:5813:1876286758739584:0@lo:101: 00000100:00100000:2.0:1789366542.778933:0:5813:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789366542.778956:0:5813:0:(client.c:2716:ptlrpc_set_wait()) set ffff9638871669c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789366542.778968:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286758739584 00000100:00100000:1.0:1789366542.778973:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286758739584 00000100:00100000:1.0:1789366542.779003:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:1.0:1789366542.779011:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638987e6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8cde4528-5832-4854-a387-4adacc3dd0ab+13:5813:x1876286758739584:12345-0@lo:101: 00010000:00010000:1.0:1789366542.779018:0:5808:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789366542.779027:0:5808:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff96388148e200/0x8da3486b955f3076 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x8da3486b955f306f expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366542.779041:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff96388148e200/0x8da3486b955f3076 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8da3486b955f306f expref: 14 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366542.779048:0:5808:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff96388148e200/0x8da3486b955f3076 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8da3486b955f306f expref: 14 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366542.779053:0:5808:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96388148e200, rc 0) 00000100:00100000:1.0:1789366542.779078:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638987e6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8cde4528-5832-4854-a387-4adacc3dd0ab+14:5813:x1876286758739584:12345-0@lo:101: Request processed in 69us (144us total) trans 0 rc 0/0 00000100:00100000:1.0:1789366542.779084:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:2.0:1789366542.779106:0:5813:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9638b6ea2a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8cde4528-5832-4854-a387-4adacc3dd0ab:5813:1876286758739584:0@lo:101: 00010000:00010000:2.0:1789366542.779119:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.123@tcp lock: ffff9638a0741600/0x8da3486b955f306f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8da3486b955f3076 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366542.779127:0:5813:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.123@tcp lock: ffff9638a0741600/0x8da3486b955f306f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x8da3486b955f3076 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789366542.779154:0:5813:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9638b6ea2a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8cde4528-5832-4854-a387-4adacc3dd0ab:5813:1876286758739712:0@lo:501: 00000100:00100000:2.0:1789366542.779170:0:5813:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789366542.779241:0:5813:0:(client.c:2716:ptlrpc_set_wait()) set ffff9638871669c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789366542.779265:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286758739712 00000100:00100000:3.0:1789366542.779269:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286758739712 00000100:00100000:3.0:1789366542.779294:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:3.0:1789366542.779301:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638b4e84050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8cde4528-5832-4854-a387-4adacc3dd0ab+14:5813:x1876286758739712:12345-0@lo:501: 00000100:00100000:3.0:1789366542.779469:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638b4e84050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8cde4528-5832-4854-a387-4adacc3dd0ab+14:5813:x1876286758739712:12345-0@lo:501: Request processed in 168us (296us total) trans 0 rc 0/0 00000100:00100000:3.0:1789366542.779475:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:2.0:1789366542.780110:0:5813:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9638b6ea2a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8cde4528-5832-4854-a387-4adacc3dd0ab:5813:1876286758739712:0@lo:501: 00000100:00100000:2.0:1789366542.780136:0:5813:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9638b6ea2a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8cde4528-5832-4854-a387-4adacc3dd0ab:5813:1876286758739840:0@lo:503: 00000100:00100000:2.0:1789366542.780159:0:5813:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789366542.780185:0:5813:0:(client.c:2716:ptlrpc_set_wait()) set ffff9638871669c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789366542.780190:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286758739840 00000100:00100000:1.0:1789366542.780194:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286758739840 00000100:00100000:1.0:1789366542.780220:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:1.0:1789366542.780294:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638b4e85450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8cde4528-5832-4854-a387-4adacc3dd0ab+14:5813:x1876286758739840:12345-0@lo:503: 00000100:00100000:1.0:1789366542.780409:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638b4e85450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8cde4528-5832-4854-a387-4adacc3dd0ab+14:5813:x1876286758739840:12345-0@lo:503: Request processed in 183us (248us total) trans 0 rc 0/0 00000100:00100000:1.0:1789366542.780414:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:2.0:1789366542.780436:0:5813:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9638b6ea2a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8cde4528-5832-4854-a387-4adacc3dd0ab:5813:1876286758739840:0@lo:503: 00000100:00100000:2.0:1789366542.780658:0:8432:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9638b6ea2a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8cde4528-5832-4854-a387-4adacc3dd0ab:8432:1876286758739968:0@lo:502: 00000100:00100000:2.0:1789366542.780682:0:8432:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789366542.780697:0:8432:0:(client.c:2716:ptlrpc_set_wait()) set ffff963887166f00 going to sleep for 11 seconds 00000100:00100000:3.0:1789366542.780733:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286758739968 00000100:00100000:3.0:1789366542.780738:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286758739968 00000100:00100000:3.0:1789366542.780761:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:3.0:1789366542.780767:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638b4e84c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8cde4528-5832-4854-a387-4adacc3dd0ab+14:8432:x1876286758739968:12345-0@lo:502: 00000100:00100000:3.0:1789366542.780867:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638b4e84c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8cde4528-5832-4854-a387-4adacc3dd0ab+14:8432:x1876286758739968:12345-0@lo:502: Request processed in 99us (182us total) trans 0 rc 0/0 00000100:00100000:3.0:1789366542.780873:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:2.0:1789366542.780893:0:8432:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9638b6ea2a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8cde4528-5832-4854-a387-4adacc3dd0ab:8432:1876286758739968:0@lo:502: 00000020:01000000:2.0:1789366542.780911:0:8432:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789366542.780918:0:8432:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789366542.780920:0:8432:0:(obd_config.c:1563:class_process_config()) marker 25 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1789366542.780925:0:8432:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:2.0:1789366542.780942:0:8432:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9638b6ea2a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8cde4528-5832-4854-a387-4adacc3dd0ab:8432:1876286758740096:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789366542.780969:0:8432:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789366542.780985:0:8432:0:(client.c:2716:ptlrpc_set_wait()) set ffff963887166f00 going to sleep for 11 seconds 00000100:00100000:1.0:1789366542.781026:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286758740096 00000100:00100000:1.0:1789366542.781030:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286758740096 00000100:00100000:1.0:1789366542.782211:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:1.0:1789366542.782232:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638b4e85c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8cde4528-5832-4854-a387-4adacc3dd0ab+14:8432:x1876286758740096:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789366542.782371:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638b4e85c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8cde4528-5832-4854-a387-4adacc3dd0ab+14:8432:x1876286758740096:12345-0@lo:502:llog_process_th.0 Request processed in 151us (1399us total) trans 0 rc 0/0 00000100:00100000:1.0:1789366542.782377:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:2.0:1789366542.782406:0:8432:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9638b6ea2a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8cde4528-5832-4854-a387-4adacc3dd0ab:8432:1876286758740096:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1789366542.782428:0:8432:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789366542.782433:0:8432:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789366542.782435:0:8432:0:(obd_config.c:1563:class_process_config()) marker 25 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1789366542.782439:0:8432:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 11 count 11 00000020:01000000:3.0:1789366542.782703:0:5813:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 8-10 (rc=0) 10000000:01000000:3.0:1789366542.782742:0:5813:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.123@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:3.0:1789366542.782751:0:5813:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.123@tcp lock: ffff9638a0741600/0x8da3486b955f306f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8da3486b955f3076 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366542.782760:0:5813:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.123@tcp lock: ffff9638a0741600/0x8da3486b955f306f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8da3486b955f3076 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789366542.782778:0:5813:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1789366542.782781:0:5813:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff963885b46000 from 39 10000000:01000000:3.0:1789366542.782783:0:5813:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1789366542.782804:0:5813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.123@tcp lock: ffff9638832d2600/0x8da3486b955f307d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366542.782811:0:5813:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.123@tcp lock: ffff9638832d2600/0x8da3486b955f307d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366542.782820:0:5813:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.123@tcp lock: ffff9638832d2600/0x8da3486b955f307d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789366542.782833:0:5813:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9638bf5aa300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8cde4528-5832-4854-a387-4adacc3dd0ab:5813:1876286758740224:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789366542.782862:0:5813:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789366542.782893:0:5813:0:(client.c:2716:ptlrpc_set_wait()) set ffff9637865bfcc0 going to sleep for 11 seconds 00000100:00100000:0.0:1789366542.782966:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286758740224 00000100:00100000:0.0:1789366542.782971:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286758740224 00000100:00100000:0.0:1789366542.783006:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:0.0:1789366542.783013:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638b4e87850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8cde4528-5832-4854-a387-4adacc3dd0ab+14:5813:x1876286758740224:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789366542.783022:0:5811:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789366542.783034:0:5811:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9638827f6400/0x8da3486b955f3084 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x8da3486b955f307d expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366542.783054:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9638827f6400/0x8da3486b955f3084 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8da3486b955f307d expref: 15 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366542.783061:0:5811:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9638827f6400/0x8da3486b955f3084 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8da3486b955f307d expref: 15 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366542.783067:0:5811:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9638827f6400, rc 0) 00000100:00100000:0.0:1789366542.783132:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638b4e87850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8cde4528-5832-4854-a387-4adacc3dd0ab+15:5813:x1876286758740224:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 120us (270us total) trans 0 rc 0/0 00000100:00100000:0.0:1789366542.783137:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:3.0:1789366542.783177:0:5813:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9638bf5aa300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8cde4528-5832-4854-a387-4adacc3dd0ab:5813:1876286758740224:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789366542.783188:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.123@tcp lock: ffff9638832d2600/0x8da3486b955f307d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x8da3486b955f3084 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366542.783197:0:5813:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.123@tcp lock: ffff9638832d2600/0x8da3486b955f307d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x8da3486b955f3084 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789366542.783241:0:5813:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9638bf5aa300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8cde4528-5832-4854-a387-4adacc3dd0ab:5813:1876286758740352:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789366542.783260:0:5813:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789366542.783277:0:5813:0:(client.c:2716:ptlrpc_set_wait()) set ffff9637865bfcc0 going to sleep for 11 seconds 00000100:00100000:1.0:1789366542.783296:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286758740352 00000100:00100000:1.0:1789366542.783300:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286758740352 00000100:00100000:1.0:1789366542.783442:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:1.0:1789366542.783448:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638b4e87c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8cde4528-5832-4854-a387-4adacc3dd0ab+15:5813:x1876286758740352:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789366542.783637:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638b4e87c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8cde4528-5832-4854-a387-4adacc3dd0ab+15:5813:x1876286758740352:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 189us (374us total) trans 0 rc 0/0 00000100:00100000:1.0:1789366542.783642:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:3.0:1789366542.783663:0:5813:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9638bf5aa300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8cde4528-5832-4854-a387-4adacc3dd0ab:5813:1876286758740352:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789366542.783685:0:5813:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9638bf5aa300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8cde4528-5832-4854-a387-4adacc3dd0ab:5813:1876286758740480:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789366542.783712:0:5813:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789366542.784423:0:5813:0:(client.c:2716:ptlrpc_set_wait()) set ffff9637865bfcc0 going to sleep for 11 seconds 00000100:00100000:0.0:1789366542.784478:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286758740480 00000100:00100000:0.0:1789366542.784483:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286758740480 00000100:00100000:0.0:1789366542.784509:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:0.0:1789366542.784515:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638b4e86c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8cde4528-5832-4854-a387-4adacc3dd0ab+15:5813:x1876286758740480:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789366542.784679:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638b4e86c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8cde4528-5832-4854-a387-4adacc3dd0ab+15:5813:x1876286758740480:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 160us (961us total) trans 0 rc 0/0 00000100:00100000:0.0:1789366542.784687:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:3.0:1789366542.784755:0:5813:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9638bf5aa300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8cde4528-5832-4854-a387-4adacc3dd0ab:5813:1876286758740480:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789366542.785158:0:8433:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9638bf5aa300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8cde4528-5832-4854-a387-4adacc3dd0ab:8433:1876286758740608:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789366542.785197:0:8433:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789366542.785241:0:8433:0:(client.c:2716:ptlrpc_set_wait()) set ffff9637865bf540 going to sleep for 11 seconds 00000100:00100000:2.0:1789366542.785250:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286758740608 00000100:00100000:2.0:1789366542.785257:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286758740608 00000100:00100000:2.0:1789366542.785287:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:2.0:1789366542.785295:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638b4e84450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8cde4528-5832-4854-a387-4adacc3dd0ab+15:8433:x1876286758740608:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789366542.785491:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638b4e84450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8cde4528-5832-4854-a387-4adacc3dd0ab+15:8433:x1876286758740608:12345-0@lo:502:llog_process_th.0 Request processed in 196us (292us total) trans 0 rc 0/0 00000100:00100000:2.0:1789366542.785499:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:3.0:1789366542.785501:0:8433:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9638bf5aa300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8cde4528-5832-4854-a387-4adacc3dd0ab:8433:1876286758740608:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789366542.785538:0:8433:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9638bf5aa300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8cde4528-5832-4854-a387-4adacc3dd0ab:8433:1876286758740736:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789366542.785572:0:8433:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789366542.785624:0:8433:0:(client.c:2716:ptlrpc_set_wait()) set ffff9637865bf540 going to sleep for 11 seconds 00000100:00100000:0.0:1789366542.785650:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286758740736 00000100:00100000:0.0:1789366542.785653:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286758740736 00000100:00100000:0.0:1789366542.785677:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:0.0:1789366542.785681:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638b4e87050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8cde4528-5832-4854-a387-4adacc3dd0ab+15:8433:x1876286758740736:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789366542.785810:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638b4e87050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8cde4528-5832-4854-a387-4adacc3dd0ab+15:8433:x1876286758740736:12345-0@lo:502:llog_process_th.0 Request processed in 123us (232us total) trans 0 rc 0/0 00000100:00100000:0.0:1789366542.785817:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:3.0:1789366542.785842:0:8433:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9638bf5aa300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8cde4528-5832-4854-a387-4adacc3dd0ab:8433:1876286758740736:0@lo:502:llog_process_th.0 00000040:00080000:3.0:1789366542.785860:0:8433:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:0.0:1789366542.785971:0:5813:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:0.0:1789366542.785988:0:5813:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.123@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1789366542.786002:0:5813:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.123@tcp lock: ffff9638832d2600/0x8da3486b955f307d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x8da3486b955f3084 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366542.786012:0:5813:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.123@tcp lock: ffff9638832d2600/0x8da3486b955f307d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x8da3486b955f3084 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789366542.786021:0:5813:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:0.0:1789366542.786023:0:5813:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 11 10000000:01000000:0.0:1789366542.786026:0:5813:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:0.0:1789366542.786050:0:5813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.123@tcp lock: ffff9638827f7600/0x8da3486b955f308b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366542.786058:0:5813:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.123@tcp lock: ffff9638827f7600/0x8da3486b955f308b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366542.786067:0:5813:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.123@tcp lock: ffff9638827f7600/0x8da3486b955f308b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789366542.786077:0:5813:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9638b4f19c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8cde4528-5832-4854-a387-4adacc3dd0ab:5813:1876286758740864:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789366542.786105:0:5813:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789366542.786128:0:5813:0:(client.c:2716:ptlrpc_set_wait()) set ffff9638895c5a80 going to sleep for 11 seconds 00000100:00100000:3.0:1789366542.786135:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286758740864 00000100:00100000:3.0:1789366542.786139:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286758740864 00000100:00100000:3.0:1789366542.786169:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:3.0:1789366542.786176:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638b4e85850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8cde4528-5832-4854-a387-4adacc3dd0ab+15:5813:x1876286758740864:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789366542.786184:0:5811:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789366542.786195:0:5811:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9638832d3200/0x8da3486b955f3092 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x8da3486b955f308b expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366542.786213:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9638832d3200/0x8da3486b955f3092 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8da3486b955f308b expref: 16 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366542.786241:0:5811:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9638832d3200/0x8da3486b955f3092 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8da3486b955f308b expref: 16 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366542.786260:0:5811:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9638832d3200, rc 0) 00000100:00100000:3.0:1789366542.786297:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638b4e85850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8cde4528-5832-4854-a387-4adacc3dd0ab+16:5813:x1876286758740864:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 122us (190us total) trans 0 rc 0/0 00000100:00100000:3.0:1789366542.786304:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:0.0:1789366542.786367:0:5813:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9638b4f19c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8cde4528-5832-4854-a387-4adacc3dd0ab:5813:1876286758740864:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789366542.786396:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.123@tcp lock: ffff9638827f7600/0x8da3486b955f308b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x8da3486b955f3092 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366542.786405:0:5813:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.123@tcp lock: ffff9638827f7600/0x8da3486b955f308b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x8da3486b955f3092 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789366542.786458:0:5813:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9638b4f19c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8cde4528-5832-4854-a387-4adacc3dd0ab:5813:1876286758740992:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789366542.786490:0:5813:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789366542.786503:0:5813:0:(client.c:2716:ptlrpc_set_wait()) set ffff9638895c5a80 going to sleep for 11 seconds 00000100:00100000:1.0:1789366542.786524:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286758740992 00000100:00100000:1.0:1789366542.786530:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286758740992 00000100:00100000:1.0:1789366542.786554:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:1.0:1789366542.786561:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638b4e86450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8cde4528-5832-4854-a387-4adacc3dd0ab+16:5813:x1876286758740992:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789366542.786803:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638b4e86450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8cde4528-5832-4854-a387-4adacc3dd0ab+16:5813:x1876286758740992:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 243us (310us total) trans 0 rc 0/0 00000100:00100000:1.0:1789366542.786811:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:0.0:1789366542.786849:0:5813:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9638b4f19c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8cde4528-5832-4854-a387-4adacc3dd0ab:5813:1876286758740992:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789366542.786886:0:5813:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9638b4f19c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8cde4528-5832-4854-a387-4adacc3dd0ab:5813:1876286758741120:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789366542.786918:0:5813:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789366542.786936:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286758741120 00000100:00100000:0.0:1789366542.786939:0:5813:0:(client.c:2716:ptlrpc_set_wait()) set ffff9638895c5a80 going to sleep for 11 seconds 00000100:00100000:3.0:1789366542.786940:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286758741120 00000100:00100000:3.0:1789366542.786967:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:3.0:1789366542.786973:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638b4e86050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8cde4528-5832-4854-a387-4adacc3dd0ab+16:5813:x1876286758741120:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789366542.787121:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638b4e86050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8cde4528-5832-4854-a387-4adacc3dd0ab+16:5813:x1876286758741120:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 148us (203us total) trans 0 rc 0/0 00000100:00100000:3.0:1789366542.787128:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:0.0:1789366542.787325:0:5813:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9638b4f19c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8cde4528-5832-4854-a387-4adacc3dd0ab:5813:1876286758741120:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789366542.787589:0:8434:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9638b4f19c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8cde4528-5832-4854-a387-4adacc3dd0ab:8434:1876286758741248:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789366542.787624:0:8434:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789366542.787653:0:8434:0:(client.c:2716:ptlrpc_set_wait()) set ffff9638895c5240 going to sleep for 11 seconds 00000100:00100000:1.0:1789366542.787669:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286758741248 00000100:00100000:1.0:1789366542.787673:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286758741248 00000100:00100000:1.0:1789366542.787696:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:1.0:1789366542.787700:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638b4e86850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8cde4528-5832-4854-a387-4adacc3dd0ab+16:8434:x1876286758741248:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789366542.787852:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638b4e86850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8cde4528-5832-4854-a387-4adacc3dd0ab+16:8434:x1876286758741248:12345-0@lo:502:llog_process_th.0 Request processed in 150us (226us total) trans 0 rc 0/0 00000100:00100000:1.0:1789366542.787864:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:0.0:1789366542.787919:0:8434:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9638b4f19c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8cde4528-5832-4854-a387-4adacc3dd0ab:8434:1876286758741248:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1789366542.787940:0:8434:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789366542.787949:0:8434:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789366542.787951:0:8434:0:(obd_config.c:1563:class_process_config()) marker 27 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1789366542.787955:0:8434:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:0.0:1789366542.787972:0:8434:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9638b4f19c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8cde4528-5832-4854-a387-4adacc3dd0ab:8434:1876286758741376:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789366542.788001:0:8434:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789366542.788036:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286758741376 00000100:00100000:0.0:1789366542.788038:0:8434:0:(client.c:2716:ptlrpc_set_wait()) set ffff9638895c5240 going to sleep for 11 seconds 00000100:00100000:3.0:1789366542.788041:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286758741376 00000100:00100000:3.0:1789366542.788069:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:3.0:1789366542.788075:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638b4e87450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8cde4528-5832-4854-a387-4adacc3dd0ab+16:8434:x1876286758741376:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789366542.788172:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638b4e87450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8cde4528-5832-4854-a387-4adacc3dd0ab+16:8434:x1876286758741376:12345-0@lo:502:llog_process_th.0 Request processed in 96us (169us total) trans 0 rc 0/0 00000100:00100000:3.0:1789366542.788178:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:0.0:1789366542.788212:0:8434:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9638b4f19c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8cde4528-5832-4854-a387-4adacc3dd0ab:8434:1876286758741376:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1789366542.788298:0:8434:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789366542.788302:0:8434:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789366542.788304:0:8434:0:(obd_config.c:1563:class_process_config()) marker 27 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1789366542.788308:0:8434:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 14 count 14 00000020:01000000:2.0:1789366542.788377:0:5813:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 11-13 (rc=0) 10000000:01000000:2.0:1789366542.788399:0:5813:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.123@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:2.0:1789366542.788406:0:5813:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.123@tcp lock: ffff9638827f7600/0x8da3486b955f308b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x8da3486b955f3092 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366542.788414:0:5813:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.123@tcp lock: ffff9638827f7600/0x8da3486b955f308b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x8da3486b955f3092 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789366542.788426:0:5813:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1789366542.788428:0:5813:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff963884956000 from 39 10000000:01000000:2.0:1789366542.788430:0:5813:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1789366542.788448:0:5813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.123@tcp lock: ffff9638a0740400/0x8da3486b955f3099 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366542.788453:0:5813:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.123@tcp lock: ffff9638a0740400/0x8da3486b955f3099 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366542.788460:0:5813:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.123@tcp lock: ffff9638a0740400/0x8da3486b955f3099 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789366542.788469:0:5813:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9638b6ea2a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8cde4528-5832-4854-a387-4adacc3dd0ab:5813:1876286758741504:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789366542.788492:0:5813:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789366542.788513:0:5813:0:(client.c:2716:ptlrpc_set_wait()) set ffff9638871669c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789366542.788549:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286758741504 00000100:00100000:1.0:1789366542.788552:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286758741504 00000100:00100000:1.0:1789366542.788599:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:1.0:1789366542.788607:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638b4e85050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8cde4528-5832-4854-a387-4adacc3dd0ab+16:5813:x1876286758741504:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789366542.788615:0:5810:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789366542.788626:0:5810:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff96388148f600/0x8da3486b955f30a0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x8da3486b955f3099 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366542.788640:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff96388148f600/0x8da3486b955f30a0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8da3486b955f3099 expref: 17 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366542.788647:0:5810:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff96388148f600/0x8da3486b955f30a0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8da3486b955f3099 expref: 17 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366542.788652:0:5810:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96388148f600, rc 0) 00000100:00100000:1.0:1789366542.788680:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638b4e85050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8cde4528-5832-4854-a387-4adacc3dd0ab+17:5813:x1876286758741504:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 74us (186us total) trans 0 rc 0/0 00000100:00100000:1.0:1789366542.788687:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:0.0:1789366542.788703:0:5813:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9638b6ea2a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8cde4528-5832-4854-a387-4adacc3dd0ab:5813:1876286758741504:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789366542.788714:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.123@tcp lock: ffff9638a0740400/0x8da3486b955f3099 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x8da3486b955f30a0 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366542.788750:0:5813:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.123@tcp lock: ffff9638a0740400/0x8da3486b955f3099 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x8da3486b955f30a0 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789366542.788784:0:5813:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9638b4f19c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8cde4528-5832-4854-a387-4adacc3dd0ab:5813:1876286758741632:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789366542.788801:0:5813:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789366542.788842:0:5813:0:(client.c:2716:ptlrpc_set_wait()) set ffff9638895c5240 going to sleep for 11 seconds 00000100:00100000:3.0:1789366542.788883:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286758741632 00000100:00100000:3.0:1789366542.788887:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286758741632 00000100:00100000:3.0:1789366542.788915:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:3.0:1789366542.788920:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638b4e83450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8cde4528-5832-4854-a387-4adacc3dd0ab+17:5813:x1876286758741632:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789366542.789278:0:5813:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9638b4f19c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8cde4528-5832-4854-a387-4adacc3dd0ab:5813:1876286758741632:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789366542.789296:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638b4e83450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8cde4528-5832-4854-a387-4adacc3dd0ab+17:5813:x1876286758741632:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 291us (408us total) trans 0 rc 0/0 00000100:00100000:0.0:1789366542.789301:0:5813:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9638b4f19c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8cde4528-5832-4854-a387-4adacc3dd0ab:5813:1876286758741760:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789366542.789303:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:0.0:1789366542.789332:0:5813:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789366542.789351:0:5813:0:(client.c:2716:ptlrpc_set_wait()) set ffff9638895c5240 going to sleep for 11 seconds 00000100:00100000:1.0:1789366542.789422:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286758741760 00000100:00100000:1.0:1789366542.789426:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286758741760 00000100:00100000:1.0:1789366542.789447:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:1.0:1789366542.789452:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638b4e81050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8cde4528-5832-4854-a387-4adacc3dd0ab+17:5813:x1876286758741760:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789366542.789549:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638b4e81050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8cde4528-5832-4854-a387-4adacc3dd0ab+17:5813:x1876286758741760:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 96us (216us total) trans 0 rc 0/0 00000100:00100000:1.0:1789366542.789554:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:0.0:1789366542.789582:0:5813:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9638b4f19c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8cde4528-5832-4854-a387-4adacc3dd0ab:5813:1876286758741760:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789366542.789982:0:8435:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9638b6ea2a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8cde4528-5832-4854-a387-4adacc3dd0ab:8435:1876286758741888:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789366542.790009:0:8435:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789366542.790030:0:8435:0:(client.c:2716:ptlrpc_set_wait()) set ffff963887166900 going to sleep for 11 seconds 00000100:00100000:3.0:1789366542.790053:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286758741888 00000100:00100000:3.0:1789366542.790068:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286758741888 00000100:00100000:3.0:1789366542.790098:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:3.0:1789366542.790103:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638b4e80850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8cde4528-5832-4854-a387-4adacc3dd0ab+17:8435:x1876286758741888:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789366542.790354:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638b4e80850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8cde4528-5832-4854-a387-4adacc3dd0ab+17:8435:x1876286758741888:12345-0@lo:502:llog_process_th.0 Request processed in 250us (343us total) trans 0 rc 0/0 00000100:00100000:3.0:1789366542.790358:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:2.0:1789366542.790394:0:8435:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9638b6ea2a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8cde4528-5832-4854-a387-4adacc3dd0ab:8435:1876286758741888:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789366542.790433:0:8435:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9638b6ea2a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8cde4528-5832-4854-a387-4adacc3dd0ab:8435:1876286758742016:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789366542.790464:0:8435:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789366542.790486:0:8435:0:(client.c:2716:ptlrpc_set_wait()) set ffff963887166900 going to sleep for 11 seconds 00000100:00100000:1.0:1789366542.790507:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286758742016 00000100:00100000:1.0:1789366542.790519:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286758742016 00000100:00100000:1.0:1789366542.790543:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:1.0:1789366542.790548:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638b4e80050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8cde4528-5832-4854-a387-4adacc3dd0ab+17:8435:x1876286758742016:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789366542.790668:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638b4e80050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8cde4528-5832-4854-a387-4adacc3dd0ab+17:8435:x1876286758742016:12345-0@lo:502:llog_process_th.0 Request processed in 119us (203us total) trans 0 rc 0/0 00000100:00100000:1.0:1789366542.790676:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:2.0:1789366542.790700:0:8435:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9638b6ea2a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8cde4528-5832-4854-a387-4adacc3dd0ab:8435:1876286758742016:0@lo:502:llog_process_th.0 00000040:00080000:2.0:1789366542.790740:0:8435:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:0.0:1789366542.790794:0:5813:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:0.0:1789366542.790811:0:5813:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.123@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1789366542.790819:0:5813:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.123@tcp lock: ffff9638a0740400/0x8da3486b955f3099 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x8da3486b955f30a0 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366542.790829:0:5813:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.123@tcp lock: ffff9638a0740400/0x8da3486b955f3099 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x8da3486b955f30a0 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789366542.790850:0:5813:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:0.0:1789366542.790853:0:5813:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 34 10000000:01000000:0.0:1789366542.790856:0:5813:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:0.0:1789366542.790876:0:5813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.123@tcp lock: ffff9638827f6c00/0x8da3486b955f30a7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366542.790883:0:5813:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.123@tcp lock: ffff9638827f6c00/0x8da3486b955f30a7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366542.790896:0:5813:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.123@tcp lock: ffff9638827f6c00/0x8da3486b955f30a7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789366542.790908:0:5813:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9638b4f19c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8cde4528-5832-4854-a387-4adacc3dd0ab:5813:1876286758742144:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789366542.790932:0:5813:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789366542.790955:0:5813:0:(client.c:2716:ptlrpc_set_wait()) set ffff9638895c5240 going to sleep for 11 seconds 00000100:00100000:3.0:1789366542.790967:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286758742144 00000100:00100000:3.0:1789366542.790972:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286758742144 00000100:00100000:3.0:1789366542.791001:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:3.0:1789366542.791009:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638b4e81450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8cde4528-5832-4854-a387-4adacc3dd0ab+17:5813:x1876286758742144:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789366542.791017:0:5811:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789366542.791029:0:5811:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9638832d2e00/0x8da3486b955f30ae lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x8da3486b955f30a7 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366542.791046:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9638832d2e00/0x8da3486b955f30ae lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8da3486b955f30a7 expref: 18 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366542.791055:0:5811:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9638832d2e00/0x8da3486b955f30ae lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8da3486b955f30a7 expref: 18 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366542.791062:0:5811:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9638832d2e00, rc 0) 00000100:00100000:3.0:1789366542.791096:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638b4e81450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8cde4528-5832-4854-a387-4adacc3dd0ab+18:5813:x1876286758742144:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 89us (163us total) trans 0 rc 0/0 00000100:00100000:3.0:1789366542.791102:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:0.0:1789366542.791175:0:5813:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9638b4f19c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8cde4528-5832-4854-a387-4adacc3dd0ab:5813:1876286758742144:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789366542.791196:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.123@tcp lock: ffff9638827f6c00/0x8da3486b955f30a7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x8da3486b955f30ae expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366542.791204:0:5813:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.123@tcp lock: ffff9638827f6c00/0x8da3486b955f30a7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x8da3486b955f30ae expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789366542.791262:0:5813:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9638b4f19c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8cde4528-5832-4854-a387-4adacc3dd0ab:5813:1876286758742272:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789366542.791285:0:5813:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789366542.791340:0:5813:0:(client.c:2716:ptlrpc_set_wait()) set ffff9638895c5240 going to sleep for 11 seconds 00000100:00100000:1.0:1789366542.791444:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286758742272 00000100:00100000:1.0:1789366542.791449:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286758742272 00000100:00100000:1.0:1789366542.791474:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:1.0:1789366542.791481:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638b4e80c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8cde4528-5832-4854-a387-4adacc3dd0ab+18:5813:x1876286758742272:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789366542.791663:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638b4e80c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8cde4528-5832-4854-a387-4adacc3dd0ab+18:5813:x1876286758742272:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 182us (377us total) trans 0 rc 0/0 00000100:00100000:1.0:1789366542.791668:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:0.0:1789366542.791696:0:5813:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9638b4f19c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8cde4528-5832-4854-a387-4adacc3dd0ab:5813:1876286758742272:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789366542.791751:0:5813:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9638b4f19c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8cde4528-5832-4854-a387-4adacc3dd0ab:5813:1876286758742400:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789366542.791793:0:5813:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789366542.791823:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286758742400 00000100:00100000:0.0:1789366542.791827:0:5813:0:(client.c:2716:ptlrpc_set_wait()) set ffff9638895c5240 going to sleep for 11 seconds 00000100:00100000:3.0:1789366542.791847:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286758742400 00000100:00100000:2.0:1789366542.791903:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:2.0:1789366542.791911:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638b4e81c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8cde4528-5832-4854-a387-4adacc3dd0ab+18:5813:x1876286758742400:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789366542.792015:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638b4e81c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8cde4528-5832-4854-a387-4adacc3dd0ab+18:5813:x1876286758742400:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 106us (224us total) trans 0 rc 0/0 00000100:00100000:2.0:1789366542.792021:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:0.0:1789366542.792041:0:5813:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9638b4f19c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8cde4528-5832-4854-a387-4adacc3dd0ab:5813:1876286758742400:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789366542.792379:0:8436:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9638b4f19c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8cde4528-5832-4854-a387-4adacc3dd0ab:8436:1876286758742528:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789366542.792421:0:8436:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789366542.792437:0:8436:0:(client.c:2716:ptlrpc_set_wait()) set ffff9638895c53c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789366542.792467:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286758742528 00000100:00100000:1.0:1789366542.792472:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286758742528 00000100:00100000:1.0:1789366542.792504:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:1.0:1789366542.792512:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638b4e83850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8cde4528-5832-4854-a387-4adacc3dd0ab+18:8436:x1876286758742528:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789366542.792660:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638b4e83850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8cde4528-5832-4854-a387-4adacc3dd0ab+18:8436:x1876286758742528:12345-0@lo:502:llog_process_th.0 Request processed in 149us (237us total) trans 0 rc 0/0 00000100:00100000:1.0:1789366542.792668:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:0.0:1789366542.792679:0:8436:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9638b4f19c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8cde4528-5832-4854-a387-4adacc3dd0ab:8436:1876286758742528:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1789366542.792701:0:8436:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789366542.792710:0:8436:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789366542.792712:0:8436:0:(obd_config.c:1563:class_process_config()) marker 26 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1789366542.792778:0:8436:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:0.0:1789366542.792797:0:8436:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9638b4f19c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8cde4528-5832-4854-a387-4adacc3dd0ab:8436:1876286758742656:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789366542.792823:0:8436:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789366542.792856:0:8436:0:(client.c:2716:ptlrpc_set_wait()) set ffff9638895c5a80 going to sleep for 11 seconds 00000100:00100000:2.0:1789366542.792860:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286758742656 00000100:00100000:2.0:1789366542.792866:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286758742656 00000100:00100000:2.0:1789366542.792894:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:2.0:1789366542.792906:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638b4e83c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8cde4528-5832-4854-a387-4adacc3dd0ab+18:8436:x1876286758742656:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789366542.793036:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638b4e83c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8cde4528-5832-4854-a387-4adacc3dd0ab+18:8436:x1876286758742656:12345-0@lo:502:llog_process_th.0 Request processed in 135us (211us total) trans 0 rc 0/0 00000100:00100000:2.0:1789366542.793044:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:0.0:1789366542.793057:0:8436:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9638b4f19c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8cde4528-5832-4854-a387-4adacc3dd0ab:8436:1876286758742656:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1789366542.793076:0:8436:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789366542.793080:0:8436:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789366542.793082:0:8436:0:(obd_config.c:1563:class_process_config()) marker 26 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1789366542.793085:0:8436:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 37 count 37 00000020:01000000:2.0:1789366542.793149:0:5813:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 34-36 (rc=0) 10000000:01000000:2.0:1789366542.793169:0:5813:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.123@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:2.0:1789366542.793185:0:5813:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.123@tcp lock: ffff9638827f6c00/0x8da3486b955f30a7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x8da3486b955f30ae expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366542.793194:0:5813:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.123@tcp lock: ffff9638827f6c00/0x8da3486b955f30a7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x8da3486b955f30ae expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789366542.793204:0:5813:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:2.0:1789366542.793206:0:5813:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff963882f5cd40 from 1 10000000:01000000:2.0:1789366542.793209:0:5813:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1789366542.793240:0:5813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.123@tcp lock: ffff9638a0741400/0x8da3486b955f30b5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366542.793248:0:5813:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.123@tcp lock: ffff9638a0741400/0x8da3486b955f30b5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366542.793256:0:5813:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.123@tcp lock: ffff9638a0741400/0x8da3486b955f30b5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789366542.793276:0:5813:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9638b6ea2a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8cde4528-5832-4854-a387-4adacc3dd0ab:5813:1876286758742784:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789366542.793303:0:5813:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789366542.793322:0:5813:0:(client.c:2716:ptlrpc_set_wait()) set ffff963887166e40 going to sleep for 11 seconds 00000100:00100000:3.0:1789366542.793343:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286758742784 00000100:00100000:3.0:1789366542.793349:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286758742784 00000100:00100000:3.0:1789366542.793380:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:3.0:1789366542.793386:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638b4e82c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8cde4528-5832-4854-a387-4adacc3dd0ab+18:5813:x1876286758742784:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789366542.793393:0:5811:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789366542.793402:0:5811:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9638832d2800/0x8da3486b955f30bc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x8da3486b955f30b5 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366542.793417:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9638832d2800/0x8da3486b955f30bc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8da3486b955f30b5 expref: 19 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366542.793424:0:5811:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9638832d2800/0x8da3486b955f30bc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8da3486b955f30b5 expref: 19 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366542.793429:0:5811:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9638832d2800, rc 0) 00000100:00100000:3.0:1789366542.793453:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638b4e82c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8cde4528-5832-4854-a387-4adacc3dd0ab+19:5813:x1876286758742784:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 68us (150us total) trans 0 rc 0/0 00000100:00100000:3.0:1789366542.793457:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:2.0:1789366542.793482:0:5813:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9638b6ea2a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8cde4528-5832-4854-a387-4adacc3dd0ab:5813:1876286758742784:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789366542.793495:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.123@tcp lock: ffff9638a0741400/0x8da3486b955f30b5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x8da3486b955f30bc expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366542.793504:0:5813:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.123@tcp lock: ffff9638a0741400/0x8da3486b955f30b5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x8da3486b955f30bc expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789366542.793541:0:5813:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9638b6ea2a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8cde4528-5832-4854-a387-4adacc3dd0ab:5813:1876286758742912:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789366542.793565:0:5813:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789366542.793597:0:5813:0:(client.c:2716:ptlrpc_set_wait()) set ffff963887166e40 going to sleep for 11 seconds 00000100:00100000:0.0:1789366542.793602:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286758742912 00000100:00100000:0.0:1789366542.793608:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286758742912 00000100:00100000:0.0:1789366542.793636:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:0.0:1789366542.793642:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638b4e80450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8cde4528-5832-4854-a387-4adacc3dd0ab+19:5813:x1876286758742912:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789366542.793787:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638b4e80450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8cde4528-5832-4854-a387-4adacc3dd0ab+19:5813:x1876286758742912:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 146us (221us total) trans 0 rc -2/-2 00000100:00100000:0.0:1789366542.793793:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:2.0:1789366542.793817:0:5813:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9638b6ea2a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8cde4528-5832-4854-a387-4adacc3dd0ab:5813:1876286758742912:0@lo:501:ll_cfg_requeue.0 10000000:01000000:2.0:1789366542.793841:0:5813:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.123@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1789366542.793847:0:5813:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.123@tcp lock: ffff9638a0741400/0x8da3486b955f30b5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x8da3486b955f30bc expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366542.793854:0:5813:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.123@tcp lock: ffff9638a0741400/0x8da3486b955f30b5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x8da3486b955f30bc expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366543.224392:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789366544.248067:0:5805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789366545.228055:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:3.0:1789366545.228141:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751379712 00000100:00100000:3.0:1789366545.228151:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751379712 00000100:00100000:3.0:1789366545.228228:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 154 00000100:00100000:3.0:1789366545.228240:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638b4e83050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:14a2847b-91d8-4d87-b71b-010443acc91a+8:5583:x1876286751379712:12345-192.168.202.23@tcp:101: 00010000:00010000:3.0:1789366545.228258:0:5811:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789366545.228276:0:5811:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9638832d3800/0x8da3486b955f30c3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0xda917a494d06bed2 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366545.228310:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9638832d3800/0x8da3486b955f30c3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.202.23@tcp remote: 0xda917a494d06bed2 expref: 9 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366545.228323:0:5811:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9638832d3800/0x8da3486b955f30c3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.202.23@tcp remote: 0xda917a494d06bed2 expref: 9 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366545.228350:0:5811:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9638832d3800, rc 0) 00000100:00100000:3.0:1789366545.228411:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638b4e83050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:14a2847b-91d8-4d87-b71b-010443acc91a+9:5583:x1876286751379712:12345-192.168.202.23@tcp:101: Request processed in 173us (364us total) trans 0 rc 0/0 00000100:00100000:3.0:1789366545.228418:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 154 00000100:00100000:3.0:1789366545.231714:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:1.0:1789366545.232010:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751379840 00000100:00100000:1.0:1789366545.232020:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751379840 00000100:00100000:1.0:1789366545.232080:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 155 00000100:00100000:1.0:1789366545.232091:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638b4e81850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:14a2847b-91d8-4d87-b71b-010443acc91a+9:5583:x1876286751379840:12345-192.168.202.23@tcp:501: 00000100:00100000:1.0:1789366545.238270:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638b4e81850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:14a2847b-91d8-4d87-b71b-010443acc91a+9:5583:x1876286751379840:12345-192.168.202.23@tcp:501: Request processed in 6170us (6553us total) trans 0 rc 0/0 00000100:00100000:1.0:1789366545.238298:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 155 00000100:00100000:1.0:1789366545.241273:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:3.0:1789366545.241383:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751379968 00000100:00100000:3.0:1789366545.241393:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751379968 00000100:00100000:3.0:1789366545.241494:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 156 00000100:00100000:3.0:1789366545.241504:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638b4e82450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:14a2847b-91d8-4d87-b71b-010443acc91a+9:5583:x1876286751379968:12345-192.168.202.23@tcp:503: 00000100:00100000:3.0:1789366545.241779:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638b4e82450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:14a2847b-91d8-4d87-b71b-010443acc91a+9:5583:x1876286751379968:12345-192.168.202.23@tcp:503: Request processed in 275us (513us total) trans 0 rc 0/0 00000100:00100000:3.0:1789366545.241787:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 156 00000100:00100000:2.0:1789366545.245591:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:1.0:1789366545.245671:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751380096 00000100:00100000:1.0:1789366545.245685:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751380096 00000100:00100000:1.0:1789366545.245796:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 157 00000100:00100000:1.0:1789366545.245809:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638b4e82050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:14a2847b-91d8-4d87-b71b-010443acc91a+9:6065:x1876286751380096:12345-192.168.202.23@tcp:502: 00000100:00100000:1.0:1789366545.246138:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638b4e82050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:14a2847b-91d8-4d87-b71b-010443acc91a+9:6065:x1876286751380096:12345-192.168.202.23@tcp:502: Request processed in 330us (558us total) trans 0 rc 0/0 00000100:00100000:1.0:1789366545.246147:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 157 00000100:00100000:1.0:1789366545.247476:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:3.0:1789366545.247538:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751380224 00000100:00100000:3.0:1789366545.247550:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751380224 00000100:00100000:3.0:1789366545.247592:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 158 00000100:00100000:3.0:1789366545.247599:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638b4e82850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:14a2847b-91d8-4d87-b71b-010443acc91a+9:6065:x1876286751380224:12345-192.168.202.23@tcp:502:llog_process_th.0 00000100:00100000:3.0:1789366545.247765:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638b4e82850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:14a2847b-91d8-4d87-b71b-010443acc91a+9:6065:x1876286751380224:12345-192.168.202.23@tcp:502:llog_process_th.0 Request processed in 165us (290us total) trans 0 rc 0/0 00000100:00100000:3.0:1789366545.247772:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 158 00000100:00100000:2.0:1789366545.249691:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:1.0:1789366545.249797:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751380352 00000100:00100000:1.0:1789366545.249806:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751380352 00000100:00100000:1.0:1789366545.249860:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 159 00000100:00100000:1.0:1789366545.249874:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638b4e3cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:14a2847b-91d8-4d87-b71b-010443acc91a+9:5583:x1876286751380352:12345-192.168.202.23@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789366545.249903:0:5810:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789366545.249924:0:5810:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff96388148fe00/0x8da3486b955f30ca lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0xda917a494d06bed9 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366545.249954:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff96388148fe00/0x8da3486b955f30ca lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.202.23@tcp remote: 0xda917a494d06bed9 expref: 10 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366545.249966:0:5810:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff96388148fe00/0x8da3486b955f30ca lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.202.23@tcp remote: 0xda917a494d06bed9 expref: 10 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366545.249975:0:5810:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96388148fe00, rc 0) 00000100:00100000:1.0:1789366545.250038:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638b4e3cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:14a2847b-91d8-4d87-b71b-010443acc91a+10:5583:x1876286751380352:12345-192.168.202.23@tcp:101:ll_cfg_requeue.0 Request processed in 166us (353us total) trans 0 rc 0/0 00000100:00100000:1.0:1789366545.250061:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 159 00000100:00100000:2.0:1789366545.255363:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:0.0:1789366545.255438:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751380480 00000100:00100000:0.0:1789366545.255447:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751380480 00000100:00100000:0.0:1789366545.255549:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 160 00000100:00100000:0.0:1789366545.255564:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638b4e3dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:14a2847b-91d8-4d87-b71b-010443acc91a+10:5583:x1876286751380480:12345-192.168.202.23@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789366545.255871:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638b4e3dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:14a2847b-91d8-4d87-b71b-010443acc91a+10:5583:x1876286751380480:12345-192.168.202.23@tcp:501:ll_cfg_requeue.0 Request processed in 312us (514us total) trans 0 rc -2/-2 00000100:00100000:0.0:1789366545.255896:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 160 00010000:00010000:2.0:1789366545.272004:0:6675:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789366545.336187:0:3286:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9638b4f19f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3286:1876286758743296:0@lo:400:kworker.0 00000100:00100000:0.0:1789366545.336283:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789366545.336286:0:3287:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9638b4f18700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3287:1876286758743424:0@lo:400:kworker.0 00000100:00100000:0.0:1789366545.336351:0:3286:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9638bf5aa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3286:1876286758743808:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789366545.336435:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9638b4f19880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3285:1876286758743168:0@lo:400:kworker.0 00000100:00100000:1.0:1789366545.336506:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9638b4f19c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8cde4528-5832-4854-a387-4adacc3dd0ab:3284:1876286758743040:0@lo:400:kworker.0 00000100:00100000:0.0:1789366545.337415:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789366545.337463:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286758743296 00000100:00100000:0.0:1789366545.337470:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286758743296 00000100:00100000:0.0:1789366545.337523:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1789366545.337533:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638b4f1aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3286:x1876286758743296:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789366545.337580:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638b4f1aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3286:x1876286758743296:12345-0@lo:400:kworker.0 Request processed in 49us (1297us total) trans 0 rc 0/0 00000100:00100000:0.0:1789366545.337587:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1789366545.337608:0:7134:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286758743808 00000100:00100000:0.0:1789366545.337611:0:7134:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286758743808 00000100:00100000:0.0:1789366545.337633:0:7134:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1789366545.337639:0:7134:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638b4f1a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3286:x1876286758743808:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789366545.337664:0:7134:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789366545.337691:0:7134:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638b4f1a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3286:x1876286758743808:12345-0@lo:13:osp-pre-1-0.0 Request processed in 52us (277us total) trans 0 rc 0/0 00000100:00100000:0.0:1789366545.337697:0:7134:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00080000:0.0:1789366545.337747:0:3286:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9638bf5aa300 x1876286758743808/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789366561 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789366545.337765:0:3286:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9638bf5aa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3286:1876286758743808:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789366545.337777:0:3286:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9638b4f19f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3286:1876286758743296:0@lo:400:kworker.0 00000100:00080000:0.0:1789366545.337828:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789366545.337832:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789366545.339307:0:3287:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789366545.339427:0:8065:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286758743424 00000100:00100000:0.0:1789366545.339433:0:8065:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286758743424 00000100:00100000:0.0:1789366545.339519:0:8065:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1789366545.339528:0:8065:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638bf5aa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3287:x1876286758743424:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789366545.339571:0:8065:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638bf5aa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3287:x1876286758743424:12345-0@lo:400:kworker.0 Request processed in 45us (266us total) trans 0 rc 0/0 00000100:00100000:0.0:1789366545.339578:0:8065:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00080000:3.0:1789366545.339627:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1789366545.339652:0:3287:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9638b4f18700 x1876286758743424/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789366561 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789366545.339681:0:3287:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9638b4f18700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3287:1876286758743424:0@lo:400:kworker.0 00000100:00100000:2.0:1789366545.342946:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789366545.342946:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789366545.343004:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9638b4f18e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3284:1876286758743552:0@lo:400:kworker.0 00000100:00100000:2.0:1789366545.343007:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9638b4f1b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3285:1876286758743680:0@lo:400:kworker.0 00000100:00100000:1.0:1789366545.343045:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789366545.343066:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789366545.343117:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286758743680 00000100:00100000:1.0:1789366545.343125:0:6660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286758743680 00000100:00100000:1.0:1789366545.343178:0:6660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1789366545.343186:0:6660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638b6ea0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3285:x1876286758743680:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789366545.343248:0:6660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638b6ea0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3285:x1876286758743680:12345-0@lo:400:kworker.0 Request processed in 62us (182us total) trans 0 rc 0/0 00000100:00100000:1.0:1789366545.343255:0:6660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1789366545.343330:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286758743168 00000100:00100000:0.0:1789366545.343335:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286758743168 00000100:00100000:0.0:1789366545.343368:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286758743552 00000100:00100000:0.0:1789366545.343371:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286758743552 00000100:00100000:0.0:1789366545.343400:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1789366545.343407:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638b6ea2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3285:x1876286758743168:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789366545.343440:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638b6ea2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3285:x1876286758743168:12345-0@lo:400:kworker.0 Request processed in 33us (498us total) trans 0 rc 0/0 00000100:00100000:0.0:1789366545.343446:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1789366545.343458:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1789366545.343464:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638b73cfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3284:x1876286758743552:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789366545.343488:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638b73cfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3284:x1876286758743552:12345-0@lo:400:kworker.0 Request processed in 25us (445us total) trans 0 rc 0/0 00000100:00100000:0.0:1789366545.343494:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1789366545.343512:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286758743040 00000100:00100000:0.0:1789366545.343515:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286758743040 00000100:00100000:0.0:1789366545.343534:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:0.0:1789366545.343541:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638b4e3f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8cde4528-5832-4854-a387-4adacc3dd0ab+19:3284:x1876286758743040:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789366545.343583:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638b4e3f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8cde4528-5832-4854-a387-4adacc3dd0ab+19:3284:x1876286758743040:12345-0@lo:400:kworker.0 Request processed in 42us (647us total) trans 0 rc 0/0 00000100:00100000:0.0:1789366545.343590:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00080000:3.0:1789366545.343674:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789366545.343760:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9638b4f19880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3285:1876286758743168:0@lo:400:kworker.0 00010000:00080000:2.0:1789366545.343774:0:3285:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9638b4f1b800 x1876286758743680/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789366561 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789366545.343784:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9638b4f1b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3285:1876286758743680:0@lo:400:kworker.0 00000100:00100000:1.0:1789366545.343930:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9638b4f19c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8cde4528-5832-4854-a387-4adacc3dd0ab:3284:1876286758743040:0@lo:400:kworker.0 00000100:00100000:1.0:1789366545.343941:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9638b4f18e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3284:1876286758743552:0@lo:400:kworker.0 00010000:00010000:1.0:1789366546.304608:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1789366546.528075:0:8476:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffd411bca10 20000000:00000080:1.0:1789366546.528091:0:8476:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff963883296400 uarg=0000000000000000 20000000:01000000:1.0:1789366546.528125:0:8476:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:1.0:1789366546.528130:0:8476:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:1.0:1789366546.528134:0:8476:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:3.0:1789366546.529030:0:8477:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 20000000:02000000:1.0:1789366546.529159:0:8476:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter general.lod.*.mdt_hash=crush in log params 00000040:00080000:1.0:1789366546.531350:0:8476:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8976 00000040:00080000:1.0:1789366546.531395:0:8476:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 112 off9088 00000040:00080000:1.0:1789366546.531438:0:8476:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 224 off9312 10000000:01000000:1.0:1789366546.531452:0:8476:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1789366546.531469:0:8476:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff96388148e400/0x8da3486b955f30d1 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366546.531491:0:8476:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9638827f6600/0x8da3486b955f2e9a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8da3486b955f2e93 expref: 18 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366546.531499:0:8476:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9638832d2000/0x8da3486b955f2f18 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8da3486b955f2f11 expref: 18 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366546.531506:0:8476:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9638a0740a00/0x8da3486b955f2f73 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8da3486b955f2f6c expref: 18 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366546.531515:0:8476:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff96388148f400/0x8da3486b955f3030 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.202.23@tcp remote: 0xda917a494d06bea1 expref: 9 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366546.531522:0:8476:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff96388148e400/0x8da3486b955f30d1 lrc: 7/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366546.531555:0:8476:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff96388148f400/0x8da3486b955f3030 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 192.168.202.23@tcp remote: 0xda917a494d06bea1 expref: 9 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366546.531568:0:8476:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff96388148f400/0x8da3486b955f3030 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 192.168.202.23@tcp remote: 0xda917a494d06bea1 expref: 9 pid: 5810 timeout: 221 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789366546.531582:0:8476:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9638b73cd880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8476:1876286758743936:192.168.202.23@tcp:104: 00010000:00010000:1.0:1789366546.531681:0:8476:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9638a0740a00/0x8da3486b955f2f73 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x8da3486b955f2f6c expref: 18 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366546.531690:0:8476:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9638a0740a00/0x8da3486b955f2f73 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x8da3486b955f2f6c expref: 18 pid: 5810 timeout: 271 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789366546.531699:0:8476:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9638b73cc700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8476:1876286758744064:0@lo:104: 00000100:00100000:1.0:1789366546.531759:0:8476:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789366546.532087:0:8476:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9638832d2000/0x8da3486b955f2f18 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x8da3486b955f2f11 expref: 18 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366546.532095:0:8476:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9638832d2000/0x8da3486b955f2f18 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x8da3486b955f2f11 expref: 18 pid: 5808 timeout: 271 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789366546.532104:0:8476:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9638b73cca80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8476:1876286758744192:0@lo:104: 00000100:00100000:1.0:1789366546.532122:0:8476:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789366546.532187:0:8476:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9638827f6600/0x8da3486b955f2e9a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x8da3486b955f2e93 expref: 18 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366546.532205:0:8476:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9638827f6600/0x8da3486b955f2e9a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x8da3486b955f2e93 expref: 18 pid: 5810 timeout: 271 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789366546.532214:0:8476:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9638b73cdc00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8476:1876286758744320:0@lo:104: 00000100:00100000:1.0:1789366546.532233:0:8476:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789366546.532323:0:5800:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1789366546.532335:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286758744064 00000100:00100000:2.0:1789366546.532341:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286758744064 00000100:00100000:2.0:1789366546.532369:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286758744192 00000100:00100000:2.0:1789366546.532372:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286758744192 00000100:00100000:2.0:1789366546.532379:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286758744320 00000100:00100000:2.0:1789366546.532381:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286758744320 00000100:00100000:2.0:1789366546.532391:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1789366546.532399:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638b73ced80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8cde4528-5832-4854-a387-4adacc3dd0ab+5:8476:x1876286758744064:12345-0@lo:104: 00010000:00010000:2.0:1789366546.532410:0:5800:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.123@tcp lock: ffff96388148fc00/0x8da3486b955f2f6c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x8da3486b955f2f73 expref: -99 pid: 7601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366546.532448:0:5800:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1789366546.532453:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638b73ced80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8cde4528-5832-4854-a387-4adacc3dd0ab+5:8476:x1876286758744064:12345-0@lo:104: Request processed in 55us (695us total) trans 0 rc 0/0 00000100:00100000:2.0:1789366546.532459:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1789366546.532472:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1789366546.532477:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638b73ce680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8cde4528-5832-4854-a387-4adacc3dd0ab+4:8476:x1876286758744192:12345-0@lo:104: 00010000:00010000:2.0:1789366546.532488:0:5800:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.123@tcp lock: ffff96388148f000/0x8da3486b955f2f11 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x8da3486b955f2f18 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366546.532513:0:5800:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1789366546.532517:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638b73ce680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8cde4528-5832-4854-a387-4adacc3dd0ab+4:8476:x1876286758744192:12345-0@lo:104: Request processed in 40us (394us total) trans 0 rc 0/0 00000100:00100000:2.0:1789366546.532522:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1789366546.532532:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1789366546.532536:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963889559c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8cde4528-5832-4854-a387-4adacc3dd0ab+3:8476:x1876286758744320:12345-0@lo:104: 00010000:00010000:2.0:1789366546.532544:0:5800:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.123@tcp lock: ffff9638a0740800/0x8da3486b955f2e93 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x8da3486b955f2e9a expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366546.532566:0:5800:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:2.0:1789366546.532571:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963889559c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8cde4528-5832-4854-a387-4adacc3dd0ab+3:8476:x1876286758744320:12345-0@lo:104: Request processed in 35us (337us total) trans 0 rc 0/0 00000100:00100000:2.0:1789366546.532577:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00010000:00010000:2.0:1789366546.532605:0:5805:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1789366546.532611:0:5805:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.123@tcp lock: ffff96388148fc00/0x8da3486b955f2f6c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x8da3486b955f2f73 expref: -99 pid: 7601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366546.532618:0:5805:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96388148fc00 already unused, calling callback (ffffffffc1cc7c20) 10000000:00010000:2.0:1789366546.532622:0:5805:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.123@tcp lock: ffff96388148fc00/0x8da3486b955f2f6c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x8da3486b955f2f73 expref: -99 pid: 7601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366546.532631:0:5805:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.123@tcp lock: ffff96388148fc00/0x8da3486b955f2f6c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x8da3486b955f2f73 expref: -99 pid: 7601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789366546.532638:0:5805:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.123@tcp lock: ffff96388148fc00/0x8da3486b955f2f6c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x8da3486b955f2f73 expref: -99 pid: 7601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789366546.532649:0:5805:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1789366546.532681:0:5805:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.123@tcp lock: ffff96388148fc00/0x8da3486b955f2f6c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8da3486b955f2f73 expref: -99 pid: 7601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366546.532688:0:5805:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789366546.532704:0:5805:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.123@tcp lock: ffff96388148fc00/0x8da3486b955f2f6c lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8da3486b955f2f73 expref: -99 pid: 7601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366546.532712:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.123@tcp lock: ffff96388148fc00/0x8da3486b955f2f6c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8da3486b955f2f73 expref: -99 pid: 7601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366546.532794:0:5805:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789366546.532798:0:5805:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.123@tcp lock: ffff96388148f000/0x8da3486b955f2f11 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x8da3486b955f2f18 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366546.532803:0:5805:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96388148f000 already unused, calling callback (ffffffffc1cc7c20) 10000000:00010000:2.0:1789366546.532806:0:5805:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.123@tcp lock: ffff96388148f000/0x8da3486b955f2f11 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x8da3486b955f2f18 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366546.532813:0:5805:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.123@tcp lock: ffff96388148f000/0x8da3486b955f2f11 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x8da3486b955f2f18 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789366546.532819:0:5805:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.123@tcp lock: ffff96388148f000/0x8da3486b955f2f11 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x8da3486b955f2f18 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789366546.532824:0:5805:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1789366546.532835:0:5805:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.123@tcp lock: ffff96388148f000/0x8da3486b955f2f11 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8da3486b955f2f18 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366546.532841:0:5805:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789366546.532859:0:5805:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.123@tcp lock: ffff96388148f000/0x8da3486b955f2f11 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8da3486b955f2f18 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366546.532866:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.123@tcp lock: ffff96388148f000/0x8da3486b955f2f11 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8da3486b955f2f18 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366546.532873:0:5805:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789366546.532876:0:5805:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.123@tcp lock: ffff9638a0740800/0x8da3486b955f2e93 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x8da3486b955f2e9a expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366546.532881:0:5805:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9638a0740800 already unused, calling callback (ffffffffc1cc7c20) 10000000:00010000:2.0:1789366546.532884:0:5805:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.123@tcp lock: ffff9638a0740800/0x8da3486b955f2e93 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x8da3486b955f2e9a expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366546.532890:0:5805:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.123@tcp lock: ffff9638a0740800/0x8da3486b955f2e93 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x8da3486b955f2e9a expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789366546.532896:0:5805:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.123@tcp lock: ffff9638a0740800/0x8da3486b955f2e93 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x8da3486b955f2e9a expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789366546.532902:0:5805:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1789366546.532910:0:5805:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.123@tcp lock: ffff9638a0740800/0x8da3486b955f2e93 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8da3486b955f2e9a expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366546.532916:0:5805:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789366546.532930:0:5805:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.123@tcp lock: ffff9638a0740800/0x8da3486b955f2e93 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8da3486b955f2e9a expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366546.532937:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.123@tcp lock: ffff9638a0740800/0x8da3486b955f2e93 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8da3486b955f2e9a expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366546.532947:0:5805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789366546.532952:0:5805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789366546.532954:0:5805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789366546.532960:0:6675:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789366546.532964:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789366546.532980:0:3287:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9638c1e6f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8cde4528-5832-4854-a387-4adacc3dd0ab:3287:1876286758744448:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789366546.533003:0:3287:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789366546.533030:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9638c1e6c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8cde4528-5832-4854-a387-4adacc3dd0ab:3284:1876286758744576:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789366546.533046:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789366546.533060:0:3284:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789366546.533065:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9638c1e6f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8cde4528-5832-4854-a387-4adacc3dd0ab:3284:1876286758744704:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789366546.533078:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789366546.533097:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286758744448 00000100:00100000:2.0:1789366546.533100:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286758744448 00010000:00010000:2.0:1789366546.533115:0:5803:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9638a0740a00/0x8da3486b955f2f73 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8da3486b955f2f6c expref: 19 pid: 5810 timeout: 271 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789366546.533131:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286758744576 00000100:00100000:2.0:1789366546.533132:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286758744576 00010000:00010000:2.0:1789366546.533140:0:5803:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9638832d2000/0x8da3486b955f2f18 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8da3486b955f2f11 expref: 20 pid: 5808 timeout: 271 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789366546.533148:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286758744704 00000100:00100000:2.0:1789366546.533150:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286758744704 00010000:00010000:2.0:1789366546.533157:0:5803:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9638827f6600/0x8da3486b955f2e9a lrc: 6/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8da3486b955f2e93 expref: 21 pid: 5810 timeout: 271 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789366546.533166:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1789366546.533171:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638c1e6ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8cde4528-5832-4854-a387-4adacc3dd0ab+21:3287:x1876286758744448:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789366546.533180:0:5803:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789366546.533200:0:5803:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9638a0740a00/0x8da3486b955f2f73 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8da3486b955f2f6c expref: 21 pid: 5810 timeout: 271 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366546.533209:0:5803:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9638a0740a00/0x8da3486b955f2f73 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x8da3486b955f2f6c expref: 21 pid: 5810 timeout: 271 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366546.533221:0:5803:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789366546.533244:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638c1e6ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8cde4528-5832-4854-a387-4adacc3dd0ab+21:3287:x1876286758744448:12345-0@lo:103:ldlm_bl.0 Request processed in 73us (240us total) trans 0 rc 0/0 00000100:00100000:2.0:1789366546.533250:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1789366546.533261:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1789366546.533266:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638c1e6f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8cde4528-5832-4854-a387-4adacc3dd0ab+20:3284:x1876286758744576:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789366546.533272:0:5803:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789366546.533276:0:5803:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9638832d2000/0x8da3486b955f2f18 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8da3486b955f2f11 expref: 20 pid: 5808 timeout: 271 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366546.533283:0:5803:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9638832d2000/0x8da3486b955f2f18 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x8da3486b955f2f11 expref: 20 pid: 5808 timeout: 271 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366546.533292:0:5803:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789366546.533309:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638c1e6f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8cde4528-5832-4854-a387-4adacc3dd0ab+20:3284:x1876286758744576:12345-0@lo:103:ldlm_bl.0 Request processed in 43us (262us total) trans 0 rc 0/0 00000100:00100000:2.0:1789366546.533314:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1789366546.533323:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1789366546.533327:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638c1e6c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8cde4528-5832-4854-a387-4adacc3dd0ab+19:3284:x1876286758744704:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789366546.533333:0:5803:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789366546.533336:0:5803:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9638827f6600/0x8da3486b955f2e9a lrc: 6/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8da3486b955f2e93 expref: 19 pid: 5810 timeout: 271 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366546.533352:0:5803:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9638827f6600/0x8da3486b955f2e9a lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x8da3486b955f2e93 expref: 19 pid: 5810 timeout: 271 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366546.533361:0:5803:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789366546.533376:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638c1e6c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8cde4528-5832-4854-a387-4adacc3dd0ab+19:3284:x1876286758744704:12345-0@lo:103:ldlm_bl.0 Request processed in 49us (298us total) trans 0 rc 0/0 00000100:00100000:2.0:1789366546.533382:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1789366546.533417:0:3287:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9638c1e6f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8cde4528-5832-4854-a387-4adacc3dd0ab:3287:1876286758744448:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789366546.533434:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9638c1e6f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8cde4528-5832-4854-a387-4adacc3dd0ab:3284:1876286758744704:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789366546.533441:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9638c1e6c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8cde4528-5832-4854-a387-4adacc3dd0ab:3284:1876286758744576:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789366546.533631:0:6674:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 0 new 8192-byte reqbufs (1/1 left), rc = 0 00000100:00100000:1.0:1789366546.533648:0:8476:0:(client.c:2716:ptlrpc_set_wait()) set ffff963882a2ad80 going to sleep for 11 seconds 00010000:00010000:1.0:1789366546.533660:0:8476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9638a0740a00/0x8da3486b955f2f73 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x8da3486b955f2f6c expref: 18 pid: 5810 timeout: 271 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789366546.533669:0:8476:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9638b73cc700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8476:1876286758744064:0@lo:104: 00010000:00010000:1.0:1789366546.533677:0:8476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9638832d2000/0x8da3486b955f2f18 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x8da3486b955f2f11 expref: 17 pid: 5808 timeout: 271 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789366546.533684:0:8476:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9638b73cca80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8476:1876286758744192:0@lo:104: 00010000:00010000:1.0:1789366546.533691:0:8476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9638827f6600/0x8da3486b955f2e9a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x8da3486b955f2e93 expref: 16 pid: 5810 timeout: 271 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789366546.533708:0:8476:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9638b73cdc00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8476:1876286758744320:0@lo:104: 00000100:00100000:0.0:1789366546.534422:0:8476:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9638b73cd880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8476:1876286758743936:192.168.202.23@tcp:104: 00010000:00010000:0.0:1789366546.534443:0:8476:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff96388148e400/0x8da3486b955f30d1 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789366546.535146:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:0.0:1789366546.535284:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751380608 00000100:00100000:0.0:1789366546.535291:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751380608 00010000:00010000:0.0:1789366546.535320:0:5803:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff96388148f400/0x8da3486b955f3030 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.202.23@tcp remote: 0xda917a494d06bea1 expref: 10 pid: 5810 timeout: 221 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789366546.535359:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 23 00000100:00100000:0.0:1789366546.535368:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638c1e6c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:14a2847b-91d8-4d87-b71b-010443acc91a+10:2354:x1876286751380608:12345-192.168.202.23@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789366546.535383:0:5803:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789366546.535390:0:5803:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff96388148f400/0x8da3486b955f3030 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.23@tcp remote: 0xda917a494d06bea1 expref: 10 pid: 5810 timeout: 221 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366546.535401:0:5803:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff96388148f400/0x8da3486b955f3030 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.202.23@tcp remote: 0xda917a494d06bea1 expref: 10 pid: 5810 timeout: 221 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366546.535415:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff96388148f400/0x8da3486b955f3030 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.202.23@tcp remote: 0xda917a494d06bea1 expref: 10 pid: 5810 timeout: 221 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366546.535427:0:5803:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff96388148e400/0x8da3486b955f30d1 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366546.535436:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff96388148e400/0x8da3486b955f30d1 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366546.535457:0:5803:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff96388148e400/0x8da3486b955f30d1 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366546.535464:0:5803:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff96388148e400/0x8da3486b955f30d1 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366546.535470:0:5803:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff96388148e400/0x8da3486b955f30d1 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366546.535476:0:5803:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff96388148e400/0x8da3486b955f30d1 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366546.535482:0:5803:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96388148e400 already unused, calling callback (ffffffffc16df520) 00010000:00010000:0.0:1789366546.535486:0:5803:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff96388148e400/0x8da3486b955f30d1 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366546.535493:0:5803:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff96388148e400/0x8da3486b955f30d1 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 8476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366546.536038:0:8476:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff96388148e400/0x8da3486b955f30d1 lrc: 5/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366546.536045:0:8476:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff96388148e400/0x8da3486b955f30d1 lrc: 5/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366546.536758:0:5803:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff96388148e400/0x8da3486b955f30d1 lrc: 3/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366546.536766:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff96388148e400/0x8da3486b955f30d1 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366546.536778:0:5803:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789366546.536819:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638c1e6c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:14a2847b-91d8-4d87-b71b-010443acc91a+9:2354:x1876286751380608:12345-192.168.202.23@tcp:103:ldlm_bl.0 Request processed in 1453us (1676us total) trans 0 rc 0/0 00000100:00100000:0.0:1789366546.536825:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 23 00010000:00010000:2.0:1789366547.323066:0:5805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789366547.659984:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:2.0:1789366547.660241:0:7614:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751380864 00000100:00100000:2.0:1789366547.660253:0:7614:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751380864 00000100:00100000:2.0:1789366547.660350:0:7614:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 15 00000100:00100000:2.0:1789366547.660364:0:7614:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638b73cd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0ab23baa-a205-44ad-bf17-f7b47295d82b+6:2354:x1876286751380864:12345-192.168.202.23@tcp:400:kworker.0 00000100:00080000:3.0:1789366547.660413:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789366547.660457:0:7614:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638b73cd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0ab23baa-a205-44ad-bf17-f7b47295d82b+6:2354:x1876286751380864:12345-192.168.202.23@tcp:400:kworker.0 Request processed in 96us (481us total) trans 0 rc 0/0 00000100:00100000:2.0:1789366547.660466:0:7614:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 15 00000100:00100000:3.0:1789366547.662023:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:3.0:1789366547.662054:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:3.0:1789366547.662085:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:3.0:1789366547.662107:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751380992 00000100:00100000:3.0:1789366547.662114:0:6661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751380992 00000100:00100000:3.0:1789366547.662149:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751381120 00000100:00100000:3.0:1789366547.662153:0:6661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751381120 00000100:00100000:3.0:1789366547.662173:0:6661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 8 00000100:00100000:3.0:1789366547.662209:0:6661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638bf5ab800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0ab23baa-a205-44ad-bf17-f7b47295d82b+5:2355:x1876286751380992:12345-192.168.202.23@tcp:400:kworker.0 00000100:00100000:3.0:1789366547.662250:0:6661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638bf5ab800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0ab23baa-a205-44ad-bf17-f7b47295d82b+5:2355:x1876286751380992:12345-192.168.202.23@tcp:400:kworker.0 Request processed in 70us (195us total) trans 0 rc 0/0 00000100:00100000:3.0:1789366547.662257:0:6661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 8 00000100:00100000:3.0:1789366547.662270:0:6661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 9 00000100:00100000:3.0:1789366547.662277:0:6661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638bf5ab100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0ab23baa-a205-44ad-bf17-f7b47295d82b+5:2354:x1876286751381120:12345-192.168.202.23@tcp:400:kworker.0 00000100:00100000:3.0:1789366547.662301:0:6661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638bf5ab100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0ab23baa-a205-44ad-bf17-f7b47295d82b+5:2354:x1876286751381120:12345-192.168.202.23@tcp:400:kworker.0 Request processed in 24us (215us total) trans 0 rc 0/0 00000100:00100000:3.0:1789366547.662307:0:6661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 9 00000100:00080000:3.0:1789366547.662321:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789366547.662325:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789366547.662503:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751380736 00000100:00100000:2.0:1789366547.662509:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751380736 00000100:00100000:2.0:1789366547.662548:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 162 00000100:00100000:2.0:1789366547.662560:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638b4e3fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:14a2847b-91d8-4d87-b71b-010443acc91a+9:2355:x1876286751380736:12345-192.168.202.23@tcp:400:kworker.0 00000100:00100000:2.0:1789366547.662604:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638b4e3fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:14a2847b-91d8-4d87-b71b-010443acc91a+9:2355:x1876286751380736:12345-192.168.202.23@tcp:400:kworker.0 Request processed in 49us (585us total) trans 0 rc 0/0 00000100:00100000:2.0:1789366547.662620:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 162 00000100:00100000:0.0:1789366547.895895:0:3286:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9638c1e6f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3286:1876286758744832:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789366547.895969:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789366547.896002:0:6662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286758744832 00000100:00100000:2.0:1789366547.896009:0:6662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286758744832 00000100:00080000:1.0:1789366547.896052:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789366547.896074:0:6662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1789366547.896083:0:6662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638b4f19f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3286:x1876286758744832:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789366547.896116:0:6662:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789366547.896171:0:6662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638b4f19f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3286:x1876286758744832:12345-0@lo:13:osp-pre-0-0.0 Request processed in 89us (203us total) trans 0 rc 0/0 00000100:00100000:2.0:1789366547.896186:0:6662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00080000:0.0:1789366547.896235:0:3286:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9638c1e6f800 x1876286758744832/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789366563 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789366547.896255:0:3286:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9638c1e6f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3286:1876286758744832:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789366548.058260:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:3.0:1789366548.058451:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751381248 00000100:00100000:3.0:1789366548.058464:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751381248 00000100:00100000:3.0:1789366548.058536:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 163 00000100:00100000:3.0:1789366548.058554:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638b4e3ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:14a2847b-91d8-4d87-b71b-010443acc91a+9:5583:x1876286751381248:12345-192.168.202.23@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789366548.058573:0:5811:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789366548.058592:0:5811:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9638832d3600/0x8da3486b955f30d8 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xda917a494d06bee0 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366548.058623:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9638832d3600/0x8da3486b955f30d8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.202.23@tcp remote: 0xda917a494d06bee0 expref: 10 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366548.058634:0:5811:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9638832d3600/0x8da3486b955f30d8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.202.23@tcp remote: 0xda917a494d06bee0 expref: 10 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366548.058643:0:5811:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9638832d3600, rc 0) 00000100:00100000:3.0:1789366548.058710:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638b4e3ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:14a2847b-91d8-4d87-b71b-010443acc91a+10:5583:x1876286751381248:12345-192.168.202.23@tcp:101:ll_cfg_requeue.0 Request processed in 158us (457us total) trans 0 rc 0/0 00000100:00100000:3.0:1789366548.058737:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 163 00000100:00100000:3.0:1789366548.065230:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:0.0:1789366548.065306:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751381376 00000100:00100000:0.0:1789366548.065317:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751381376 00000100:00100000:0.0:1789366548.065374:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 164 00000100:00100000:0.0:1789366548.065384:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638b4e3c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:14a2847b-91d8-4d87-b71b-010443acc91a+10:5583:x1876286751381376:12345-192.168.202.23@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789366548.065709:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638b4e3c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:14a2847b-91d8-4d87-b71b-010443acc91a+10:5583:x1876286751381376:12345-192.168.202.23@tcp:501:ll_cfg_requeue.0 Request processed in 325us (486us total) trans 0 rc 0/0 00000100:00100000:0.0:1789366548.065749:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 164 00000100:00100000:3.0:1789366548.077064:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:0.0:1789366548.077289:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751381504 00000100:00100000:0.0:1789366548.077300:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751381504 00000100:00100000:0.0:1789366548.077348:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 165 00000100:00100000:0.0:1789366548.077358:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638b4e3f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:14a2847b-91d8-4d87-b71b-010443acc91a+10:5583:x1876286751381504:12345-192.168.202.23@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789366548.078079:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638b4e3f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:14a2847b-91d8-4d87-b71b-010443acc91a+10:5583:x1876286751381504:12345-192.168.202.23@tcp:503:ll_cfg_requeue.0 Request processed in 720us (1023us total) trans 0 rc 0/0 00000100:00100000:0.0:1789366548.078088:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 165 00000100:00100000:1.0:1789366548.085715:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:3.0:1789366548.087009:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751381632 00000100:00100000:3.0:1789366548.087021:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751381632 00000100:00100000:3.0:1789366548.087072:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 166 00000100:00100000:3.0:1789366548.087082:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638b4e3d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:14a2847b-91d8-4d87-b71b-010443acc91a+10:6146:x1876286751381632:12345-192.168.202.23@tcp:502:llog_process_th.0 00000100:00100000:3.0:1789366548.087684:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638b4e3d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:14a2847b-91d8-4d87-b71b-010443acc91a+10:6146:x1876286751381632:12345-192.168.202.23@tcp:502:llog_process_th.0 Request processed in 602us (1978us total) trans 0 rc 0/0 00000100:00100000:3.0:1789366548.087693:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 166 00000100:00100000:1.0:1789366548.096262:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:1.0:1789366548.096313:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751381760 00000100:00100000:1.0:1789366548.096323:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751381760 00000100:00100000:1.0:1789366548.096380:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 167 00000100:00100000:1.0:1789366548.096389:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638b4e3e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:14a2847b-91d8-4d87-b71b-010443acc91a+10:6146:x1876286751381760:12345-192.168.202.23@tcp:502:llog_process_th.0 10000000:01000000:2.0:1789366548.096535:0:5813:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1789366548.096539:0:5813:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff963883577000 from 4 10000000:01000000:2.0:1789366548.096543:0:5813:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1789366548.096582:0:5813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.123@tcp lock: ffff9638a0740a00/0x8da3486b955f30df lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366548.096594:0:5813:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.123@tcp lock: ffff9638a0740a00/0x8da3486b955f30df lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366548.096606:0:5813:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.123@tcp lock: ffff9638a0740a00/0x8da3486b955f30df lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789366548.096628:0:5813:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9638c1e6f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8cde4528-5832-4854-a387-4adacc3dd0ab:5813:1876286758744960:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789366548.096772:0:5813:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789366548.096822:0:5813:0:(client.c:2716:ptlrpc_set_wait()) set ffff9638bfe9c000 going to sleep for 11 seconds 00000100:00100000:2.0:1789366548.096840:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286758744960 00000100:00100000:2.0:1789366548.096844:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286758744960 00000100:00100000:2.0:1789366548.096877:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:2.0:1789366548.096886:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638b4e3e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8cde4528-5832-4854-a387-4adacc3dd0ab+16:5813:x1876286758744960:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789366548.096904:0:5810:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789366548.096916:0:5810:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9638a0740600/0x8da3486b955f30e6 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x8da3486b955f30df expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366548.096938:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9638a0740600/0x8da3486b955f30e6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8da3486b955f30df expref: 17 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366548.096949:0:5810:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9638a0740600/0x8da3486b955f30e6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8da3486b955f30df expref: 17 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366548.096959:0:5810:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9638a0740600, rc 0) 00000100:00100000:2.0:1789366548.097001:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638b4e3e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8cde4528-5832-4854-a387-4adacc3dd0ab+17:5813:x1876286758744960:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 116us (229us total) trans 0 rc 0/0 00000100:00100000:2.0:1789366548.097008:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:2.0:1789366548.097053:0:5813:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9638c1e6f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8cde4528-5832-4854-a387-4adacc3dd0ab:5813:1876286758744960:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789366548.097069:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.123@tcp lock: ffff9638a0740a00/0x8da3486b955f30df lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8da3486b955f30e6 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366548.097079:0:5813:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.123@tcp lock: ffff9638a0740a00/0x8da3486b955f30df lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x8da3486b955f30e6 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789366548.097136:0:5813:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9638c1e6f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8cde4528-5832-4854-a387-4adacc3dd0ab:5813:1876286758745088:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789366548.097164:0:5813:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789366548.098295:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638b4e3e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:14a2847b-91d8-4d87-b71b-010443acc91a+10:6146:x1876286751381760:12345-192.168.202.23@tcp:502:llog_process_th.0 Request processed in 1904us (2041us total) trans 0 rc 0/0 00000100:00100000:1.0:1789366548.098304:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 167 00000100:00100000:1.0:1789366548.098325:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286758745088 00000100:00100000:1.0:1789366548.098329:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286758745088 00000100:00100000:1.0:1789366548.098349:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:1.0:1789366548.098356:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638b4e3e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8cde4528-5832-4854-a387-4adacc3dd0ab+17:5813:x1876286758745088:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789366548.100323:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638b4e3e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8cde4528-5832-4854-a387-4adacc3dd0ab+17:5813:x1876286758745088:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 1963us (3153us total) trans 0 rc 0/0 00000100:00100000:1.0:1789366548.100334:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00100000:2.0:1789366548.100512:0:5813:0:(client.c:2716:ptlrpc_set_wait()) set ffff9638bfe9c000 going to sleep for 11 seconds 00000100:00100000:2.0:1789366548.100537:0:5813:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9638c1e6f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8cde4528-5832-4854-a387-4adacc3dd0ab:5813:1876286758745088:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789366548.100585:0:5813:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9638c1e6f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8cde4528-5832-4854-a387-4adacc3dd0ab:5813:1876286758745216:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789366548.100645:0:5813:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789366548.100736:0:5813:0:(client.c:2716:ptlrpc_set_wait()) set ffff9638bfe9c000 going to sleep for 11 seconds 00000100:00100000:3.0:1789366548.102245:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286758745216 00000100:00100000:3.0:1789366548.102256:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286758745216 00000100:00100000:0.0:1789366548.102492:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:0.0:1789366548.102503:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638b4e3f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8cde4528-5832-4854-a387-4adacc3dd0ab+17:5813:x1876286758745216:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789366548.102864:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638b4e3f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8cde4528-5832-4854-a387-4adacc3dd0ab+17:5813:x1876286758745216:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 362us (2218us total) trans 0 rc 0/0 00000100:00100000:0.0:1789366548.102872:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00100000:2.0:1789366548.102961:0:5813:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9638c1e6f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8cde4528-5832-4854-a387-4adacc3dd0ab:5813:1876286758745216:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789366548.103325:0:8585:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9638c1e6f100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8cde4528-5832-4854-a387-4adacc3dd0ab:8585:1876286758745344:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789366548.103364:0:8585:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789366548.103400:0:8585:0:(client.c:2716:ptlrpc_set_wait()) set ffff9638bfe9cd80 going to sleep for 11 seconds 00000100:00100000:3.0:1789366548.103437:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286758745344 00000100:00100000:3.0:1789366548.103447:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286758745344 00000100:00100000:3.0:1789366548.103480:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:3.0:1789366548.103488:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638b4e3d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8cde4528-5832-4854-a387-4adacc3dd0ab+17:8585:x1876286758745344:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789366548.103631:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638b4e3d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8cde4528-5832-4854-a387-4adacc3dd0ab+17:8585:x1876286758745344:12345-0@lo:502:llog_process_th.0 Request processed in 143us (265us total) trans 0 rc 0/0 00000100:00100000:3.0:1789366548.103638:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00000100:00100000:0.0:1789366548.103754:0:8585:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9638c1e6f100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8cde4528-5832-4854-a387-4adacc3dd0ab:8585:1876286758745344:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1789366548.103777:0:8585:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789366548.103788:0:8585:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789366548.103790:0:8585:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1789366548.103797:0:8585:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff963883577000 00000020:00000080:0.0:1789366548.103800:0:8585:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1789366548.103866:0:8585:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9638b4f18000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8cde4528-5832-4854-a387-4adacc3dd0ab:8585:1876286758745472:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789366548.103895:0:8585:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789366548.103913:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286758745472 00000100:00100000:0.0:1789366548.103916:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286758745472 00000100:00100000:0.0:1789366548.103934:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 172 00000100:00100000:0.0:1789366548.103939:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638b4e3c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8cde4528-5832-4854-a387-4adacc3dd0ab+17:8585:x1876286758745472:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789366548.104028:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638b4e3c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8cde4528-5832-4854-a387-4adacc3dd0ab+17:8585:x1876286758745472:12345-0@lo:502:llog_process_th.0 Request processed in 88us (132us total) trans 0 rc 0/0 00000100:00100000:0.0:1789366548.104034:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 172 00000100:00100000:0.0:1789366548.104056:0:8585:0:(client.c:2716:ptlrpc_set_wait()) set ffff9638895c5cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1789366548.104067:0:8585:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9638b4f18000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8cde4528-5832-4854-a387-4adacc3dd0ab:8585:1876286758745472:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1789366548.104081:0:8585:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789366548.104085:0:8585:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789366548.104086:0:8585:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:0.0:1789366548.104090:0:8585:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:3.0:1789366548.106264:0:5813:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:3.0:1789366548.106293:0:5813:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.123@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1789366548.106304:0:5813:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.123@tcp lock: ffff9638a0740a00/0x8da3486b955f30df lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8da3486b955f30e6 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366548.106317:0:5813:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.123@tcp lock: ffff9638a0740a00/0x8da3486b955f30df lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8da3486b955f30e6 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789366548.106327:0:5813:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1789366548.106330:0:5813:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff963885b46000 from 4 10000000:01000000:3.0:1789366548.106333:0:5813:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1789366548.106367:0:5813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.123@tcp lock: ffff9638832d3e00/0x8da3486b955f30ed lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366548.106375:0:5813:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.123@tcp lock: ffff9638832d3e00/0x8da3486b955f30ed lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366548.106386:0:5813:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.123@tcp lock: ffff9638832d3e00/0x8da3486b955f30ed lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789366548.106405:0:5813:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9638bf5a9500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8cde4528-5832-4854-a387-4adacc3dd0ab:5813:1876286758745600:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789366548.106454:0:5813:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789366548.106478:0:5813:0:(client.c:2716:ptlrpc_set_wait()) set ffff963898282540 going to sleep for 11 seconds 00000100:00100000:3.0:1789366548.106499:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286758745600 00000100:00100000:3.0:1789366548.106509:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286758745600 00000100:00100000:3.0:1789366548.106546:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00100000:3.0:1789366548.106554:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638b4e3c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8cde4528-5832-4854-a387-4adacc3dd0ab+17:5813:x1876286758745600:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789366548.106566:0:5811:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789366548.106577:0:5811:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9638832d2200/0x8da3486b955f30f4 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x8da3486b955f30ed expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366548.106598:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9638832d2200/0x8da3486b955f30f4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8da3486b955f30ed expref: 18 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366548.106608:0:5811:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9638832d2200/0x8da3486b955f30f4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8da3486b955f30ed expref: 18 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366548.106618:0:5811:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9638832d2200, rc 0) 00000100:00100000:3.0:1789366548.106650:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638b4e3c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8cde4528-5832-4854-a387-4adacc3dd0ab+18:5813:x1876286758745600:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 96us (196us total) trans 0 rc 0/0 00000100:00100000:3.0:1789366548.106790:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 00000100:00100000:3.0:1789366548.106831:0:5813:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9638bf5a9500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8cde4528-5832-4854-a387-4adacc3dd0ab:5813:1876286758745600:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789366548.106843:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.123@tcp lock: ffff9638832d3e00/0x8da3486b955f30ed lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8da3486b955f30f4 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366548.106852:0:5813:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.123@tcp lock: ffff9638832d3e00/0x8da3486b955f30ed lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x8da3486b955f30f4 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789366548.106896:0:5813:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9638bf5a9500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8cde4528-5832-4854-a387-4adacc3dd0ab:5813:1876286758745728:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789366548.106920:0:5813:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789366548.107069:0:5813:0:(client.c:2716:ptlrpc_set_wait()) set ffff963898282540 going to sleep for 11 seconds 00000100:00100000:0.0:1789366548.110204:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286758745728 00000100:00100000:0.0:1789366548.110214:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286758745728 00000100:00100000:1.0:1789366548.110376:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00100000:1.0:1789366548.110394:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638b4e3d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8cde4528-5832-4854-a387-4adacc3dd0ab+18:5813:x1876286758745728:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789366548.110675:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638b4e3d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8cde4528-5832-4854-a387-4adacc3dd0ab+18:5813:x1876286758745728:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 282us (3753us total) trans 0 rc 0/0 00000100:00100000:1.0:1789366548.110684:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 00000100:00100000:0.0:1789366548.110807:0:5813:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9638bf5a9500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8cde4528-5832-4854-a387-4adacc3dd0ab:5813:1876286758745728:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789366548.110856:0:5813:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9638b4f18000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8cde4528-5832-4854-a387-4adacc3dd0ab:5813:1876286758745856:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789366548.110899:0:5813:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789366548.110934:0:5813:0:(client.c:2716:ptlrpc_set_wait()) set ffff963883ba53c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789366548.110977:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286758745856 00000100:00100000:1.0:1789366548.110981:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286758745856 00000100:00100000:1.0:1789366548.110997:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:1.0:1789366548.111003:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638b4e39450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8cde4528-5832-4854-a387-4adacc3dd0ab+18:5813:x1876286758745856:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789366548.111141:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638b4e39450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8cde4528-5832-4854-a387-4adacc3dd0ab+18:5813:x1876286758745856:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 137us (242us total) trans 0 rc 0/0 00000100:00100000:1.0:1789366548.111148:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00100000:0.0:1789366548.111218:0:5813:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9638b4f18000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8cde4528-5832-4854-a387-4adacc3dd0ab:5813:1876286758745856:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789366548.114855:0:8587:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9638b4f18000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8cde4528-5832-4854-a387-4adacc3dd0ab:8587:1876286758745984:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789366548.114926:0:8587:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789366548.114967:0:8587:0:(client.c:2716:ptlrpc_set_wait()) set ffff963883ba5480 going to sleep for 11 seconds 00000100:00100000:1.0:1789366548.115061:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286758745984 00000100:00100000:1.0:1789366548.115067:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286758745984 00000100:00100000:1.0:1789366548.115099:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:1.0:1789366548.115106:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638b4e38c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8cde4528-5832-4854-a387-4adacc3dd0ab+18:8587:x1876286758745984:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789366548.115306:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638b4e38c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8cde4528-5832-4854-a387-4adacc3dd0ab+18:8587:x1876286758745984:12345-0@lo:502:llog_process_th.0 Request processed in 200us (380us total) trans 0 rc 0/0 00000100:00100000:1.0:1789366548.115314:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00100000:0.0:1789366548.115401:0:8587:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9638b4f18000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8cde4528-5832-4854-a387-4adacc3dd0ab:8587:1876286758745984:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1789366548.115426:0:8587:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789366548.115435:0:8587:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789366548.115438:0:8587:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1789366548.115444:0:8587:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff963885b46000 00000020:00000080:0.0:1789366548.115447:0:8587:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1789366548.115524:0:8587:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9638b4f18000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8cde4528-5832-4854-a387-4adacc3dd0ab:8587:1876286758746112:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789366548.115552:0:8587:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789366548.115569:0:8587:0:(client.c:2716:ptlrpc_set_wait()) set ffff963883ba5480 going to sleep for 11 seconds 00000100:00100000:1.0:1789366548.116172:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286758746112 00000100:00100000:1.0:1789366548.116190:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286758746112 00000100:00100000:1.0:1789366548.116211:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:1.0:1789366548.116218:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638b4e39c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8cde4528-5832-4854-a387-4adacc3dd0ab+18:8587:x1876286758746112:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789366548.117160:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638b4e39c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8cde4528-5832-4854-a387-4adacc3dd0ab+18:8587:x1876286758746112:12345-0@lo:502:llog_process_th.0 Request processed in 941us (1606us total) trans 0 rc 0/0 00000100:00100000:1.0:1789366548.117168:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00100000:0.0:1789366548.117235:0:8587:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9638b4f18000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8cde4528-5832-4854-a387-4adacc3dd0ab:8587:1876286758746112:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1789366548.117260:0:8587:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789366548.117266:0:8587:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789366548.117268:0:8587:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:0.0:1789366548.117272:0:8587:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:2.0:1789366548.119119:0:5813:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:2.0:1789366548.119154:0:5813:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.123@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1789366548.119165:0:5813:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.123@tcp lock: ffff9638832d3e00/0x8da3486b955f30ed lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8da3486b955f30f4 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366548.120068:0:5813:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.123@tcp lock: ffff9638832d3e00/0x8da3486b955f30ed lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8da3486b955f30f4 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789366548.120082:0:5813:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1789366548.120085:0:5813:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff963884956000 from 4 10000000:01000000:2.0:1789366548.120088:0:5813:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1789366548.120125:0:5813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.123@tcp lock: ffff9638a0740800/0x8da3486b955f30fb lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366548.120134:0:5813:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.123@tcp lock: ffff9638a0740800/0x8da3486b955f30fb lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366548.120144:0:5813:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.123@tcp lock: ffff9638a0740800/0x8da3486b955f30fb lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789366548.120167:0:5813:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9638c1e6df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8cde4528-5832-4854-a387-4adacc3dd0ab:5813:1876286758746240:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789366548.120238:0:5813:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789366548.120291:0:5813:0:(client.c:2716:ptlrpc_set_wait()) set ffff9638bfe9ce40 going to sleep for 11 seconds 00000100:00100000:1.0:1789366548.120337:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286758746240 00000100:00100000:1.0:1789366548.120349:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286758746240 00000100:00100000:1.0:1789366548.120402:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:1.0:1789366548.120411:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638b4e3b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8cde4528-5832-4854-a387-4adacc3dd0ab+18:5813:x1876286758746240:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789366548.120424:0:5811:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789366548.120435:0:5811:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff96388148fc00/0x8da3486b955f3102 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x8da3486b955f30fb expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366548.120457:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff96388148fc00/0x8da3486b955f3102 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8da3486b955f30fb expref: 19 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366548.120467:0:5811:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff96388148fc00/0x8da3486b955f3102 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8da3486b955f30fb expref: 19 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366548.120475:0:5811:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96388148fc00, rc 0) 00000100:00100000:1.0:1789366548.120510:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638b4e3b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8cde4528-5832-4854-a387-4adacc3dd0ab+19:5813:x1876286758746240:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 101us (272us total) trans 0 rc 0/0 00000100:00100000:1.0:1789366548.120516:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00100000:1.0:1789366548.120545:0:5813:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9638c1e6df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8cde4528-5832-4854-a387-4adacc3dd0ab:5813:1876286758746240:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789366548.120557:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.123@tcp lock: ffff9638a0740800/0x8da3486b955f30fb lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x8da3486b955f3102 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366548.120566:0:5813:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.123@tcp lock: ffff9638a0740800/0x8da3486b955f30fb lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x8da3486b955f3102 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789366548.120616:0:5813:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9638b73cd500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8cde4528-5832-4854-a387-4adacc3dd0ab:5813:1876286758746368:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789366548.120636:0:5813:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789366548.120649:0:5813:0:(client.c:2716:ptlrpc_set_wait()) set ffff963882ec9cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1789366548.120660:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286758746368 00000100:00100000:1.0:1789366548.120669:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286758746368 00000100:00100000:1.0:1789366548.120686:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:1.0:1789366548.120691:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638b4e3bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8cde4528-5832-4854-a387-4adacc3dd0ab+19:5813:x1876286758746368:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789366548.122292:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638b4e3bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8cde4528-5832-4854-a387-4adacc3dd0ab+19:5813:x1876286758746368:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 1598us (1651us total) trans 0 rc 0/0 00000100:00100000:1.0:1789366548.122302:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00100000:2.0:1789366548.128283:0:5813:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9638b73cd500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8cde4528-5832-4854-a387-4adacc3dd0ab:5813:1876286758746368:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789366548.128346:0:5813:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9638c1e6fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8cde4528-5832-4854-a387-4adacc3dd0ab:5813:1876286758746496:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789366548.128410:0:5813:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789366548.128461:0:5813:0:(client.c:2716:ptlrpc_set_wait()) set ffff9638bfe9ccc0 going to sleep for 11 seconds 00000100:00100000:0.0:1789366548.128523:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286758746496 00000100:00100000:0.0:1789366548.128529:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286758746496 00000100:00100000:0.0:1789366548.128580:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 180 00000100:00100000:0.0:1789366548.128589:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638b4e3ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8cde4528-5832-4854-a387-4adacc3dd0ab+19:5813:x1876286758746496:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789366548.128801:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638b4e3ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8cde4528-5832-4854-a387-4adacc3dd0ab+19:5813:x1876286758746496:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 213us (391us total) trans 0 rc 0/0 00000100:00100000:0.0:1789366548.128809:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 180 00000100:00100000:2.0:1789366548.128972:0:5813:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9638c1e6fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8cde4528-5832-4854-a387-4adacc3dd0ab:5813:1876286758746496:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789366548.129263:0:8589:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9638c1e6fb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8cde4528-5832-4854-a387-4adacc3dd0ab:8589:1876286758746624:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789366548.129294:0:8589:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789366548.129324:0:8589:0:(client.c:2716:ptlrpc_set_wait()) set ffff9638bfe9cd80 going to sleep for 11 seconds 00000100:00100000:1.0:1789366548.129364:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286758746624 00000100:00100000:1.0:1789366548.129368:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286758746624 00000100:00100000:1.0:1789366548.129400:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 181 00000100:00100000:1.0:1789366548.129407:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638b4e38450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8cde4528-5832-4854-a387-4adacc3dd0ab+19:8589:x1876286758746624:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789366548.129530:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638b4e38450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8cde4528-5832-4854-a387-4adacc3dd0ab+19:8589:x1876286758746624:12345-0@lo:502:llog_process_th.0 Request processed in 123us (235us total) trans 0 rc 0/0 00000100:00100000:1.0:1789366548.129537:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 181 00000100:00100000:1.0:1789366548.129571:0:8589:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9638c1e6fb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8cde4528-5832-4854-a387-4adacc3dd0ab:8589:1876286758746624:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1789366548.129590:0:8589:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789366548.129599:0:8589:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789366548.129601:0:8589:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1789366548.129609:0:8589:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff963884956000 00000020:00000080:1.0:1789366548.129611:0:8589:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1789366548.129980:0:8589:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9638b73cce00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8cde4528-5832-4854-a387-4adacc3dd0ab:8589:1876286758746752:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789366548.130010:0:8589:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789366548.130028:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286758746752 00000100:00100000:1.0:1789366548.130032:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286758746752 00000100:00100000:1.0:1789366548.130052:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 182 00000100:00100000:1.0:1789366548.130057:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638b4e3b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8cde4528-5832-4854-a387-4adacc3dd0ab+19:8589:x1876286758746752:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789366548.130150:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638b4e3b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8cde4528-5832-4854-a387-4adacc3dd0ab+19:8589:x1876286758746752:12345-0@lo:502:llog_process_th.0 Request processed in 91us (139us total) trans 0 rc 0/0 00000100:00100000:1.0:1789366548.130162:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 182 00000100:00100000:1.0:1789366548.130205:0:8589:0:(client.c:2716:ptlrpc_set_wait()) set ffff963882ec9d80 going to sleep for 11 seconds 00000100:00100000:1.0:1789366548.130216:0:8589:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9638b73cce00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8cde4528-5832-4854-a387-4adacc3dd0ab:8589:1876286758746752:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1789366548.130233:0:8589:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789366548.130237:0:8589:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789366548.130239:0:8589:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:1.0:1789366548.130243:0:8589:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:1.0:1789366548.130286:0:5813:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:1.0:1789366548.130304:0:5813:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.123@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1789366548.130313:0:5813:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.123@tcp lock: ffff9638a0740800/0x8da3486b955f30fb lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x8da3486b955f3102 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366548.130324:0:5813:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.123@tcp lock: ffff9638a0740800/0x8da3486b955f30fb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x8da3486b955f3102 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366548.343997:0:6675:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789366549.369891:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789366550.394268:0:5805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789366550.455919:0:3287:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9638b4f18000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8cde4528-5832-4854-a387-4adacc3dd0ab:3287:1876286758746880:0@lo:400:kworker.0 00000100:00100000:0.0:1789366550.455993:0:3287:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789366550.456045:0:3287:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9638b4f1b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3287:1876286758747392:0@lo:400:kworker.0 00000100:00100000:0.0:1789366550.456072:0:3287:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789366550.456096:0:3287:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789366550.456102:0:3287:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9638b4f19c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3287:1876286758747264:0@lo:400:kworker.0 00000100:00100000:0.0:1789366550.456127:0:3287:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789366550.456168:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9638b4f1b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3284:1876286758747008:0@lo:400:kworker.0 00000100:00100000:0.0:1789366550.456192:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789366550.456210:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9638b4f19880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3284:1876286758747520:0@lo:400:kworker.0 00000100:00100000:0.0:1789366550.456230:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789366550.456247:0:3284:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789366550.456251:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9638b4f18e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3284:1876286758747136:0@lo:400:kworker.0 00000100:00100000:0.0:1789366550.456270:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789366550.456302:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286758746880 00000100:00100000:0.0:1789366550.456311:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286758746880 00000100:00100000:0.0:1789366550.456359:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 183 00000100:00100000:0.0:1789366550.456368:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638b4e39850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8cde4528-5832-4854-a387-4adacc3dd0ab+19:3287:x1876286758746880:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789366550.456415:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638b4e39850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8cde4528-5832-4854-a387-4adacc3dd0ab+19:3287:x1876286758746880:12345-0@lo:400:kworker.0 Request processed in 49us (423us total) trans 0 rc 0/0 00000100:00100000:0.0:1789366550.456422:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 183 00000100:00100000:0.0:1789366550.456451:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286758747392 00000100:00100000:0.0:1789366550.456455:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286758747392 00000100:00100000:0.0:1789366550.456488:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286758747008 00000100:00100000:0.0:1789366550.456491:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286758747008 00000100:00100000:0.0:1789366550.456509:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286758747136 00000100:00100000:0.0:1789366550.456512:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286758747136 00000100:00100000:0.0:1789366550.456542:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1789366550.456548:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638b4f18700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3287:x1876286758747392:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789366550.456577:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638b4f18700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3287:x1876286758747392:12345-0@lo:400:kworker.0 Request processed in 30us (505us total) trans 0 rc 0/0 00000100:00100000:0.0:1789366550.456584:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1789366550.456597:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1789366550.456602:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963785f29180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3284:x1876286758747008:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789366550.456632:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963785f29180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3284:x1876286758747008:12345-0@lo:400:kworker.0 Request processed in 31us (440us total) trans 0 rc 0/0 00000100:00100000:0.0:1789366550.456638:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1789366550.456649:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1789366550.456655:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963785f28a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3284:x1876286758747136:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789366550.456680:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963785f28a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3284:x1876286758747136:12345-0@lo:400:kworker.0 Request processed in 25us (408us total) trans 0 rc 0/0 00000100:00100000:0.0:1789366550.456685:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1789366550.456702:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286758747264 00000100:00100000:0.0:1789366550.456705:0:6661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286758747264 00000100:00100000:0.0:1789366550.456746:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286758747520 00000100:00100000:0.0:1789366550.456750:0:6661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286758747520 00000100:00100000:0.0:1789366550.456770:0:6661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1789366550.456776:0:6661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963785f29c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3287:x1876286758747264:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789366550.456804:0:6661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963785f29c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3287:x1876286758747264:12345-0@lo:400:kworker.0 Request processed in 29us (676us total) trans 0 rc 0/0 00000100:00100000:0.0:1789366550.456811:0:6661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1789366550.456821:0:6661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1789366550.456826:0:6661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963785f2a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3284:x1876286758747520:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789366550.456862:0:6661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963785f2a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3284:x1876286758747520:12345-0@lo:400:kworker.0 Request processed in 36us (631us total) trans 0 rc 0/0 00000100:00100000:0.0:1789366550.456868:0:6661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00080000:0.0:1789366550.456901:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789366550.456905:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789366550.456908:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789366550.456945:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9638b4f18e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3284:1876286758747136:0@lo:400:kworker.0 00000100:00100000:0.0:1789366550.456957:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9638b4f1b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3284:1876286758747008:0@lo:400:kworker.0 00010000:00080000:0.0:1789366550.456969:0:3284:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9638b4f19880 x1876286758747520/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789366566 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789366550.456980:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9638b4f19880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3284:1876286758747520:0@lo:400:kworker.0 00010000:00080000:0.0:1789366550.457011:0:3287:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9638b4f19c00 x1876286758747264/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789366566 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789366550.457020:0:3287:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9638b4f19c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3287:1876286758747264:0@lo:400:kworker.0 00000100:00100000:0.0:1789366550.457029:0:3287:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9638b4f18000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8cde4528-5832-4854-a387-4adacc3dd0ab:3287:1876286758746880:0@lo:400:kworker.0 00000100:00100000:0.0:1789366550.457038:0:3287:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9638b4f1b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3287:1876286758747392:0@lo:400:kworker.0 00000100:00100000:3.0:1789366550.459664:0:3284:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789366550.459694:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9638bf5a8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3284:1876286758747648:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789366550.459769:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789366550.459827:0:6663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286758747648 00000100:00100000:3.0:1789366550.459834:0:6663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286758747648 00000100:00100000:3.0:1789366550.459873:0:6663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1789366550.459881:0:6663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638bf5a9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1876286758747648:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789366550.459912:0:6663:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789366550.459951:0:6663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638bf5a9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1876286758747648:12345-0@lo:13:osp-pre-1-0.0 Request processed in 69us (180us total) trans 0 rc 0/0 00000100:00100000:3.0:1789366550.459957:0:6663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00080000:3.0:1789366550.459995:0:3284:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9638bf5a8e00 x1876286758747648/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789366566 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789366550.460012:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9638bf5a8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3284:1876286758747648:0@lo:13:osp-pre-1-0.0 00000001:02000400:0.0:1789366551.087555:0:8773:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg223-server.virtnet: executing check_logdir /tmp/testlogs/ 00010000:00010000:2.0:1789366551.417057:0:6675:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789366552.440075:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789366552.831748:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:0.0:1789366552.831789:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:0.0:1789366552.831818:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:0.0:1789366552.831849:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:1.0:1789366552.831870:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751382016 00000100:00100000:0.0:1789366552.831875:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751382272 00000100:00100000:1.0:1789366552.831883:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751382016 00000100:00100000:0.0:1789366552.831883:0:6661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751382272 00000100:00100000:0.0:1789366552.831954:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751382144 00000100:00100000:0.0:1789366552.831957:0:6661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751382144 00000100:00100000:1.0:1789366552.831962:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 19 00000100:00100000:1.0:1789366552.831974:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963785f2bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0ab23baa-a205-44ad-bf17-f7b47295d82b+6:2354:x1876286751382016:12345-192.168.202.23@tcp:400:kworker.0 00000100:00100000:0.0:1789366552.831984:0:6661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 12 00000100:00100000:0.0:1789366552.831995:0:6661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963785f2ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0ab23baa-a205-44ad-bf17-f7b47295d82b+5:2354:x1876286751382272:12345-192.168.202.23@tcp:400:kworker.0 00000100:00100000:0.0:1789366552.832048:0:6661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963785f2ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0ab23baa-a205-44ad-bf17-f7b47295d82b+5:2354:x1876286751382272:12345-192.168.202.23@tcp:400:kworker.0 Request processed in 55us (257us total) trans 0 rc 0/0 00000100:00100000:0.0:1789366552.832056:0:6661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 12 00000100:00100000:0.0:1789366552.832074:0:6661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 13 00000100:00100000:0.0:1789366552.832080:0:6661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963785f2a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0ab23baa-a205-44ad-bf17-f7b47295d82b+5:2354:x1876286751382144:12345-192.168.202.23@tcp:400:kworker.0 00000100:00100000:2.0:1789366552.832954:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751381888 00000100:00100000:2.0:1789366552.832960:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751381888 00000100:00100000:2.0:1789366552.832996:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 184 00000100:00100000:2.0:1789366552.833005:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638b4e3a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:14a2847b-91d8-4d87-b71b-010443acc91a+10:2354:x1876286751381888:12345-192.168.202.23@tcp:400:kworker.0 00000100:00100000:0.0:1789366552.837068:0:6661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963785f2a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0ab23baa-a205-44ad-bf17-f7b47295d82b+5:2354:x1876286751382144:12345-192.168.202.23@tcp:400:kworker.0 Request processed in 4969us (5200us total) trans 0 rc 0/0 00000100:00100000:0.0:1789366552.837084:0:6661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 13 00000100:00080000:0.0:1789366552.837185:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789366552.837190:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789366552.837194:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789366552.842209:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638b4e3a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:14a2847b-91d8-4d87-b71b-010443acc91a+10:2354:x1876286751381888:12345-192.168.202.23@tcp:400:kworker.0 Request processed in 9193us (10378us total) trans 0 rc 0/0 00000100:00100000:2.0:1789366552.842310:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 184 00000100:00100000:1.0:1789366552.842974:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963785f2bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0ab23baa-a205-44ad-bf17-f7b47295d82b+6:2354:x1876286751382016:12345-192.168.202.23@tcp:400:kworker.0 Request processed in 10999us (11233us total) trans 0 rc 0/0 00000100:00100000:1.0:1789366552.842986:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 19 00000100:00100000:3.0:1789366553.016303:0:3287:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789366553.016356:0:3287:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9638b73cce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3287:1876286758747776:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789366553.016426:0:3287:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789366553.016750:0:6662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286758747776 00000100:00100000:0.0:1789366553.016759:0:6662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286758747776 00000100:00080000:1.0:1789366553.016806:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789366553.016822:0:6662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1789366553.016832:0:6662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638bf5a8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3287:x1876286758747776:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789366553.016869:0:6662:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789366553.016922:0:6662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638bf5a8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3287:x1876286758747776:12345-0@lo:13:osp-pre-0-0.0 Request processed in 91us (496us total) trans 0 rc 0/0 00000100:00100000:0.0:1789366553.016929:0:6662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00080000:3.0:1789366553.016962:0:3287:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9638b73cce00 x1876286758747776/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789366569 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789366553.016978:0:3287:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9638b73cce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3287:1876286758747776:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1789366553.463831:0:5805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1789366554.282262:0:9020:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg223-server.virtnet: executing yml_node 00010000:00010000:2.0:1789366554.488949:0:6675:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789366555.512621:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789366555.578951:0:3287:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9638bf5a9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3287:1876286758747904:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789366555.579045:0:3287:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789366555.580591:0:7134:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286758747904 00000100:00100000:3.0:1789366555.580603:0:7134:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286758747904 00000100:00100000:3.0:1789366555.580692:0:7134:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1789366555.580703:0:7134:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963785f29880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3287:x1876286758747904:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789366555.580775:0:7134:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789366555.580851:0:7134:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963785f29880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3287:x1876286758747904:12345-0@lo:13:osp-pre-1-0.0 Request processed in 151us (1812us total) trans 0 rc 0/0 00000100:00100000:3.0:1789366555.580872:0:7134:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00080000:3.0:1789366555.580922:0:3287:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9638bf5a9f80 x1876286758747904/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789366571 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789366555.580942:0:3287:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9638bf5a9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3287:1876286758747904:0@lo:13:osp-pre-1-0.0 00000100:00080000:1.0:1789366555.582279:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789366555.585910:0:3287:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9638c1e6ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3287:1876286758748416:0@lo:400:kworker.0 00000100:00100000:2.0:1789366555.585975:0:3287:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789366555.586023:0:3287:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789366555.586029:0:3287:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9638c1e6ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3287:1876286758748288:0@lo:400:kworker.0 00000100:00100000:2.0:1789366555.586165:0:3287:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789366555.586639:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9638c1e6c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3285:1876286758748160:0@lo:400:kworker.0 00000100:00100000:0.0:1789366555.586668:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789366555.586696:0:3285:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1789366555.586702:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9638c1e6d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8cde4528-5832-4854-a387-4adacc3dd0ab:3285:1876286758748032:0@lo:400:kworker.0 00000100:00100000:0.0:1789366555.586768:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789366555.586791:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9638c1e6e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3285:1876286758748544:0@lo:400:kworker.0 00000100:00100000:0.0:1789366555.586815:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789366555.586935:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286758748416 00000100:00100000:0.0:1789366555.586943:0:6661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286758748416 00000100:00100000:0.0:1789366555.586989:0:6661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1789366555.586997:0:6661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638c1e6dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3287:x1876286758748416:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789366555.587039:0:6661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638c1e6dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3287:x1876286758748416:12345-0@lo:400:kworker.0 Request processed in 42us (1065us total) trans 0 rc 0/0 00000100:00100000:0.0:1789366555.587103:0:6661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1789366555.587135:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286758748288 00000100:00100000:0.0:1789366555.587138:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286758748288 00000100:00100000:0.0:1789366555.587237:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286758748160 00000100:00100000:0.0:1789366555.587240:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286758748160 00000100:00100000:0.0:1789366555.587251:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286758748544 00000100:00100000:0.0:1789366555.587253:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286758748544 00000100:00100000:0.0:1789366555.587264:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1789366555.587269:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638c1e6d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3287:x1876286758748288:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789366555.587297:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638c1e6d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3287:x1876286758748288:12345-0@lo:400:kworker.0 Request processed in 27us (1132us total) trans 0 rc 0/0 00000100:00100000:0.0:1789366555.587303:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1789366555.587311:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1789366555.587330:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963785f28700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3285:x1876286758748160:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789366555.587355:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963785f28700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3285:x1876286758748160:12345-0@lo:400:kworker.0 Request processed in 26us (687us total) trans 0 rc 0/0 00000100:00100000:0.0:1789366555.587361:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1789366555.587370:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1789366555.587375:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638b4f1b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3285:x1876286758748544:12345-0@lo:400:kworker.0 00000100:00080000:1.0:1789366555.587580:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789366555.587585:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789366555.587650:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9638c1e6c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3285:1876286758748160:0@lo:400:kworker.0 00000100:00100000:2.0:1789366555.587858:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286758748032 00000100:00100000:2.0:1789366555.587872:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286758748032 00000100:00100000:2.0:1789366555.587906:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 185 00000100:00100000:2.0:1789366555.587912:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638b4e3a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8cde4528-5832-4854-a387-4adacc3dd0ab+19:3285:x1876286758748032:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789366555.588203:0:3287:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9638c1e6ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3287:1876286758748288:0@lo:400:kworker.0 00010000:00080000:3.0:1789366555.588221:0:3287:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9638c1e6ca80 x1876286758748416/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789366571 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789366555.588232:0:3287:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9638c1e6ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3287:1876286758748416:0@lo:400:kworker.0 00000100:00100000:3.0:1789366555.590409:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638b4e3a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8cde4528-5832-4854-a387-4adacc3dd0ab+19:3285:x1876286758748032:12345-0@lo:400:kworker.0 Request processed in 2488us (3632us total) trans 0 rc 0/0 00000100:00100000:3.0:1789366555.590421:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 185 00000100:00100000:1.0:1789366555.590518:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9638c1e6d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8cde4528-5832-4854-a387-4adacc3dd0ab:3285:1876286758748032:0@lo:400:kworker.0 00000100:00100000:0.0:1789366555.590834:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638b4f1b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3285:x1876286758748544:12345-0@lo:400:kworker.0 Request processed in 3456us (4015us total) trans 0 rc 0/0 00000100:00100000:0.0:1789366555.590843:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1789366555.590872:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9638c1e6e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3285:1876286758748544:0@lo:400:kworker.0 00010000:00010000:0.0:1789366556.538855:0:5805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1789366557.489662:0:9211:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Client: 2.17.58.6 00010000:00010000:2.0:1789366557.559942:0:6675:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789366557.902416:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:3.0:1789366557.902475:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:3.0:1789366557.902506:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:3.0:1789366557.902531:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:0.0:1789366557.902595:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751382528 00000100:00100000:0.0:1789366557.902605:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751382528 00000100:00100000:0.0:1789366557.902679:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 23 00000100:00100000:0.0:1789366557.902689:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638bf5a9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0ab23baa-a205-44ad-bf17-f7b47295d82b+6:2354:x1876286751382528:12345-192.168.202.23@tcp:400:kworker.0 00000100:00100000:0.0:1789366557.902783:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638bf5a9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0ab23baa-a205-44ad-bf17-f7b47295d82b+6:2354:x1876286751382528:12345-192.168.202.23@tcp:400:kworker.0 Request processed in 95us (375us total) trans 0 rc 0/0 00000100:00100000:0.0:1789366557.902791:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 23 00000100:00100000:0.0:1789366557.902814:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751382656 00000100:00100000:0.0:1789366557.902831:0:6660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751382656 00000100:00100000:0.0:1789366557.902855:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751382784 00000100:00100000:0.0:1789366557.902858:0:6660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751382784 00000100:00100000:0.0:1789366557.902876:0:6660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 15 00000100:00100000:0.0:1789366557.902882:0:6660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638bf5aaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0ab23baa-a205-44ad-bf17-f7b47295d82b+5:2355:x1876286751382656:12345-192.168.202.23@tcp:400:kworker.0 00000100:00100000:0.0:1789366557.902909:0:6660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638bf5aaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0ab23baa-a205-44ad-bf17-f7b47295d82b+5:2355:x1876286751382656:12345-192.168.202.23@tcp:400:kworker.0 Request processed in 26us (403us total) trans 0 rc 0/0 00000100:00100000:0.0:1789366557.902916:0:6660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 15 00000100:00100000:0.0:1789366557.902937:0:6660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 16 00000100:00100000:0.0:1789366557.902944:0:6660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638bf5a9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0ab23baa-a205-44ad-bf17-f7b47295d82b+5:2354:x1876286751382784:12345-192.168.202.23@tcp:400:kworker.0 00000100:00100000:0.0:1789366557.902971:0:6660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638bf5a9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0ab23baa-a205-44ad-bf17-f7b47295d82b+5:2354:x1876286751382784:12345-192.168.202.23@tcp:400:kworker.0 Request processed in 27us (439us total) trans 0 rc 0/0 00000100:00100000:0.0:1789366557.902977:0:6660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 16 00000100:00100000:2.0:1789366557.903274:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751382400 00000100:00100000:2.0:1789366557.903280:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751382400 00000100:00100000:2.0:1789366557.903322:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 186 00000100:00100000:2.0:1789366557.903330:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638b4e3a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:14a2847b-91d8-4d87-b71b-010443acc91a+10:2355:x1876286751382400:12345-192.168.202.23@tcp:400:kworker.0 00000100:00100000:2.0:1789366557.903365:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638b4e3a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:14a2847b-91d8-4d87-b71b-010443acc91a+10:2355:x1876286751382400:12345-192.168.202.23@tcp:400:kworker.0 Request processed in 36us (889us total) trans 0 rc 0/0 00000100:00100000:2.0:1789366557.903372:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 186 00000100:00080000:3.0:1789366557.903686:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789366557.903691:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789366557.903694:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789366558.138596:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9638b73ce300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3285:1876286758748672:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789366558.138666:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789366558.141169:0:6662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286758748672 00000100:00100000:3.0:1789366558.141182:0:6662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286758748672 00000100:00100000:3.0:1789366558.141235:0:6662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1789366558.141244:0:6662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638bf5a8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1876286758748672:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789366558.141289:0:6662:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789366558.141370:0:6662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638bf5a8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1876286758748672:12345-0@lo:13:osp-pre-0-0.0 Request processed in 128us (2704us total) trans 0 rc 0/0 00000100:00100000:3.0:1789366558.141378:0:6662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00080000:3.0:1789366558.141408:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1789366558.141601:0:3285:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9638b73ce300 x1876286758748672/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789366574 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789366558.141620:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9638b73ce300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3285:1876286758748672:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1789366558.588146:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1789366559.507368:0:9309:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: MDS: 2.17.58.6 00010000:00010000:0.0:1789366559.608864:0:5805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789366560.631950:0:6675:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789366560.695995:0:3287:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789366560.696025:0:3287:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9638bf5a9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3287:1876286758748800:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789366560.696277:0:3287:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789366560.698466:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9638987e8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3285:1876286758749184:0@lo:400:kworker.0 00000100:00100000:2.0:1789366560.698537:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789366560.698570:0:3285:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789366560.698575:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9638987e8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3285:1876286758749056:0@lo:400:kworker.0 00000100:00100000:2.0:1789366560.698596:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789366560.698626:0:7132:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286758749184 00000100:00100000:2.0:1789366560.698635:0:7132:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286758749184 00000100:00100000:2.0:1789366560.698692:0:7132:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286758749056 00000100:00100000:2.0:1789366560.698694:0:7132:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286758749056 00000100:00100000:2.0:1789366560.698714:0:7132:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1789366560.698736:0:7132:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638c1e6d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3285:x1876286758749184:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789366560.698935:0:7132:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638c1e6d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3285:x1876286758749184:12345-0@lo:400:kworker.0 Request processed in 200us (397us total) trans 0 rc 0/0 00000100:00100000:2.0:1789366560.698944:0:7132:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1789366560.698976:0:7132:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1789366560.698984:0:7132:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638c1e6ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3285:x1876286758749056:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789366560.699011:0:7132:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638c1e6ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3285:x1876286758749056:12345-0@lo:400:kworker.0 Request processed in 29us (414us total) trans 0 rc 0/0 00000100:00100000:2.0:1789366560.699017:0:7132:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00080000:2.0:1789366560.699032:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789366560.699051:0:3286:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9638987eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3286:1876286758749312:0@lo:400:kworker.0 00000100:00100000:2.0:1789366560.699175:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789366560.699196:0:3286:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1789366560.699202:0:3286:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9638987e9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8cde4528-5832-4854-a387-4adacc3dd0ab:3286:1876286758748928:0@lo:400:kworker.0 00000100:00100000:2.0:1789366560.699227:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789366560.699251:0:3286:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9638987ead80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3286:1876286758749440:0@lo:400:kworker.0 00000100:00100000:2.0:1789366560.699268:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789366560.699296:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286758749312 00000100:00100000:2.0:1789366560.699301:0:6660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286758749312 00000100:00100000:2.0:1789366560.699338:0:6660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1789366560.699344:0:6660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638c1e6e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3286:x1876286758749312:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789366560.699379:0:6660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638c1e6e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3286:x1876286758749312:12345-0@lo:400:kworker.0 Request processed in 36us (204us total) trans 0 rc 0/0 00000100:00100000:2.0:1789366560.699385:0:6660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1789366560.699405:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286758748928 00000100:00100000:2.0:1789366560.699408:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286758748928 00000100:00100000:2.0:1789366560.699430:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 187 00000100:00100000:2.0:1789366560.699446:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638b4e3b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8cde4528-5832-4854-a387-4adacc3dd0ab+19:3286:x1876286758748928:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789366560.699475:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638b4e3b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8cde4528-5832-4854-a387-4adacc3dd0ab+19:3286:x1876286758748928:12345-0@lo:400:kworker.0 Request processed in 31us (247us total) trans 0 rc 0/0 00000100:00100000:2.0:1789366560.699481:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 187 00000100:00100000:2.0:1789366560.699875:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286758749440 00000100:00100000:2.0:1789366560.699879:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286758749440 00000100:00100000:2.0:1789366560.699904:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1789366560.699909:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638c1e6e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3286:x1876286758749440:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789366560.699940:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638c1e6e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3286:x1876286758749440:12345-0@lo:400:kworker.0 Request processed in 31us (670us total) trans 0 rc 0/0 00000100:00100000:2.0:1789366560.699946:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00080000:3.0:1789366560.700029:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789366560.700033:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789366560.700621:0:6663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286758748800 00000100:00100000:1.0:1789366560.700628:0:6663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286758748800 00000100:00080000:1.0:1789366560.700650:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789366560.700685:0:6662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1789366560.700693:0:6662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638987e8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3287:x1876286758748800:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789366560.700747:0:6662:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789366560.700919:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9638987e8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3285:1876286758749056:0@lo:400:kworker.0 00000100:00100000:3.0:1789366560.700933:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9638987e8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3285:1876286758749184:0@lo:400:kworker.0 00000100:00100000:1.0:1789366560.701025:0:6662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638987e8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3287:x1876286758748800:12345-0@lo:13:osp-pre-1-0.0 Request processed in 333us (4748us total) trans 0 rc 0/0 00000100:00100000:1.0:1789366560.701031:0:6662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00080000:3.0:1789366560.703617:0:3287:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9638bf5a9500 x1876286758748800/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789366576 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789366560.703647:0:3287:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9638bf5a9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3287:1876286758748800:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789366560.706628:0:3286:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9638987e9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8cde4528-5832-4854-a387-4adacc3dd0ab:3286:1876286758748928:0@lo:400:kworker.0 00000100:00100000:0.0:1789366560.706651:0:3286:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9638987ead80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3286:1876286758749440:0@lo:400:kworker.0 00010000:00080000:0.0:1789366560.706667:0:3286:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9638987eb480 x1876286758749312/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789366576 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789366560.706678:0:3286:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9638987eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3286:1876286758749312:0@lo:400:kworker.0 00000001:02000400:0.0:1789366561.344179:0:9406:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: OSS: 2.17.58.6 00010000:00010000:0.0:1789366561.657228:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1789366562.635867:0:9455:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: -----============= acceptance-small: sanity-pcc ============----- Mon Sep 14 02:16:01 EDT 2026 00010000:00010000:0.0:1789366562.681642:0:5805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789366563.029211:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:3.0:1789366563.029336:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:0.0:1789366563.029370:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751383168 00000100:00100000:0.0:1789366563.029380:0:6661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751383168 00000100:00100000:3.0:1789366563.029472:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:0.0:1789366563.029562:0:6661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 10 00000100:00100000:0.0:1789366563.029573:0:6661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638987e8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0ab23baa-a205-44ad-bf17-f7b47295d82b+5:2353:x1876286751383168:12345-192.168.202.23@tcp:9:kworker.0 00000020:00000080:0.0:1789366563.029607:0:6661:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x8da3486b955f303e 00000100:00080000:0.0:1789366563.029616:0:6661:0:(import.c:65:import_set_state_nolock()) ffff9638b737d800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1789366563.029657:0:6661:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:0.0:1789366563.029982:0:6661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638987e8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0ab23baa-a205-44ad-bf17-f7b47295d82b+2:2353:x1876286751383168:12345-192.168.202.23@tcp:9:kworker.0 Request processed in 411us (834us total) trans 0 rc 0/0 00000100:00100000:0.0:1789366563.030004:0:6661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 10 00010000:00010000:0.0:1789366563.030025:0:6675:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1789366563.030218:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789366563.030231:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751383040 00000100:00100000:2.0:1789366563.030236:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751383040 00000100:00100000:2.0:1789366563.030280:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 27 00000100:00100000:2.0:1789366563.030288:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638987e8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0ab23baa-a205-44ad-bf17-f7b47295d82b+6:2355:x1876286751383040:12345-192.168.202.23@tcp:400:kworker.0 00000100:00100000:2.0:1789366563.030320:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638987e8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0ab23baa-a205-44ad-bf17-f7b47295d82b+6:2355:x1876286751383040:12345-192.168.202.23@tcp:400:kworker.0 Request processed in 33us (848us total) trans 0 rc 0/0 00000100:00100000:2.0:1789366563.030326:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 27 00000100:00080000:0.0:1789366563.030427:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789366563.031145:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:2.0:1789366563.031214:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751383296 00000100:00100000:2.0:1789366563.031219:0:6660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751383296 00000100:00100000:2.0:1789366563.031263:0:6660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 11 00000100:00100000:2.0:1789366563.031270:0:6660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638987ea680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0ab23baa-a205-44ad-bf17-f7b47295d82b+5:2353:x1876286751383296:12345-192.168.202.23@tcp:9:kworker.0 00000020:00000080:2.0:1789366563.031290:0:6660:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x8da3486b955f3045 00000100:00080000:2.0:1789366563.031297:0:6660:0:(import.c:65:import_set_state_nolock()) ffff9638b737f000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1789366563.031322:0:6660:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:2.0:1789366563.031559:0:6660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638987ea680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0ab23baa-a205-44ad-bf17-f7b47295d82b+2:2353:x1876286751383296:12345-192.168.202.23@tcp:9:kworker.0 Request processed in 289us (414us total) trans 0 rc 0/0 00000100:00100000:2.0:1789366563.031567:0:6660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 11 00010000:00010000:2.0:1789366563.031582:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1789366563.031784:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789366563.032381:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751382912 00000100:00100000:1.0:1789366563.032388:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751382912 00000100:00100000:1.0:1789366563.032450:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 188 00000100:00100000:1.0:1789366563.032458:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638b4e39050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:14a2847b-91d8-4d87-b71b-010443acc91a+10:2355:x1876286751382912:12345-192.168.202.23@tcp:400:kworker.0 00000100:00100000:1.0:1789366563.032507:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638b4e39050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:14a2847b-91d8-4d87-b71b-010443acc91a+10:2355:x1876286751382912:12345-192.168.202.23@tcp:400:kworker.0 Request processed in 50us (3171us total) trans 0 rc 0/0 00000100:00100000:1.0:1789366563.032515:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 188 00000100:00100000:1.0:1789366563.256204:0:3285:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789366563.256229:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9638b73ce300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3285:1876286758749568:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789366563.256298:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789366563.256371:0:7134:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286758749568 00000100:00100000:1.0:1789366563.256585:0:7134:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286758749568 00000100:00080000:0.0:1789366563.257101:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789366563.257417:0:7134:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1789366563.257439:0:7134:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638b73cce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1876286758749568:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789366563.257475:0:7134:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789366563.257534:0:7134:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638b73cce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1876286758749568:12345-0@lo:13:osp-pre-0-0.0 Request processed in 97us (1235us total) trans 0 rc 0/0 00000100:00100000:1.0:1789366563.257541:0:7134:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00080000:0.0:1789366563.257603:0:3285:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9638b73ce300 x1876286758749568/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789366579 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789366563.257621:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9638b73ce300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3285:1876286758749568:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1789366563.704074:0:5805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789366564.734515:0:6675:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1789366565.353848:0:6685:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 0ab23baa-a205-44ad-bf17-f7b47295d82b 00000020:00000080:2.0:1789366565.353870:0:6685:0:(genops.c:885:class_export_put()) final put ffff9638b737b000/0ab23baa-a205-44ad-bf17-f7b47295d82b 00000020:00000080:3.0:1789366565.354466:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9638b737b000/0ab23baa-a205-44ad-bf17-f7b47295d82b for lustre-OST0000 00000020:00000080:3.0:1789366565.354564:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9638b737d800 for lustre-OST0000 00010000:00010000:2.0:1789366565.751992:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789366565.815987:0:3284:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789366565.816009:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9638987eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3284:1876286758749696:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789366565.816231:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789366565.816490:0:6663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286758749696 00000100:00100000:1.0:1789366565.816499:0:6663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286758749696 00000100:00100000:1.0:1789366565.816570:0:6663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1789366565.816579:0:6663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638987ead80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1876286758749696:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789366565.816614:0:6663:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789366565.816665:0:6663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638987ead80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1876286758749696:12345-0@lo:13:osp-pre-1-0.0 Request processed in 87us (434us total) trans 0 rc 0/0 00000100:00100000:1.0:1789366565.816673:0:6663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1789366565.816987:0:3286:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9638b4f18000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8cde4528-5832-4854-a387-4adacc3dd0ab:3286:1876286758749824:0@lo:400:kworker.0 00000100:00100000:0.0:1789366565.817034:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789366565.817061:0:3286:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9638b4f18e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3286:1876286758750336:0@lo:400:kworker.0 00000100:00100000:2.0:1789366565.817267:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286758749824 00000100:00100000:2.0:1789366565.817273:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286758749824 00000100:00100000:2.0:1789366565.817305:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 189 00000100:00100000:2.0:1789366565.817313:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638b4e38850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8cde4528-5832-4854-a387-4adacc3dd0ab+19:3286:x1876286758749824:12345-0@lo:400:kworker.0 00000100:00080000:3.0:1789366565.817379:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789366565.817405:0:3287:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9638b4f19c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3287:1876286758749952:0@lo:400:kworker.0 00010000:00080000:1.0:1789366565.817778:0:3284:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9638987eb480 x1876286758749696/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789366581 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789366565.817802:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9638987eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3284:1876286758749696:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789366565.817829:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9638b4f19880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3284:1876286758750080:0@lo:400:kworker.0 00000100:00100000:2.0:1789366565.824332:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638b4e38850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8cde4528-5832-4854-a387-4adacc3dd0ab+19:3286:x1876286758749824:12345-0@lo:400:kworker.0 Request processed in 7011us (7288us total) trans 0 rc 0/0 00000100:00100000:2.0:1789366565.824347:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 189 00000100:00100000:2.0:1789366565.827009:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9638b4f1b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3285:1876286758750208:0@lo:400:kworker.0 00000100:00100000:2.0:1789366565.827102:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789366565.827204:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286758750208 00000100:00100000:2.0:1789366565.827213:0:6661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286758750208 00000100:00100000:2.0:1789366565.827271:0:6661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1789366565.827279:0:6661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638c1e6d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3285:x1876286758750208:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789366565.827328:0:6661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638c1e6d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3285:x1876286758750208:12345-0@lo:400:kworker.0 Request processed in 50us (227us total) trans 0 rc 0/0 00000100:00100000:2.0:1789366565.827335:0:6661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00080000:2.0:1789366565.827374:0:3285:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9638b4f1b480 x1876286758750208/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789366581 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789366565.827388:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9638b4f1b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3285:1876286758750208:0@lo:400:kworker.0 00000100:00080000:2.0:1789366565.827430:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789366565.830080:0:3287:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789366565.830193:0:7614:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286758749952 00000100:00100000:2.0:1789366565.830201:0:7614:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286758749952 00000100:00100000:2.0:1789366565.830253:0:7614:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1789366565.830262:0:7614:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638987e9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3287:x1876286758749952:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789366565.830316:0:7614:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638987e9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3287:x1876286758749952:12345-0@lo:400:kworker.0 Request processed in 55us (241us total) trans 0 rc 0/0 00000100:00100000:2.0:1789366565.830323:0:7614:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1789366565.830397:0:3287:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9638b4f19c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3287:1876286758749952:0@lo:400:kworker.0 00000100:00100000:0.0:1789366565.830652:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789366565.830702:0:3286:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9638b4f18000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8cde4528-5832-4854-a387-4adacc3dd0ab:3286:1876286758749824:0@lo:400:kworker.0 00000100:00100000:2.0:1789366565.830887:0:7132:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286758750336 00000100:00100000:2.0:1789366565.830891:0:7132:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286758750336 00000100:00100000:2.0:1789366565.830920:0:7132:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1789366565.830926:0:7132:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638b4f19c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3286:x1876286758750336:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789366565.830959:0:7132:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638b4f19c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3286:x1876286758750336:12345-0@lo:400:kworker.0 Request processed in 33us (307us total) trans 0 rc 0/0 00000100:00100000:2.0:1789366565.830965:0:7132:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00080000:0.0:1789366565.831065:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789366565.831084:0:3286:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9638b4f18e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3286:1876286758750336:0@lo:400:kworker.0 00000100:00100000:1.0:1789366565.831318:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789366565.831411:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286758750080 00000100:00100000:2.0:1789366565.831416:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286758750080 00000100:00100000:2.0:1789366565.831509:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1789366565.831516:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638b73cd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3284:x1876286758750080:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789366565.831559:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638b73cd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3284:x1876286758750080:12345-0@lo:400:kworker.0 Request processed in 43us (241us total) trans 0 rc 0/0 00000100:00100000:2.0:1789366565.831564:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1789366565.831610:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9638b4f19880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3284:1876286758750080:0@lo:400:kworker.0 00000100:00080000:0.0:1789366565.831657:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1789366566.776032:0:5805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1789366566.905526:0:7617:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 0ab23baa-a205-44ad-bf17-f7b47295d82b 00000020:00000080:3.0:1789366566.905535:0:7617:0:(genops.c:885:class_export_put()) final put ffff9638b737d000/0ab23baa-a205-44ad-bf17-f7b47295d82b 00000020:00000080:2.0:1789366566.905590:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9638b737d000/0ab23baa-a205-44ad-bf17-f7b47295d82b for lustre-OST0001 00000020:00000080:2.0:1789366566.905639:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9638b737f000 for lustre-OST0001 00010000:00010000:1.0:1789366567.807459:0:6675:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789366568.151496:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:3.0:1789366568.151547:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:1.0:1789366568.151553:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751383424 00000100:00100000:1.0:1789366568.151564:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751383424 00000100:00100000:2.0:1789366568.151705:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751383552 00000100:00100000:2.0:1789366568.151710:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751383552 00000100:00100000:2.0:1789366568.151800:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 31 00000100:00100000:2.0:1789366568.151820:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638987eb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0ab23baa-a205-44ad-bf17-f7b47295d82b+6:2354:x1876286751383552:12345-192.168.202.23@tcp:400:kworker.0 00000100:00080000:3.0:1789366568.151834:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789366568.151900:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638987eb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0ab23baa-a205-44ad-bf17-f7b47295d82b+6:2354:x1876286751383552:12345-192.168.202.23@tcp:400:kworker.0 Request processed in 82us (353us total) trans 0 rc 0/0 00000100:00100000:2.0:1789366568.151907:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 31 00000100:00100000:1.0:1789366568.152048:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 190 00000100:00100000:1.0:1789366568.152056:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638b4e38050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:14a2847b-91d8-4d87-b71b-010443acc91a+10:2355:x1876286751383424:12345-192.168.202.23@tcp:400:kworker.0 00000100:00100000:1.0:1789366568.152105:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638b4e38050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:14a2847b-91d8-4d87-b71b-010443acc91a+10:2355:x1876286751383424:12345-192.168.202.23@tcp:400:kworker.0 Request processed in 50us (616us total) trans 0 rc 0/0 00000100:00100000:1.0:1789366568.152112:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 190 00000100:00100000:3.0:1789366568.378584:0:3287:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9638b4f18e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3287:1876286758750464:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789366568.378655:0:3287:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789366568.378872:0:7134:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286758750464 00000100:00100000:1.0:1789366568.378880:0:7134:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286758750464 00000100:00100000:1.0:1789366568.378952:0:7134:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1789366568.378961:0:7134:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638bf5a9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3287:x1876286758750464:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789366568.379008:0:7134:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00080000:2.0:1789366568.379075:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789366568.382940:0:7134:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638bf5a9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3287:x1876286758750464:12345-0@lo:13:osp-pre-0-0.0 Request processed in 3972us (4277us total) trans 0 rc 0/0 00000100:00100000:1.0:1789366568.382954:0:7134:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00010000:00080000:3.0:1789366568.383085:0:3287:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9638b4f18e00 x1876286758750464/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789366584 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789366568.383110:0:3287:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9638b4f18e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3287:1876286758750464:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1789366568.877481:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789366570.024001:0:5805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789366571.017691:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9638c1e6ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3284:1876286758750592:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789366571.017905:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789366571.018080:0:6662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286758750592 00000100:00100000:1.0:1789366571.018089:0:6662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286758750592 00000100:00100000:1.0:1789366571.018185:0:6662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1789366571.018195:0:6662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638b73cd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1876286758750592:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789366571.018233:0:6662:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789366571.018285:0:6662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638b73cd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1876286758750592:12345-0@lo:13:osp-pre-1-0.0 Request processed in 92us (380us total) trans 0 rc 0/0 00000100:00100000:1.0:1789366571.018292:0:6662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00080000:1.0:1789366571.018326:0:3284:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9638c1e6ca80 x1876286758750592/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789366587 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789366571.018344:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9638c1e6ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3284:1876286758750592:0@lo:13:osp-pre-1-0.0 00000100:00080000:2.0:1789366571.018440:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789366571.021571:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9638b4f19880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3284:1876286758751104:0@lo:400:kworker.0 00000100:00100000:0.0:1789366571.021627:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789366571.021669:0:3284:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1789366571.021686:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9638b4f18000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8cde4528-5832-4854-a387-4adacc3dd0ab:3284:1876286758750720:0@lo:400:kworker.0 00000100:00100000:0.0:1789366571.021710:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789366571.022917:0:3287:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9638b4f18e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3287:1876286758750976:0@lo:400:kworker.0 00000100:00100000:3.0:1789366571.022965:0:3287:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789366571.023008:0:3287:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789366571.023013:0:3287:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9638b4f1b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3287:1876286758750848:0@lo:400:kworker.0 00000100:00100000:3.0:1789366571.023034:0:3287:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789366571.023173:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286758750976 00000100:00100000:3.0:1789366571.023180:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286758750976 00000100:00100000:3.0:1789366571.023230:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286758750848 00000100:00100000:3.0:1789366571.023233:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286758750848 00000100:00100000:3.0:1789366571.023250:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1789366571.023257:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638bf4b2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3287:x1876286758750976:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789366571.023357:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9638af2d7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3284:1876286758751232:0@lo:400:kworker.0 00000100:00100000:0.0:1789366571.023379:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789366571.023630:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638bf4b2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3287:x1876286758750976:12345-0@lo:400:kworker.0 Request processed in 373us (664us total) trans 0 rc 0/0 00000100:00100000:3.0:1789366571.023642:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1789366571.023656:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286758751232 00000100:00100000:3.0:1789366571.023659:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286758751232 00000100:00100000:3.0:1789366571.023673:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1789366571.023677:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638bf4b0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3287:x1876286758750848:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789366571.023700:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638bf4b0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3287:x1876286758750848:12345-0@lo:400:kworker.0 Request processed in 22us (665us total) trans 0 rc 0/0 00000100:00100000:3.0:1789366571.023705:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1789366571.023713:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1789366571.023818:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638af2d7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3284:x1876286758751232:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789366571.023849:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638af2d7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3284:x1876286758751232:12345-0@lo:400:kworker.0 Request processed in 131us (469us total) trans 0 rc 0/0 00000100:00100000:3.0:1789366571.023854:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00080000:3.0:1789366571.023995:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789366571.024028:0:3287:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9638b4f1b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3287:1876286758750848:0@lo:400:kworker.0 00000100:00100000:3.0:1789366571.024037:0:3287:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9638b4f18e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3287:1876286758750976:0@lo:400:kworker.0 00000100:00100000:3.0:1789366571.024064:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9638af2d7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3284:1876286758751232:0@lo:400:kworker.0 00000100:00100000:3.0:1789366571.024094:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286758750720 00000100:00100000:3.0:1789366571.024098:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286758750720 00000100:00100000:3.0:1789366571.024120:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 191 00000100:00100000:3.0:1789366571.024125:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638987e6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8cde4528-5832-4854-a387-4adacc3dd0ab+19:3284:x1876286758750720:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789366571.024157:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638987e6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8cde4528-5832-4854-a387-4adacc3dd0ab+19:3284:x1876286758750720:12345-0@lo:400:kworker.0 Request processed in 31us (2446us total) trans 0 rc 0/0 00000100:00100000:3.0:1789366571.024163:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 191 00000100:00100000:3.0:1789366571.024199:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286758751104 00000100:00100000:3.0:1789366571.024203:0:6660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286758751104 00000100:00100000:3.0:1789366571.024233:0:6660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1789366571.024239:0:6660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638af2d4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3284:x1876286758751104:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789366571.024278:0:6660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638af2d4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3284:x1876286758751104:12345-0@lo:400:kworker.0 Request processed in 39us (2651us total) trans 0 rc 0/0 00000100:00100000:3.0:1789366571.024284:0:6660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00080000:3.0:1789366571.024305:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789366571.024319:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9638b4f18000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8cde4528-5832-4854-a387-4adacc3dd0ab:3284:1876286758750720:0@lo:400:kworker.0 00010000:00080000:3.0:1789366571.024332:0:3284:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9638b4f19880 x1876286758751104/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789366587 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789366571.024342:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9638b4f19880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3284:1876286758751104:0@lo:400:kworker.0 00010000:00010000:1.0:1789366571.064908:0:6675:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789366572.087909:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789366573.115273:0:5805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789366573.262147:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:0.0:1789366573.262247:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:2.0:1789366573.262330:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751383680 00000100:00100000:2.0:1789366573.262339:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751383680 00000100:00100000:2.0:1789366573.262402:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 192 00000100:00100000:2.0:1789366573.262411:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638b4e84050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:14a2847b-91d8-4d87-b71b-010443acc91a+10:2355:x1876286751383680:12345-192.168.202.23@tcp:400:kworker.0 00000100:00100000:2.0:1789366573.262493:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638b4e84050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:14a2847b-91d8-4d87-b71b-010443acc91a+10:2355:x1876286751383680:12345-192.168.202.23@tcp:400:kworker.0 Request processed in 82us (355us total) trans 0 rc 0/0 00000100:00100000:2.0:1789366573.262501:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 192 00000100:00100000:3.0:1789366573.262921:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751383808 00000100:00100000:3.0:1789366573.262926:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751383808 00000100:00100000:3.0:1789366573.263021:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 35 00000100:00100000:3.0:1789366573.263029:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638af2d6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0ab23baa-a205-44ad-bf17-f7b47295d82b+6:2355:x1876286751383808:12345-192.168.202.23@tcp:400:kworker.0 00000100:00100000:3.0:1789366573.263078:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638af2d6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0ab23baa-a205-44ad-bf17-f7b47295d82b+6:2355:x1876286751383808:12345-192.168.202.23@tcp:400:kworker.0 Request processed in 49us (830us total) trans 0 rc 0/0 00000100:00100000:3.0:1789366573.263085:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 35 00000100:00080000:0.0:1789366573.263435:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789366573.496022:0:3286:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9638bf4b2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3286:1876286758751360:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789366573.496092:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789366573.496340:0:7134:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286758751360 00000100:00100000:2.0:1789366573.496348:0:7134:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286758751360 00000100:00100000:2.0:1789366573.496403:0:7134:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1789366573.496412:0:7134:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638b73cdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3286:x1876286758751360:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789366573.496446:0:7134:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00080000:3.0:1789366573.496516:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789366573.497465:0:7134:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638b73cdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3286:x1876286758751360:12345-0@lo:13:osp-pre-0-0.0 Request processed in 1053us (1372us total) trans 0 rc 0/0 00000100:00100000:2.0:1789366573.497474:0:7134:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00010000:00080000:1.0:1789366573.497582:0:3286:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9638bf4b2680 x1876286758751360/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789366589 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789366573.497602:0:3286:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9638bf4b2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3286:1876286758751360:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1789366574.136034:0:6675:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1789366574.902515:0:10089:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: start setup 02:16:14 (1789366574) === 00010000:00010000:3.0:1789366575.160042:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789366575.437506:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:1.0:1789366575.442751:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751383936 00000100:00100000:1.0:1789366575.442770:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751383936 00000100:00100000:1.0:1789366575.442848:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 193 00000100:00100000:1.0:1789366575.442859:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638b4e85450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:14a2847b-91d8-4d87-b71b-010443acc91a+10:8121:x1876286751383936:12345-192.168.202.23@tcp:101:mount.lustre.0 00010000:00010000:1.0:1789366575.442878:0:5808:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789366575.442899:0:5808:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff96388148e400/0x8da3486b955f3109 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0xda917a494d06bee7 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366575.442942:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff96388148e400/0x8da3486b955f3109 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.202.23@tcp remote: 0xda917a494d06bee7 expref: 11 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366575.442954:0:5808:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff96388148e400/0x8da3486b955f3109 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.202.23@tcp remote: 0xda917a494d06bee7 expref: 11 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366575.442963:0:5808:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96388148e400, rc 0) 00000100:00100000:1.0:1789366575.443025:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638b4e85450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:14a2847b-91d8-4d87-b71b-010443acc91a+11:8121:x1876286751383936:12345-192.168.202.23@tcp:101:mount.lustre.0 Request processed in 168us (5532us total) trans 0 rc 0/0 00000100:00100000:1.0:1789366575.443032:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 193 00000100:00100000:2.0:1789366575.447134:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:0.0:1789366575.447226:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751384064 00000100:00100000:0.0:1789366575.447237:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751384064 00000100:00100000:0.0:1789366575.447310:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 194 00000100:00100000:0.0:1789366575.447321:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638b4e84c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:14a2847b-91d8-4d87-b71b-010443acc91a+11:8121:x1876286751384064:12345-192.168.202.23@tcp:501:mount.lustre.0 00000100:00100000:0.0:1789366575.447614:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638b4e84c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:14a2847b-91d8-4d87-b71b-010443acc91a+11:8121:x1876286751384064:12345-192.168.202.23@tcp:501:mount.lustre.0 Request processed in 294us (488us total) trans 0 rc 0/0 00000100:00100000:0.0:1789366575.447622:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 194 00000100:00100000:3.0:1789366575.449237:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:2.0:1789366575.449333:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751384192 00000100:00100000:2.0:1789366575.449342:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751384192 00000100:00100000:2.0:1789366575.449396:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 195 00000100:00100000:2.0:1789366575.449407:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638b4e85c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:14a2847b-91d8-4d87-b71b-010443acc91a+11:8121:x1876286751384192:12345-192.168.202.23@tcp:503:mount.lustre.0 00000100:00100000:2.0:1789366575.449622:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638b4e85c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:14a2847b-91d8-4d87-b71b-010443acc91a+11:8121:x1876286751384192:12345-192.168.202.23@tcp:503:mount.lustre.0 Request processed in 216us (391us total) trans 0 rc 0/0 00000100:00100000:2.0:1789366575.449630:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 195 00000100:00100000:3.0:1789366575.453172:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:1.0:1789366575.457953:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751384320 00000100:00100000:1.0:1789366575.457971:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751384320 00000100:00100000:1.0:1789366575.458099:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 196 00000100:00100000:1.0:1789366575.458111:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638b4e87850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:14a2847b-91d8-4d87-b71b-010443acc91a+11:8125:x1876286751384320:12345-192.168.202.23@tcp:502:llog_process_th.0 00000100:00100000:1.0:1789366575.458489:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638b4e87850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:14a2847b-91d8-4d87-b71b-010443acc91a+11:8125:x1876286751384320:12345-192.168.202.23@tcp:502:llog_process_th.0 Request processed in 379us (5325us total) trans 0 rc 0/0 00000100:00100000:1.0:1789366575.458499:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 196 00000100:00100000:3.0:1789366575.490500:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:0.0:1789366575.490593:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751384448 00000100:00100000:0.0:1789366575.490603:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751384448 00000100:00100000:0.0:1789366575.490673:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 197 00000100:00100000:0.0:1789366575.490685:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638b4e87c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:14a2847b-91d8-4d87-b71b-010443acc91a+11:8125:x1876286751384448:12345-192.168.202.23@tcp:502:llog_process_th.0 00000100:00100000:0.0:1789366575.490995:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638b4e87c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:14a2847b-91d8-4d87-b71b-010443acc91a+11:8125:x1876286751384448:12345-192.168.202.23@tcp:502:llog_process_th.0 Request processed in 312us (504us total) trans 0 rc 0/0 00000100:00100000:0.0:1789366575.491003:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 197 00000100:00100000:3.0:1789366575.496555:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:1.0:1789366575.496684:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751384576 00000100:00100000:1.0:1789366575.496695:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751384576 00000100:00100000:1.0:1789366575.496777:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 198 00000100:00100000:1.0:1789366575.496787:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638b4e86c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:14a2847b-91d8-4d87-b71b-010443acc91a+11:8121:x1876286751384576:12345-192.168.202.23@tcp:101:mount.lustre.0 00010000:00010000:1.0:1789366575.496808:0:5808:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789366575.496827:0:5808:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff96388148f400/0x8da3486b955f3110 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xda917a494d06bf11 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366575.496856:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff96388148f400/0x8da3486b955f3110 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.202.23@tcp remote: 0xda917a494d06bf11 expref: 12 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366575.496869:0:5808:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff96388148f400/0x8da3486b955f3110 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.202.23@tcp remote: 0xda917a494d06bf11 expref: 12 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366575.496879:0:5808:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96388148f400, rc 0) 00000100:00100000:1.0:1789366575.496945:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638b4e86c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:14a2847b-91d8-4d87-b71b-010443acc91a+12:8121:x1876286751384576:12345-192.168.202.23@tcp:101:mount.lustre.0 Request processed in 159us (402us total) trans 0 rc 0/0 00000100:00100000:1.0:1789366575.496952:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 198 00000100:00100000:3.0:1789366575.502883:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:2.0:1789366575.503037:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751384704 00000100:00100000:2.0:1789366575.503048:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751384704 00000100:00100000:2.0:1789366575.503106:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 199 00000100:00100000:2.0:1789366575.503117:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638b4e84450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:14a2847b-91d8-4d87-b71b-010443acc91a+12:8121:x1876286751384704:12345-192.168.202.23@tcp:256:mount.lustre.0 20000000:01000000:2.0:1789366575.503143:0:5810:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:2.0:1789366575.503167:0:5810:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:2.0:1789366575.503171:0:5810:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:2.0:1789366575.503174:0:5810:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:2.0:1789366575.503177:0:5810:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 5 00000100:00100000:2.0:1789366575.507446:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638b4e84450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:14a2847b-91d8-4d87-b71b-010443acc91a+12:8121:x1876286751384704:12345-192.168.202.23@tcp:256:mount.lustre.0 Request processed in 4321us (4563us total) trans 0 rc 0/0 00000100:00100000:2.0:1789366575.507463:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 199 00000100:00100000:3.0:1789366575.512321:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:0.0:1789366575.512467:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751384832 00000100:00100000:0.0:1789366575.512478:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751384832 00000100:00100000:0.0:1789366575.512538:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 200 00000100:00100000:0.0:1789366575.512548:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638b4e87050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:14a2847b-91d8-4d87-b71b-010443acc91a+12:8121:x1876286751384832:12345-192.168.202.23@tcp:101:mount.lustre.0 00010000:00010000:0.0:1789366575.512564:0:5811:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789366575.512583:0:5811:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9638827f6600/0x8da3486b955f3117 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xda917a494d06bf18 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366575.512610:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9638827f6600/0x8da3486b955f3117 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.202.23@tcp remote: 0xda917a494d06bf18 expref: 13 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366575.512639:0:5811:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9638827f6600/0x8da3486b955f3117 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.202.23@tcp remote: 0xda917a494d06bf18 expref: 13 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366575.512649:0:5811:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9638827f6600, rc 0) 00000100:00100000:0.0:1789366575.512953:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638b4e87050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:14a2847b-91d8-4d87-b71b-010443acc91a+13:8121:x1876286751384832:12345-192.168.202.23@tcp:101:mount.lustre.0 Request processed in 407us (641us total) trans 0 rc 0/0 00000100:00100000:0.0:1789366575.512960:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 200 00000100:00100000:3.0:1789366575.514490:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:2.0:1789366575.514574:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751384960 00000100:00100000:2.0:1789366575.514582:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751384960 00000100:00100000:2.0:1789366575.514631:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 201 00000100:00100000:2.0:1789366575.514639:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638b4e85850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:14a2847b-91d8-4d87-b71b-010443acc91a+13:8121:x1876286751384960:12345-192.168.202.23@tcp:501:mount.lustre.0 00000100:00100000:2.0:1789366575.515157:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638b4e85850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:14a2847b-91d8-4d87-b71b-010443acc91a+13:8121:x1876286751384960:12345-192.168.202.23@tcp:501:mount.lustre.0 Request processed in 517us (671us total) trans 0 rc 0/0 00000100:00100000:2.0:1789366575.515165:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 201 00000100:00100000:3.0:1789366575.516641:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:0.0:1789366575.523019:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751385088 00000100:00100000:0.0:1789366575.523033:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751385088 00000100:00100000:0.0:1789366575.523709:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 202 00000100:00100000:0.0:1789366575.523745:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638b4e86450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:14a2847b-91d8-4d87-b71b-010443acc91a+13:8121:x1876286751385088:12345-192.168.202.23@tcp:503:mount.lustre.0 00000100:00100000:0.0:1789366575.523977:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638b4e86450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:14a2847b-91d8-4d87-b71b-010443acc91a+13:8121:x1876286751385088:12345-192.168.202.23@tcp:503:mount.lustre.0 Request processed in 258us (7341us total) trans 0 rc 0/0 00000100:00100000:0.0:1789366575.523985:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 202 00000100:00100000:2.0:1789366575.526896:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:1.0:1789366575.528552:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751385216 00000100:00100000:1.0:1789366575.528563:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751385216 00000100:00100000:1.0:1789366575.528607:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 203 00000100:00100000:1.0:1789366575.528615:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638b4e86050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:14a2847b-91d8-4d87-b71b-010443acc91a+13:8128:x1876286751385216:12345-192.168.202.23@tcp:502:llog_process_th.0 00000100:00100000:1.0:1789366575.529106:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638b4e86050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:14a2847b-91d8-4d87-b71b-010443acc91a+13:8128:x1876286751385216:12345-192.168.202.23@tcp:502:llog_process_th.0 Request processed in 490us (2215us total) trans 0 rc 0/0 00000100:00100000:1.0:1789366575.529115:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 203 00000100:00100000:0.0:1789366575.542525:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:1.0:1789366575.542618:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751385344 00000100:00100000:1.0:1789366575.542627:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751385344 00000100:00100000:1.0:1789366575.542688:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 204 00000100:00100000:1.0:1789366575.542697:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638b4e86850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:14a2847b-91d8-4d87-b71b-010443acc91a+13:8128:x1876286751385344:12345-192.168.202.23@tcp:502:llog_process_th.0 00000100:00100000:1.0:1789366575.542974:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638b4e86850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:14a2847b-91d8-4d87-b71b-010443acc91a+13:8128:x1876286751385344:12345-192.168.202.23@tcp:502:llog_process_th.0 Request processed in 278us (459us total) trans 0 rc 0/0 00000100:00100000:1.0:1789366575.542983:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 204 00000100:00100000:3.0:1789366575.550492:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:3.0:1789366575.550533:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:1.0:1789366575.550816:0:7132:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751385856 00000100:00100000:1.0:1789366575.550828:0:7132:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751385856 00000100:00100000:1.0:1789366575.550893:0:7132:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751385472 00000100:00100000:1.0:1789366575.550896:0:7132:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751385472 00000100:00100000:1.0:1789366575.550914:0:7132:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 36 00000100:00100000:1.0:1789366575.550936:0:7132:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638bf4b1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0ab23baa-a205-44ad-bf17-f7b47295d82b+6:2354:x1876286751385856:12345-192.168.202.23@tcp:400:kworker.0 00000100:00100000:1.0:1789366575.551012:0:7132:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638bf4b1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0ab23baa-a205-44ad-bf17-f7b47295d82b+6:2354:x1876286751385856:12345-192.168.202.23@tcp:400:kworker.0 Request processed in 90us (529us total) trans 0 rc 0/0 00000100:00100000:1.0:1789366575.551019:0:7132:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 36 00000100:00100000:1.0:1789366575.551035:0:7132:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 10 00000100:00100000:1.0:1789366575.551040:0:7132:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638bf4b1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2353:x1876286751385472:12345-192.168.202.23@tcp:38:mount.lustre.0 00010000:00080000:1.0:1789366575.551064:0:7132:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from b9764435-e52f-45ac-a5f9-bab1231105ac@192.168.202.23@tcp t0 exp 0000000000000000 cur 151 last 0 00000020:00000080:1.0:1789366575.551104:0:7132:0:(genops.c:1385:class_connect()) connect: client b9764435-e52f-45ac-a5f9-bab1231105ac, cookie 0x8da3486b955f311e 00000004:00100000:1.0:1789366575.551139:0:7132:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:1.0:1789366575.551463:0:7132:0:(import.c:65:import_set_state_nolock()) ffff963785ebb800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789366575.551497:0:7132:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638bf4b1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b9764435-e52f-45ac-a5f9-bab1231105ac+6:2353:x1876286751385472:12345-192.168.202.23@tcp:38:mount.lustre.0 Request processed in 455us (963us total) trans 0 rc 0/0 00000100:00100000:1.0:1789366575.551504:0:7132:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 10 00000100:00080000:3.0:1789366575.552170:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789366575.556165:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:3.0:1789366575.556222:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:1.0:1789366575.556371:0:7614:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751385728 00000100:00100000:1.0:1789366575.556380:0:7614:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751385728 00000100:00100000:1.0:1789366575.556440:0:7614:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751385600 00000100:00100000:1.0:1789366575.556443:0:7614:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751385600 00000100:00100000:1.0:1789366575.556460:0:7614:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 11 00000100:00100000:1.0:1789366575.556469:0:7614:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638bf4b1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b9764435-e52f-45ac-a5f9-bab1231105ac+7:8121:x1876286751385728:12345-192.168.202.23@tcp:41:mount.lustre.0 00000004:00000024:1.0:1789366575.556509:0:7614:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:1.0:1789366575.556580:0:7614:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638bf4b1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b9764435-e52f-45ac-a5f9-bab1231105ac+7:8121:x1876286751385728:12345-192.168.202.23@tcp:41:mount.lustre.0 Request processed in 112us (422us total) trans 0 rc 0/0 00000100:00100000:1.0:1789366575.556588:0:7614:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 11 00000100:00100000:1.0:1789366575.556602:0:7614:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 12 00000100:00100000:1.0:1789366575.556607:0:7614:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638bf4b0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b9764435-e52f-45ac-a5f9-bab1231105ac+6:0:x1876286751385600:12345-192.168.202.23@tcp:41:mount.lustre.0 00000004:00000024:1.0:1789366575.556617:0:7614:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:1.0:1789366575.556634:0:7614:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638bf4b0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b9764435-e52f-45ac-a5f9-bab1231105ac+6:0:x1876286751385600:12345-192.168.202.23@tcp:41:mount.lustre.0 Request processed in 27us (413us total) trans 0 rc 0/0 00000100:00100000:1.0:1789366575.556640:0:7614:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 12 00000100:00080000:3.0:1789366575.557071:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789366575.558479:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:3.0:1789366575.558545:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751385984 00000100:00100000:3.0:1789366575.558551:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751385984 00000100:00100000:3.0:1789366575.558594:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 13 00000100:00100000:3.0:1789366575.558602:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638b73cca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b9764435-e52f-45ac-a5f9-bab1231105ac+6:8121:x1876286751385984:12345-192.168.202.23@tcp:40:mount.lustre.0 00000100:00100000:3.0:1789366575.558934:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638b73cca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b9764435-e52f-45ac-a5f9-bab1231105ac+6:8121:x1876286751385984:12345-192.168.202.23@tcp:40:mount.lustre.0 Request processed in 322us (449us total) trans 0 rc 0/0 00000100:00100000:3.0:1789366575.558942:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 13 00000100:00100000:3.0:1789366575.563397:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:3.0:1789366575.563441:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:3.0:1789366575.563470:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:0.0:1789366575.563541:0:8065:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751386112 00000100:00100000:0.0:1789366575.563552:0:8065:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751386112 00000100:00100000:0.0:1789366575.563641:0:8065:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751386240 00000100:00100000:0.0:1789366575.563645:0:8065:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751386240 00000100:00100000:0.0:1789366575.563677:0:8065:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 12 00000100:00100000:0.0:1789366575.563685:0:8065:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638bf4b3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2353:x1876286751386112:12345-192.168.202.23@tcp:8:mount.lustre.0 00010000:00080000:0.0:1789366575.563712:0:8065:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from b9764435-e52f-45ac-a5f9-bab1231105ac@192.168.202.23@tcp t0 exp 0000000000000000 cur 151 last 0 00000020:00000080:0.0:1789366575.563766:0:8065:0:(genops.c:1385:class_connect()) connect: client b9764435-e52f-45ac-a5f9-bab1231105ac, cookie 0x8da3486b955f3125 00002000:00100000:0.0:1789366575.563778:0:8065:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli b9764435-e52f-45ac-a5f9-bab1231105ac/ffff9638b7026800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a06 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1789366575.563813:0:8065:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:0.0:1789366575.564043:0:8065:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1789366575.564074:0:8065:0:(import.c:65:import_set_state_nolock()) ffff9638b7023800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789366575.564133:0:8065:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638bf4b3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b9764435-e52f-45ac-a5f9-bab1231105ac+6:2353:x1876286751386112:12345-192.168.202.23@tcp:8:mount.lustre.0 Request processed in 447us (691us total) trans 0 rc 0/0 00000100:00100000:0.0:1789366575.564140:0:8065:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 12 00000100:00100000:0.0:1789366575.564157:0:8065:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 13 00000100:00100000:0.0:1789366575.564161:0:8065:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638bf4b0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2353:x1876286751386240:12345-192.168.202.23@tcp:8:mount.lustre.0 00010000:00080000:0.0:1789366575.564175:0:8065:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from b9764435-e52f-45ac-a5f9-bab1231105ac@192.168.202.23@tcp t0 exp 0000000000000000 cur 151 last 0 00000020:00000080:0.0:1789366575.564188:0:8065:0:(genops.c:1385:class_connect()) connect: client b9764435-e52f-45ac-a5f9-bab1231105ac, cookie 0x8da3486b955f312c 00002000:00100000:0.0:1789366575.564194:0:8065:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli b9764435-e52f-45ac-a5f9-bab1231105ac/ffff9638b7025000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a06 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1789366575.564207:0:8065:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:0.0:1789366575.564315:0:8065:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1789366575.564329:0:8065:0:(import.c:65:import_set_state_nolock()) ffff9638b7027800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789366575.564349:0:8065:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638bf4b0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b9764435-e52f-45ac-a5f9-bab1231105ac+6:2353:x1876286751386240:12345-192.168.202.23@tcp:8:mount.lustre.0 Request processed in 187us (879us total) trans 0 rc 0/0 00000100:00100000:0.0:1789366575.564356:0:8065:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 13 00000100:00100000:1.0:1789366575.564429:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751386368 00000100:00100000:1.0:1789366575.564434:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751386368 00000100:00100000:1.0:1789366575.564471:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 1 00000100:00100000:1.0:1789366575.564478:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638bf4b2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b9764435-e52f-45ac-a5f9-bab1231105ac+6:8121:x1876286751386368:12345-192.168.202.23@tcp:33:mount.lustre.0 00000004:00200000:1.0:1789366575.564534:0:5818:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000100:00100000:1.0:1789366575.564582:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638bf4b2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b9764435-e52f-45ac-a5f9-bab1231105ac+6:8121:x1876286751386368:12345-192.168.202.23@tcp:33:mount.lustre.0 Request processed in 104us (1193us total) trans 0 rc 0/0 00000100:00100000:1.0:1789366575.564588:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 1 00000100:00100000:1.0:1789366576.056091:0:3287:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9638bf4b3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8cde4528-5832-4854-a387-4adacc3dd0ab:3287:1876286758751488:0@lo:400:kworker.0 00000100:00100000:1.0:1789366576.056162:0:3287:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789366576.056302:0:3287:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9638c1e6ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3287:1876286758752000:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789366576.056332:0:3287:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789366576.056358:0:3287:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789366576.056364:0:3287:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9638bf4b0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3287:1876286758751872:0@lo:400:kworker.0 00000100:00100000:1.0:1789366576.056386:0:3287:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789366576.056399:0:6663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286758752000 00000100:00100000:2.0:1789366576.056409:0:6663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286758752000 00000100:00100000:1.0:1789366576.056415:0:8065:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286758751872 00000100:00100000:1.0:1789366576.056420:0:8065:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286758751872 00000100:00100000:2.0:1789366576.056482:0:6663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1789366576.056483:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9638bf4b2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3284:1876286758751616:0@lo:400:kworker.0 00000100:00100000:2.0:1789366576.056503:0:6663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638b73cc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3287:x1876286758752000:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789366576.056519:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00000024:2.0:1789366576.056530:0:6663:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789366576.056543:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9638bf4b1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3284:1876286758752128:0@lo:400:kworker.0 00000100:00100000:3.0:1789366576.056579:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789366576.056587:0:6663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638b73cc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3287:x1876286758752000:12345-0@lo:13:osp-pre-1-0.0 Request processed in 87us (253us total) trans 0 rc 0/0 00000100:00100000:2.0:1789366576.056596:0:6663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1789366576.056603:0:3284:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789366576.056618:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9638bf4b3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3284:1876286758751744:0@lo:400:kworker.0 00000100:00100000:3.0:1789366576.056642:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789366576.056689:0:7132:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286758751616 00000100:00100000:3.0:1789366576.056694:0:7132:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286758751616 00000100:00100000:3.0:1789366576.056750:0:7132:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286758752128 00000100:00100000:3.0:1789366576.056753:0:7132:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286758752128 00000100:00100000:1.0:1789366576.056814:0:8065:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1789366576.056821:0:8065:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638b73cc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3287:x1876286758751872:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789366576.056843:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286758751744 00000100:00100000:2.0:1789366576.056849:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286758751744 00000100:00100000:1.0:1789366576.056859:0:8065:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638b73cc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3287:x1876286758751872:12345-0@lo:400:kworker.0 Request processed in 38us (472us total) trans 0 rc 0/0 00000100:00100000:1.0:1789366576.056868:0:8065:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1789366576.056885:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1789366576.056894:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638bf4b3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3284:x1876286758751616:12345-0@lo:400:kworker.0 00000100:00080000:1.0:1789366576.056911:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789366576.056918:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789366576.056933:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789366576.056947:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1789366576.056955:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638bf4b0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3284:x1876286758751744:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789366576.056992:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638bf4b0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3284:x1876286758751744:12345-0@lo:400:kworker.0 Request processed in 39us (349us total) trans 0 rc 0/0 00000100:00100000:1.0:1789366576.056998:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00010000:00080000:1.0:1789366576.057031:0:3287:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9638bf4b0000 x1876286758751872/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789366592 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789366576.057058:0:3287:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9638bf4b0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3287:1876286758751872:0@lo:400:kworker.0 00010000:00080000:1.0:1789366576.057071:0:3287:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9638c1e6ed80 x1876286758752000/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789366592 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789366576.057085:0:3287:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9638c1e6ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3287:1876286758752000:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789366576.057112:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286758751488 00000100:00100000:1.0:1789366576.057116:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286758751488 00000100:00100000:1.0:1789366576.057144:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 205 00000100:00100000:1.0:1789366576.057150:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638b4e87450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8cde4528-5832-4854-a387-4adacc3dd0ab+19:3287:x1876286758751488:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789366576.057188:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638b4e87450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8cde4528-5832-4854-a387-4adacc3dd0ab+19:3287:x1876286758751488:12345-0@lo:400:kworker.0 Request processed in 38us (1026us total) trans 0 rc 0/0 00000100:00100000:1.0:1789366576.057194:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 205 00000100:00100000:1.0:1789366576.057226:0:3287:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9638bf4b3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8cde4528-5832-4854-a387-4adacc3dd0ab:3287:1876286758751488:0@lo:400:kworker.0 00000100:00100000:1.0:1789366576.057297:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9638bf4b3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3284:1876286758751744:0@lo:400:kworker.0 00000100:00100000:2.0:1789366576.057305:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638bf4b3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3284:x1876286758751616:12345-0@lo:400:kworker.0 Request processed in 411us (784us total) trans 0 rc 0/0 00000100:00100000:1.0:1789366576.057312:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9638bf4b2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3284:1876286758751616:0@lo:400:kworker.0 00000100:00100000:2.0:1789366576.057315:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1789366576.057410:0:7132:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1789366576.057417:0:7132:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638bf4b1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3284:x1876286758752128:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789366576.057456:0:7132:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638bf4b1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3284:x1876286758752128:12345-0@lo:400:kworker.0 Request processed in 40us (877us total) trans 0 rc 0/0 00000100:00100000:3.0:1789366576.057461:0:7132:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1789366576.057487:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9638bf4b1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3284:1876286758752128:0@lo:400:kworker.0 00010000:00010000:1.0:1789366576.184928:0:5805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1789366577.122330:0:5837:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of b9764435-e52f-45ac-a5f9-bab1231105ac 00000001:00100000:1.0:1789366577.123671:0:7617:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of b9764435-e52f-45ac-a5f9-bab1231105ac 00010000:00010000:0.0:1789366577.208970:0:6675:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789366578.231989:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789366578.616073:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9638bf4b1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3285:1876286758752256:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789366578.616140:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789366578.616277:0:7134:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286758752256 00000100:00100000:2.0:1789366578.616286:0:7134:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286758752256 00000100:00100000:2.0:1789366578.616364:0:7134:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1789366578.616374:0:7134:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638af2d7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1876286758752256:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789366578.616407:0:7134:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00080000:1.0:1789366578.616469:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789366578.616754:0:7134:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638af2d7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1876286758752256:12345-0@lo:13:osp-pre-0-0.0 Request processed in 381us (612us total) trans 0 rc 0/0 00000100:00100000:2.0:1789366578.616762:0:7134:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00080000:0.0:1789366578.616829:0:3285:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9638bf4b1f80 x1876286758752256/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789366594 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789366578.616847:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9638bf4b1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3285:1876286758752256:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1789366579.258689:0:5805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1789366579.615942:0:10283:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg223-client.virtnet: executing check_config_client /mnt/lustre 00010000:00010000:0.0:1789366580.281060:0:6675:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1789366580.823055:0:6685:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of b9764435-e52f-45ac-a5f9-bab1231105ac 00000100:00100000:0.0:1789366580.940573:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:2.0:1789366580.940975:0:7614:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751386624 00000100:00100000:0.0:1789366580.940991:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:2.0:1789366580.940993:0:7614:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751386624 00000100:00100000:0.0:1789366580.941031:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:0.0:1789366580.941072:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:0.0:1789366580.941104:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:0.0:1789366580.941146:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751386880 00000100:00100000:0.0:1789366580.941157:0:6660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751386880 00000100:00100000:0.0:1789366580.941215:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751387008 00000100:00100000:0.0:1789366580.941218:0:6660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751387008 00000100:00100000:0.0:1789366580.941243:0:6660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 21 00000100:00100000:0.0:1789366580.941254:0:6660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638af2d5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b9764435-e52f-45ac-a5f9-bab1231105ac+5:2357:x1876286751386880:12345-192.168.202.23@tcp:400:kworker.0 00000100:00100000:0.0:1789366580.941338:0:6660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638af2d5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b9764435-e52f-45ac-a5f9-bab1231105ac+5:2357:x1876286751386880:12345-192.168.202.23@tcp:400:kworker.0 Request processed in 86us (308us total) trans 0 rc 0/0 00000100:00100000:0.0:1789366580.941346:0:6660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 21 00000100:00100000:0.0:1789366580.941369:0:6660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 22 00000100:00080000:1.0:1789366580.941378:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789366580.941378:0:6660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638af2d5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b9764435-e52f-45ac-a5f9-bab1231105ac+5:2356:x1876286751387008:12345-192.168.202.23@tcp:400:kworker.0 00000100:00080000:1.0:1789366580.941388:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789366580.941395:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789366580.941415:0:6660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638af2d5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b9764435-e52f-45ac-a5f9-bab1231105ac+5:2356:x1876286751387008:12345-192.168.202.23@tcp:400:kworker.0 Request processed in 37us (309us total) trans 0 rc 0/0 00000100:00100000:0.0:1789366580.941423:0:6660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 22 00000100:00100000:3.0:1789366580.941501:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751386496 00000100:00100000:3.0:1789366580.941509:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751386496 00000100:00100000:3.0:1789366580.941558:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 206 00000100:00100000:3.0:1789366580.941569:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638b4e85050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:14a2847b-91d8-4d87-b71b-010443acc91a+13:2356:x1876286751386496:12345-192.168.202.23@tcp:400:kworker.0 00000100:00100000:3.0:1789366580.941642:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638b4e85050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:14a2847b-91d8-4d87-b71b-010443acc91a+13:2356:x1876286751386496:12345-192.168.202.23@tcp:400:kworker.0 Request processed in 75us (652us total) trans 0 rc 0/0 00000100:00100000:3.0:1789366580.941650:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 206 00000100:00100000:0.0:1789366580.945095:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751386752 00000100:00100000:0.0:1789366580.945114:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751386752 00000100:00100000:0.0:1789366580.945245:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 40 00000100:00100000:0.0:1789366580.945256:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638af2d4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0ab23baa-a205-44ad-bf17-f7b47295d82b+6:2357:x1876286751386624:12345-192.168.202.23@tcp:400:kworker.0 00000100:00100000:0.0:1789366580.945332:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638af2d4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0ab23baa-a205-44ad-bf17-f7b47295d82b+6:2357:x1876286751386624:12345-192.168.202.23@tcp:400:kworker.0 Request processed in 78us (4771us total) trans 0 rc 0/0 00000100:00100000:0.0:1789366580.945339:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 40 00000100:00100000:0.0:1789366580.945370:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 41 00000100:00100000:0.0:1789366580.945376:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638af2d7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b9764435-e52f-45ac-a5f9-bab1231105ac+5:2356:x1876286751386752:12345-192.168.202.23@tcp:400:kworker.0 00000100:00100000:0.0:1789366580.945401:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638af2d7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b9764435-e52f-45ac-a5f9-bab1231105ac+5:2356:x1876286751386752:12345-192.168.202.23@tcp:400:kworker.0 Request processed in 25us (4331us total) trans 0 rc 0/0 00000100:00100000:0.0:1789366580.945407:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 41 00000100:00080000:2.0:1789366580.946060:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789366581.176062:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9638af2d6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3284:1876286758752640:0@lo:400:kworker.0 00000100:00100000:0.0:1789366581.176090:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9638af2d4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3285:1876286758752768:0@lo:400:kworker.0 00000100:00100000:1.0:1789366581.176141:0:3286:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9638bf4b1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3286:1876286758752384:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789366581.183975:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789366581.184025:0:7132:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286758752768 00000100:00100000:3.0:1789366581.184038:0:7132:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286758752768 00000100:00100000:0.0:1789366581.184077:0:3285:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789366581.184093:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9638af2d5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3285:1876286758753152:0@lo:400:kworker.0 00000100:00100000:3.0:1789366581.184109:0:7132:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1789366581.184120:0:7132:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638af2d5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3285:x1876286758752768:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789366581.184144:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789366581.184199:0:7132:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638af2d5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3285:x1876286758752768:12345-0@lo:400:kworker.0 Request processed in 82us (235us total) trans 0 rc 0/0 00000100:00100000:3.0:1789366581.184208:0:7132:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00080000:3.0:1789366581.184230:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789366581.184245:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789366581.184279:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286758752640 00000100:00100000:3.0:1789366581.184283:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286758752640 00000100:00100000:3.0:1789366581.184308:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1789366581.184314:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638bf4b2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3284:x1876286758752640:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789366581.184348:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638bf4b2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3284:x1876286758752640:12345-0@lo:400:kworker.0 Request processed in 34us (101us total) trans 0 rc 0/0 00000100:00100000:3.0:1789366581.184354:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1789366581.184399:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9638af2d6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3284:1876286758752640:0@lo:400:kworker.0 00000100:00100000:2.0:1789366581.185861:0:8065:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286758753152 00000100:00100000:1.0:1789366581.185961:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789366581.186007:0:3286:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9638af2d6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3286:1876286758752896:0@lo:400:kworker.0 00000100:00100000:1.0:1789366581.186034:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789366581.186053:0:3286:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1789366581.186059:0:3286:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9638af2d4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8cde4528-5832-4854-a387-4adacc3dd0ab:3286:1876286758752512:0@lo:400:kworker.0 00000100:00100000:1.0:1789366581.186082:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789366581.186103:0:3286:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9638af2d5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3286:1876286758753024:0@lo:400:kworker.0 00000100:00100000:1.0:1789366581.186123:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789366581.186148:0:6662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286758752384 00000100:00100000:1.0:1789366581.186151:0:6662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286758752384 00000100:00100000:1.0:1789366581.186193:0:6662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1789366581.186200:0:6662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638b73cea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3286:x1876286758752384:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789366581.186241:0:6662:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789366581.186284:0:6662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638b73cea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3286:x1876286758752384:12345-0@lo:13:osp-pre-1-0.0 Request processed in 83us (323us total) trans 0 rc 0/0 00000100:00100000:1.0:1789366581.186291:0:6662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1789366581.186314:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286758752896 00000100:00100000:1.0:1789366581.186317:0:6659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286758752896 00000100:00100000:1.0:1789366581.186354:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1789366581.186362:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638b73cc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3286:x1876286758752896:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789366581.186393:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638b73cc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3286:x1876286758752896:12345-0@lo:400:kworker.0 Request processed in 32us (358us total) trans 0 rc 0/0 00000100:00100000:1.0:1789366581.186400:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1789366581.186417:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286758752512 00000100:00100000:1.0:1789366581.186420:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286758752512 00000100:00100000:1.0:1789366581.186446:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 207 00000100:00100000:1.0:1789366581.186453:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638b4e83450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8cde4528-5832-4854-a387-4adacc3dd0ab+19:3286:x1876286758752512:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789366581.186494:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638b4e83450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8cde4528-5832-4854-a387-4adacc3dd0ab+19:3286:x1876286758752512:12345-0@lo:400:kworker.0 Request processed in 42us (410us total) trans 0 rc 0/0 00000100:00100000:1.0:1789366581.186500:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 207 00000100:00100000:1.0:1789366581.186525:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286758753024 00000100:00100000:1.0:1789366581.186528:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286758753024 00000100:00100000:1.0:1789366581.186552:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1789366581.186558:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638b73ced80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3286:x1876286758753024:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789366581.186581:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638b73ced80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3286:x1876286758753024:12345-0@lo:400:kworker.0 Request processed in 24us (457us total) trans 0 rc 0/0 00000100:00100000:1.0:1789366581.186586:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00080000:1.0:1789366581.187493:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789366581.187501:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789366581.187503:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789366581.187537:0:3286:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9638af2d4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8cde4528-5832-4854-a387-4adacc3dd0ab:3286:1876286758752512:0@lo:400:kworker.0 00000100:00100000:1.0:1789366581.187551:0:3286:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9638af2d5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3286:1876286758753024:0@lo:400:kworker.0 00010000:00080000:1.0:1789366581.187565:0:3286:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9638bf4b1f80 x1876286758752384/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789366597 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789366581.187584:0:3286:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9638bf4b1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3286:1876286758752384:0@lo:13:osp-pre-1-0.0 00010000:00080000:1.0:1789366581.187595:0:3286:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9638af2d6680 x1876286758752896/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789366597 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789366581.187681:0:8065:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286758753152 00000100:00100000:2.0:1789366581.187737:0:8065:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1789366581.187744:0:8065:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638af2d4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3285:x1876286758753152:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789366581.187806:0:8065:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638af2d4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3285:x1876286758753152:12345-0@lo:400:kworker.0 Request processed in 62us (3660us total) trans 0 rc 0/0 00000100:00100000:2.0:1789366581.187813:0:8065:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1789366581.188015:0:3286:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9638af2d6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3286:1876286758752896:0@lo:400:kworker.0 00010000:00080000:1.0:1789366581.191372:0:3285:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9638af2d5180 x1876286758753152/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789366597 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789366581.191399:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9638af2d5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3285:1876286758753152:0@lo:400:kworker.0 00000100:00100000:1.0:1789366581.191443:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9638af2d4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3285:1876286758752768:0@lo:400:kworker.0 00010000:00010000:3.0:1789366581.305850:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789366582.328104:0:5805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789366583.352117:0:6675:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789366583.737089:0:3284:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789366583.737112:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9638bf4b3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3284:1876286758753280:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789366583.737177:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789366583.737261:0:7134:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286758753280 00000100:00100000:3.0:1789366583.737269:0:7134:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286758753280 00000100:00100000:3.0:1789366583.737324:0:7134:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1789366583.737333:0:7134:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638bf4b3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1876286758753280:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789366583.737368:0:7134:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789366583.737413:0:7134:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638bf4b3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1876286758753280:12345-0@lo:13:osp-pre-0-0.0 Request processed in 81us (235us total) trans 0 rc 0/0 00000100:00100000:3.0:1789366583.737419:0:7134:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00080000:3.0:1789366583.737439:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1789366583.737471:0:3284:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9638bf4b3480 x1876286758753280/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789366599 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789366583.737500:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9638bf4b3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3284:1876286758753280:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1789366584.375904:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789366585.399985:0:5805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789366586.058949:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:3.0:1789366586.059882:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:3.0:1789366586.059921:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:3.0:1789366586.059938:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:3.0:1789366586.059965:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:3.0:1789366586.059994:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751387392 00000100:00100000:3.0:1789366586.060007:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751387392 00000100:00100000:3.0:1789366586.060066:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751387264 00000100:00100000:3.0:1789366586.060068:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751387264 00000100:00100000:3.0:1789366586.060090:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 45 00000100:00100000:3.0:1789366586.060100:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638bf4b3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b9764435-e52f-45ac-a5f9-bab1231105ac+5:2357:x1876286751387392:12345-192.168.202.23@tcp:400:kworker.0 00000100:00100000:3.0:1789366586.060187:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638bf4b3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b9764435-e52f-45ac-a5f9-bab1231105ac+5:2357:x1876286751387392:12345-192.168.202.23@tcp:400:kworker.0 Request processed in 89us (310us total) trans 0 rc 0/0 00000100:00100000:3.0:1789366586.060195:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 45 00000100:00100000:3.0:1789366586.060213:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 46 00000100:00100000:3.0:1789366586.060219:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638bf4b2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0ab23baa-a205-44ad-bf17-f7b47295d82b+6:2357:x1876286751387264:12345-192.168.202.23@tcp:400:kworker.0 00000100:00100000:3.0:1789366586.060238:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638bf4b2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0ab23baa-a205-44ad-bf17-f7b47295d82b+6:2357:x1876286751387264:12345-192.168.202.23@tcp:400:kworker.0 Request processed in 19us (299us total) trans 0 rc 0/0 00000100:00100000:3.0:1789366586.060244:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 46 00000100:00080000:3.0:1789366586.060259:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789366586.060320:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751387648 00000100:00100000:1.0:1789366586.060324:0:6659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751387648 00000100:00100000:1.0:1789366586.060367:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751387520 00000100:00100000:1.0:1789366586.060370:0:6659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751387520 00000100:00100000:1.0:1789366586.060390:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 25 00000100:00100000:1.0:1789366586.060397:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638bf4b0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b9764435-e52f-45ac-a5f9-bab1231105ac+5:2357:x1876286751387648:12345-192.168.202.23@tcp:400:kworker.0 00000100:00100000:1.0:1789366586.060424:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638bf4b0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b9764435-e52f-45ac-a5f9-bab1231105ac+5:2357:x1876286751387648:12345-192.168.202.23@tcp:400:kworker.0 Request processed in 29us (503us total) trans 0 rc 0/0 00000100:00100000:1.0:1789366586.060431:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 25 00000100:00100000:1.0:1789366586.060442:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 26 00000100:00100000:1.0:1789366586.060447:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638bf4b1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b9764435-e52f-45ac-a5f9-bab1231105ac+5:2357:x1876286751387520:12345-192.168.202.23@tcp:400:kworker.0 00000100:00100000:1.0:1789366586.060464:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638bf4b1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b9764435-e52f-45ac-a5f9-bab1231105ac+5:2357:x1876286751387520:12345-192.168.202.23@tcp:400:kworker.0 Request processed in 17us (498us total) trans 0 rc 0/0 00000100:00100000:1.0:1789366586.060469:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 26 00000100:00080000:3.0:1789366586.060868:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789366586.060872:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789366586.061224:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751387136 00000100:00100000:0.0:1789366586.061231:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751387136 00000100:00100000:0.0:1789366586.061278:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 208 00000100:00100000:0.0:1789366586.061285:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638b4e81050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:14a2847b-91d8-4d87-b71b-010443acc91a+13:2357:x1876286751387136:12345-192.168.202.23@tcp:400:kworker.0 00000100:00100000:0.0:1789366586.061324:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638b4e81050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:14a2847b-91d8-4d87-b71b-010443acc91a+13:2357:x1876286751387136:12345-192.168.202.23@tcp:400:kworker.0 Request processed in 40us (2391us total) trans 0 rc 0/0 00000100:00100000:0.0:1789366586.061330:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 208 00000100:00100000:1.0:1789366586.296298:0:3286:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9638b73ce680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8cde4528-5832-4854-a387-4adacc3dd0ab:3286:1876286758753408:0@lo:400:kworker.0 00000100:00100000:1.0:1789366586.296401:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789366586.296470:0:3286:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9638b73ce300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3286:1876286758753920:0@lo:400:kworker.0 00000100:00100000:1.0:1789366586.296502:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789366586.296533:0:3286:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1789366586.296540:0:3286:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9638b73cf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3286:1876286758753536:0@lo:400:kworker.0 00000100:00100000:1.0:1789366586.296579:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789366586.296596:0:3286:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9638b6cbd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3286:1876286758754048:0@lo:400:kworker.0 00000100:00100000:1.0:1789366586.296636:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789366586.296668:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9638b73cf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3285:1876286758753792:0@lo:400:kworker.0 00000100:00100000:1.0:1789366586.296694:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789366586.296714:0:3285:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789366586.296745:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9638b73cf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3285:1876286758753664:0@lo:400:kworker.0 00000100:00100000:1.0:1789366586.296770:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789366586.296805:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286758753408 00000100:00100000:1.0:1789366586.296816:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286758753408 00000100:00100000:0.0:1789366586.296900:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286758754048 00000100:00100000:0.0:1789366586.296906:0:6659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286758754048 00000100:00100000:0.0:1789366586.296971:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286758753792 00000100:00100000:0.0:1789366586.296974:0:6659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286758753792 00000100:00100000:0.0:1789366586.296999:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1789366586.297008:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638b6cbe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3286:x1876286758754048:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789366586.297075:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638b6cbe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3286:x1876286758754048:12345-0@lo:400:kworker.0 Request processed in 67us (437us total) trans 0 rc 0/0 00000100:00100000:0.0:1789366586.297092:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1789366586.297112:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1789366586.297119:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638b6cbf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3285:x1876286758753792:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789366586.297155:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638b6cbf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3285:x1876286758753792:12345-0@lo:400:kworker.0 Request processed in 36us (459us total) trans 0 rc 0/0 00000100:00100000:0.0:1789366586.297161:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1789366586.297180:0:7614:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286758753920 00000100:00100000:0.0:1789366586.297184:0:7614:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286758753920 00000100:00100000:0.0:1789366586.297210:0:7614:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286758753536 00000100:00100000:0.0:1789366586.297212:0:7614:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286758753536 00000100:00100000:0.0:1789366586.297226:0:7614:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286758753664 00000100:00100000:0.0:1789366586.297229:0:7614:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286758753664 00000100:00100000:0.0:1789366586.297243:0:7614:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1789366586.297249:0:7614:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638b6cbd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3286:x1876286758753920:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789366586.297279:0:7614:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638b6cbd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3286:x1876286758753920:12345-0@lo:400:kworker.0 Request processed in 30us (777us total) trans 0 rc 0/0 00000100:00100000:0.0:1789366586.297285:0:7614:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1789366586.297296:0:7614:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1789366586.297302:0:7614:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638b6cbce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3286:x1876286758753536:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789366586.297329:0:7614:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638b6cbce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3286:x1876286758753536:12345-0@lo:400:kworker.0 Request processed in 28us (750us total) trans 0 rc 0/0 00000100:00100000:0.0:1789366586.297335:0:7614:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1789366586.297347:0:7614:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1789366586.297353:0:7614:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638b6cbc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3285:x1876286758753664:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789366586.297379:0:7614:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638b6cbc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3285:x1876286758753664:12345-0@lo:400:kworker.0 Request processed in 27us (609us total) trans 0 rc 0/0 00000100:00100000:0.0:1789366586.297395:0:7614:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1789366586.297473:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9638b73cf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3285:1876286758753664:0@lo:400:kworker.0 00010000:00080000:0.0:1789366586.297489:0:3285:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9638b73cf100 x1876286758753792/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789366602 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789366586.297500:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9638b73cf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3285:1876286758753792:0@lo:400:kworker.0 00000100:00100000:0.0:1789366586.297537:0:3286:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9638b73cf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3286:1876286758753536:0@lo:400:kworker.0 00010000:00080000:0.0:1789366586.297548:0:3286:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9638b6cbd180 x1876286758754048/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789366602 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789366586.297557:0:3286:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9638b6cbd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3286:1876286758754048:0@lo:400:kworker.0 00000100:00100000:0.0:1789366586.297567:0:3286:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9638b73ce300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3286:1876286758753920:0@lo:400:kworker.0 00000100:00100000:1.0:1789366586.297687:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 209 00000100:00100000:1.0:1789366586.297694:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638b4e80850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8cde4528-5832-4854-a387-4adacc3dd0ab+19:3286:x1876286758753408:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789366586.297761:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638b4e80850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8cde4528-5832-4854-a387-4adacc3dd0ab+19:3286:x1876286758753408:12345-0@lo:400:kworker.0 Request processed in 66us (1360us total) trans 0 rc 0/0 00000100:00100000:1.0:1789366586.297768:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 209 00000100:00100000:1.0:1789366586.297803:0:3286:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9638b73ce680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8cde4528-5832-4854-a387-4adacc3dd0ab:3286:1876286758753408:0@lo:400:kworker.0 00000100:00100000:3.0:1789366586.297939:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9638b4f19880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3284:1876286758754176:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789366586.297983:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1789366586.298036:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789366586.298042:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789366586.298045:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789366586.298056:0:6663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286758754176 00000100:00100000:3.0:1789366586.298061:0:6663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286758754176 00000100:00100000:3.0:1789366586.298089:0:6663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1789366586.298096:0:6663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638b4f18000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1876286758754176:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789366586.298131:0:6663:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789366586.298168:0:6663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638b4f18000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1876286758754176:12345-0@lo:13:osp-pre-1-0.0 Request processed in 72us (185us total) trans 0 rc 0/0 00000100:00100000:3.0:1789366586.298174:0:6663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00080000:3.0:1789366586.298205:0:3284:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9638b4f19880 x1876286758754176/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789366602 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789366586.298222:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9638b4f19880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3284:1876286758754176:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1789366586.424125:0:6675:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789366587.449155:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789366588.472683:0:5805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789366588.856031:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9638b4f19880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3285:1876286758754304:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789366588.856141:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789366588.856639:0:6662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286758754304 00000100:00100000:3.0:1789366588.856652:0:6662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286758754304 00000100:00100000:3.0:1789366588.856881:0:6662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1789366588.856895:0:6662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638af2d6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1876286758754304:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789366588.856946:0:6662:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789366588.857021:0:6662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638af2d6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1876286758754304:12345-0@lo:13:osp-pre-0-0.0 Request processed in 129us (880us total) trans 0 rc 0/0 00000100:00100000:3.0:1789366588.857029:0:6662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00010000:00080000:2.0:1789366588.857107:0:3285:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9638b4f19880 x1876286758754304/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789366604 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789366588.857133:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9638b4f19880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3285:1876286758754304:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1789366588.857212:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1789366589.495968:0:6675:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789366590.520074:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789366591.178948:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:2.0:1789366591.179148:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751387776 00000100:00100000:2.0:1789366591.179162:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751387776 00000100:00100000:2.0:1789366591.179230:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 210 00000100:00100000:2.0:1789366591.179242:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638b4e80050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:14a2847b-91d8-4d87-b71b-010443acc91a+13:2355:x1876286751387776:12345-192.168.202.23@tcp:400:kworker.0 00000100:00100000:2.0:1789366591.179412:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638b4e80050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:14a2847b-91d8-4d87-b71b-010443acc91a+13:2355:x1876286751387776:12345-192.168.202.23@tcp:400:kworker.0 Request processed in 172us (480us total) trans 0 rc 0/0 00000100:00100000:2.0:1789366591.179422:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 210 00000100:00100000:3.0:1789366591.179511:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:3.0:1789366591.179791:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:3.0:1789366591.180198:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:3.0:1789366591.180246:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:2.0:1789366591.180331:0:7614:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751387904 00000100:00100000:2.0:1789366591.180338:0:7614:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751387904 00000100:00100000:2.0:1789366591.180398:0:7614:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751388032 00000100:00100000:2.0:1789366591.180402:0:7614:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751388032 00000100:00100000:2.0:1789366591.180426:0:7614:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 50 00000100:00100000:2.0:1789366591.180435:0:7614:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638b4f18e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0ab23baa-a205-44ad-bf17-f7b47295d82b+6:2355:x1876286751387904:12345-192.168.202.23@tcp:400:kworker.0 00000100:00100000:2.0:1789366591.180496:0:7614:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638b4f18e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0ab23baa-a205-44ad-bf17-f7b47295d82b+6:2355:x1876286751387904:12345-192.168.202.23@tcp:400:kworker.0 Request processed in 61us (984us total) trans 0 rc 0/0 00000100:00100000:2.0:1789366591.180504:0:7614:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 50 00000100:00080000:3.0:1789366591.180706:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789366591.180835:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 51 00000100:00100000:0.0:1789366591.180849:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638b4f1b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b9764435-e52f-45ac-a5f9-bab1231105ac+5:2355:x1876286751388032:12345-192.168.202.23@tcp:400:kworker.0 00000100:00100000:0.0:1789366591.180884:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638b4f1b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b9764435-e52f-45ac-a5f9-bab1231105ac+5:2355:x1876286751388032:12345-192.168.202.23@tcp:400:kworker.0 Request processed in 41us (1103us total) trans 0 rc 0/0 00000100:00100000:0.0:1789366591.180891:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 51 00000100:00100000:0.0:1789366591.181404:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751388160 00000100:00100000:0.0:1789366591.181411:0:6661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751388160 00000100:00100000:3.0:1789366591.181499:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751388288 00000100:00100000:3.0:1789366591.181503:0:6659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751388288 00000100:00100000:0.0:1789366591.181576:0:6661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 29 00000100:00100000:0.0:1789366591.181585:0:6661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638b4f19880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b9764435-e52f-45ac-a5f9-bab1231105ac+5:2355:x1876286751388160:12345-192.168.202.23@tcp:400:kworker.0 00000100:00100000:0.0:1789366591.181631:0:6661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638b4f19880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b9764435-e52f-45ac-a5f9-bab1231105ac+5:2355:x1876286751388160:12345-192.168.202.23@tcp:400:kworker.0 Request processed in 48us (1434us total) trans 0 rc 0/0 00000100:00100000:0.0:1789366591.181639:0:6661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 29 00000100:00100000:3.0:1789366591.181932:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 30 00000100:00100000:3.0:1789366591.181943:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96388330a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b9764435-e52f-45ac-a5f9-bab1231105ac+5:2355:x1876286751388288:12345-192.168.202.23@tcp:400:kworker.0 00000100:00100000:3.0:1789366591.181986:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96388330a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b9764435-e52f-45ac-a5f9-bab1231105ac+5:2355:x1876286751388288:12345-192.168.202.23@tcp:400:kworker.0 Request processed in 46us (1740us total) trans 0 rc 0/0 00000100:00100000:3.0:1789366591.181994:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 30 00000100:00080000:2.0:1789366591.182193:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789366591.182198:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789366591.421073:0:3286:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9638af2d4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3286:1876286758754432:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789366591.421174:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789366591.422866:0:7134:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286758754432 00000100:00100000:3.0:1789366591.422883:0:7134:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286758754432 00000100:00100000:3.0:1789366591.422962:0:7134:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1789366591.422972:0:7134:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638c1e6c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3286:x1876286758754432:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789366591.423017:0:7134:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789366591.425082:0:3287:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9638af2d5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8cde4528-5832-4854-a387-4adacc3dd0ab:3287:1876286758754560:0@lo:400:kworker.0 00000100:00100000:0.0:1789366591.425165:0:3287:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789366591.425210:0:3287:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9638af2d6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3287:1876286758755072:0@lo:400:kworker.0 00000100:00100000:0.0:1789366591.425236:0:3287:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789366591.425263:0:3287:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789366591.425268:0:3287:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9638af2d4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3287:1876286758754944:0@lo:400:kworker.0 00000100:00100000:0.0:1789366591.425295:0:3287:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789366591.425319:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9638af2d5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3285:1876286758754816:0@lo:400:kworker.0 00000100:00100000:0.0:1789366591.425340:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789366591.425354:0:3285:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789366591.425359:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9638af2d6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3285:1876286758754688:0@lo:400:kworker.0 00000100:00100000:0.0:1789366591.425376:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789366591.425400:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286758754560 00000100:00100000:0.0:1789366591.425407:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286758754560 00000100:00100000:0.0:1789366591.425452:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 211 00000100:00100000:0.0:1789366591.425460:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638b4e81450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8cde4528-5832-4854-a387-4adacc3dd0ab+19:3287:x1876286758754560:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789366591.425507:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638b4e81450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8cde4528-5832-4854-a387-4adacc3dd0ab+19:3287:x1876286758754560:12345-0@lo:400:kworker.0 Request processed in 48us (343us total) trans 0 rc 0/0 00000100:00100000:0.0:1789366591.425515:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 211 00000100:00100000:0.0:1789366591.425550:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286758755072 00000100:00100000:0.0:1789366591.425566:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286758755072 00000100:00100000:0.0:1789366591.425596:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286758754816 00000100:00100000:0.0:1789366591.425598:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286758754816 00000100:00100000:0.0:1789366591.425613:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286758754688 00000100:00100000:0.0:1789366591.425615:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286758754688 00000100:00100000:0.0:1789366591.425626:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1789366591.425631:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638af2d7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3287:x1876286758755072:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789366591.425660:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638af2d7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3287:x1876286758755072:12345-0@lo:400:kworker.0 Request processed in 29us (424us total) trans 0 rc 0/0 00000100:00100000:0.0:1789366591.425666:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1789366591.425676:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1789366591.425681:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638b73ce300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3285:x1876286758754816:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789366591.425704:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638b73ce300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3285:x1876286758754816:12345-0@lo:400:kworker.0 Request processed in 24us (364us total) trans 0 rc 0/0 00000100:00100000:0.0:1789366591.425710:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1789366591.425743:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1789366591.425749:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638b73cf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3285:x1876286758754688:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789366591.425775:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638b73cf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3285:x1876286758754688:12345-0@lo:400:kworker.0 Request processed in 27us (398us total) trans 0 rc 0/0 00000100:00100000:0.0:1789366591.425792:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1789366591.425812:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286758754944 00000100:00100000:0.0:1789366591.425815:0:6661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286758754944 00000100:00100000:0.0:1789366591.425843:0:6661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1789366591.425849:0:6661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638b73ce680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3287:x1876286758754944:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789366591.425880:0:6661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638b73ce680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3287:x1876286758754944:12345-0@lo:400:kworker.0 Request processed in 31us (584us total) trans 0 rc 0/0 00000100:00100000:0.0:1789366591.425886:0:6661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00010000:00080000:0.0:1789366591.425941:0:3287:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9638af2d4700 x1876286758754944/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789366607 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789366591.425957:0:3287:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9638af2d4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3287:1876286758754944:0@lo:400:kworker.0 00000100:00100000:0.0:1789366591.425965:0:3287:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9638af2d5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8cde4528-5832-4854-a387-4adacc3dd0ab:3287:1876286758754560:0@lo:400:kworker.0 00000100:00100000:0.0:1789366591.425974:0:3287:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9638af2d6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3287:1876286758755072:0@lo:400:kworker.0 00000100:00100000:0.0:1789366591.426012:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9638af2d6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3285:1876286758754688:0@lo:400:kworker.0 00000100:00100000:0.0:1789366591.426021:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9638af2d5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3285:1876286758754816:0@lo:400:kworker.0 00000100:00100000:3.0:1789366591.426202:0:7134:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638c1e6c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3286:x1876286758754432:12345-0@lo:13:osp-pre-1-0.0 Request processed in 3229us (5026us total) trans 0 rc 0/0 00000100:00100000:3.0:1789366591.426212:0:7134:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00080000:3.0:1789366591.426238:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789366591.426243:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789366591.426246:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:2.0:1789366591.432857:0:3286:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9638af2d4a80 x1876286758754432/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789366607 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789366591.432891:0:3286:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9638af2d4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3286:1876286758754432:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1789366591.547280:0:5805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789366592.567964:0:6675:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1789366593.113604:0:10983:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:3.0:1789366593.592829:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789366593.979016:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96388330b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3284:1876286758755200:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789366593.979115:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789366593.979231:0:6662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286758755200 00000100:00100000:3.0:1789366593.979242:0:6662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286758755200 00000100:00100000:3.0:1789366593.979308:0:6662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1789366593.979320:0:6662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963883308380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1876286758755200:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789366593.979380:0:6662:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789366593.979441:0:6662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963883308380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1876286758755200:12345-0@lo:13:osp-pre-0-0.0 Request processed in 123us (326us total) trans 0 rc 0/0 00000100:00100000:3.0:1789366593.979448:0:6662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00080000:3.0:1789366593.979476:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1789366593.979513:0:3284:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96388330b100 x1876286758755200/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789366609 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789366593.979537:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96388330b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3284:1876286758755200:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1789366594.618896:0:5805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789366595.643613:0:6675:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789366596.301762:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:1.0:1789366596.301807:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:1.0:1789366596.301842:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751388800 00000100:00100000:1.0:1789366596.301855:0:6659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751388800 00000100:00100000:1.0:1789366596.301936:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751388928 00000100:00100000:1.0:1789366596.301939:0:6659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751388928 00000100:00100000:1.0:1789366596.301966:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 14 00000100:00100000:1.0:1789366596.301983:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638b6cbf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b9764435-e52f-45ac-a5f9-bab1231105ac+5:2353:x1876286751388800:12345-192.168.202.23@tcp:9:kworker.0 00000020:00000080:1.0:1789366596.302028:0:6659:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x8da3486b955f3125 00000100:00080000:1.0:1789366596.302039:0:6659:0:(import.c:65:import_set_state_nolock()) ffff9638b7023800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1789366596.302123:0:6659:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:1.0:1789366596.302609:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638b6cbf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b9764435-e52f-45ac-a5f9-bab1231105ac+2:2353:x1876286751388800:12345-192.168.202.23@tcp:9:kworker.0 Request processed in 629us (899us total) trans 0 rc 0/0 00000100:00100000:1.0:1789366596.302619:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 14 00000100:00100000:1.0:1789366596.302639:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 15 00000100:00100000:1.0:1789366596.302646:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638b6cbea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b9764435-e52f-45ac-a5f9-bab1231105ac+5:2353:x1876286751388928:12345-192.168.202.23@tcp:9:kworker.0 00000020:00000080:1.0:1789366596.302660:0:6659:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x8da3486b955f312c 00000100:00080000:1.0:1789366596.302666:0:6659:0:(import.c:65:import_set_state_nolock()) ffff9638b7027800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1789366596.302694:0:6659:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:1.0:1789366596.302948:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638b6cbea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b9764435-e52f-45ac-a5f9-bab1231105ac+2:2353:x1876286751388928:12345-192.168.202.23@tcp:9:kworker.0 Request processed in 302us (1139us total) trans 0 rc 0/0 00000100:00100000:1.0:1789366596.302956:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 15 00000100:00080000:1.0:1789366596.302985:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789366596.302989:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1789366596.303009:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789366596.303142:0:5805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789366596.308335:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:1.0:1789366596.308397:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:0.0:1789366596.308469:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751388672 00000100:00100000:0.0:1789366596.308483:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751388672 00000100:00100000:0.0:1789366596.308562:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 55 00000100:00100000:0.0:1789366596.308573:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638b6cbf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b9764435-e52f-45ac-a5f9-bab1231105ac+5:2356:x1876286751388672:12345-192.168.202.23@tcp:400:kworker.0 00000100:00100000:0.0:1789366596.308663:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638b6cbf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b9764435-e52f-45ac-a5f9-bab1231105ac+5:2356:x1876286751388672:12345-192.168.202.23@tcp:400:kworker.0 Request processed in 93us (265us total) trans 0 rc 0/0 00000100:00080000:1.0:1789366596.308849:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789366596.309521:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 55 00000100:00100000:3.0:1789366596.309815:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751388416 00000100:00100000:3.0:1789366596.309825:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751388416 00000100:00100000:3.0:1789366596.309889:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 212 00000100:00100000:3.0:1789366596.309898:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638b4e80c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:14a2847b-91d8-4d87-b71b-010443acc91a+13:2356:x1876286751388416:12345-192.168.202.23@tcp:400:kworker.0 00000100:00100000:3.0:1789366596.309974:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638b4e80c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:14a2847b-91d8-4d87-b71b-010443acc91a+13:2356:x1876286751388416:12345-192.168.202.23@tcp:400:kworker.0 Request processed in 78us (1655us total) trans 0 rc 0/0 00000100:00100000:3.0:1789366596.309982:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 212 00000100:00100000:1.0:1789366596.317282:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:0.0:1789366596.318193:0:7132:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751388544 00000100:00100000:0.0:1789366596.318214:0:7132:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751388544 00000100:00100000:1.0:1789366596.318545:0:7132:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 56 00000100:00100000:1.0:1789366596.318560:0:7132:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638b6cbc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0ab23baa-a205-44ad-bf17-f7b47295d82b+6:2356:x1876286751388544:12345-192.168.202.23@tcp:400:kworker.0 00000100:00100000:1.0:1789366596.319050:0:7132:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638b6cbc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0ab23baa-a205-44ad-bf17-f7b47295d82b+6:2356:x1876286751388544:12345-192.168.202.23@tcp:400:kworker.0 Request processed in 490us (1784us total) trans 0 rc 0/0 00000100:00100000:1.0:1789366596.319061:0:7132:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 56 00000100:00080000:3.0:1789366596.321970:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789366596.537253:0:3284:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789366596.537284:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9638b6cbdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3284:1876286758755328:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789366596.537406:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789366596.538864:0:6663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286758755328 00000100:00100000:1.0:1789366596.538883:0:6663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286758755328 00000100:00100000:1.0:1789366596.539001:0:6663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1789366596.539013:0:6663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638b6cbfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1876286758755328:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789366596.539063:0:6663:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789366596.539161:0:6663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638b6cbfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1876286758755328:12345-0@lo:13:osp-pre-1-0.0 Request processed in 150us (1756us total) trans 0 rc 0/0 00000100:00100000:1.0:1789366596.539168:0:6663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00010000:00080000:1.0:1789366596.539224:0:3284:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9638b6cbdf80 x1876286758755328/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789366612 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789366596.539249:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9638b6cbdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3284:1876286758755328:0@lo:13:osp-pre-1-0.0 00000100:00080000:2.0:1789366596.545979:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789366596.554659:0:3287:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9638b73cf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3287:1876286758755584:0@lo:400:kworker.0 00000100:00100000:2.0:1789366596.555193:0:3286:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9638b73cf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8cde4528-5832-4854-a387-4adacc3dd0ab:3286:1876286758755456:0@lo:400:kworker.0 00000100:00100000:2.0:1789366596.555297:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789366596.555370:0:3286:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9638af2d6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3286:1876286758755968:0@lo:400:kworker.0 00000100:00100000:2.0:1789366596.555401:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789366596.555577:0:3287:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789366596.555628:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286758755456 00000100:00100000:0.0:1789366596.555639:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286758755456 00000100:00100000:0.0:1789366596.556198:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 213 00000100:00100000:0.0:1789366596.556212:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638b4e81c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8cde4528-5832-4854-a387-4adacc3dd0ab+19:3286:x1876286758755456:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789366596.556287:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638b4e81c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8cde4528-5832-4854-a387-4adacc3dd0ab+19:3286:x1876286758755456:12345-0@lo:400:kworker.0 Request processed in 79us (991us total) trans 0 rc 0/0 00000100:00100000:0.0:1789366596.556310:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 213 00000100:00100000:0.0:1789366596.556354:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286758755968 00000100:00100000:0.0:1789366596.556360:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286758755968 00000100:00100000:0.0:1789366596.556399:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286758755584 00000100:00100000:0.0:1789366596.556403:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286758755584 00000100:00100000:0.0:1789366596.556423:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1789366596.556430:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638c1e6fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3286:x1876286758755968:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789366596.556571:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1789366596.556582:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638af2d6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3287:x1876286758755584:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789366596.560853:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638af2d6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3287:x1876286758755584:12345-0@lo:400:kworker.0 Request processed in 4258us (5260us total) trans 0 rc 0/0 00000100:00100000:2.0:1789366596.560875:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1789366596.561772:0:3287:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9638b73cf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3287:1876286758755584:0@lo:400:kworker.0 00000100:00100000:2.0:1789366596.563842:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9638af2d5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3285:1876286758755840:0@lo:400:kworker.0 00000100:00100000:2.0:1789366596.563946:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789366596.564024:0:3285:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789366596.564031:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9638af2d4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3285:1876286758755712:0@lo:400:kworker.0 00000100:00100000:2.0:1789366596.564060:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789366596.564590:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286758755840 00000100:00100000:2.0:1789366596.564603:0:6659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286758755840 00000100:00100000:2.0:1789366596.565584:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1789366596.565601:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638c1e6df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3285:x1876286758755840:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789366596.566211:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638c1e6df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3285:x1876286758755840:12345-0@lo:400:kworker.0 Request processed in 614us (2265us total) trans 0 rc 0/0 00000100:00100000:2.0:1789366596.566221:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00010000:00080000:2.0:1789366596.566286:0:3285:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9638af2d5c00 x1876286758755840/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789366612 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789366596.566305:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9638af2d5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3285:1876286758755840:0@lo:400:kworker.0 00000100:00100000:0.0:1789366596.568221:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638c1e6fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3286:x1876286758755968:12345-0@lo:400:kworker.0 Request processed in 11777us (12804us total) trans 0 rc 0/0 00000100:00100000:0.0:1789366596.568239:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1789366596.568280:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286758755712 00000100:00100000:0.0:1789366596.568289:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286758755712 00000100:00100000:0.0:1789366596.568354:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1789366596.568364:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638c1e6f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3285:x1876286758755712:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789366596.569819:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638c1e6f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3285:x1876286758755712:12345-0@lo:400:kworker.0 Request processed in 1446us (5747us total) trans 0 rc 0/0 00000100:00100000:0.0:1789366596.569834:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1789366596.569930:0:3286:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9638b73cf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8cde4528-5832-4854-a387-4adacc3dd0ab:3286:1876286758755456:0@lo:400:kworker.0 00000100:00100000:0.0:1789366596.569953:0:3286:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9638af2d6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3286:1876286758755968:0@lo:400:kworker.0 00000100:00080000:0.0:1789366596.569991:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789366596.569999:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789366596.570024:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9638af2d4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3285:1876286758755712:0@lo:400:kworker.0 00010000:00010000:3.0:1789366596.663978:0:6675:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1789366597.672061:0:7617:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of b9764435-e52f-45ac-a5f9-bab1231105ac 00000020:00000080:1.0:1789366597.672077:0:7617:0:(genops.c:885:class_export_put()) final put ffff9638b7025000/b9764435-e52f-45ac-a5f9-bab1231105ac 00000020:00000080:2.0:1789366597.672709:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9638b7025000/b9764435-e52f-45ac-a5f9-bab1231105ac for lustre-OST0001 00000020:00000080:2.0:1789366597.672814:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9638b7027800 for lustre-OST0001 00010000:00010000:0.0:1789366597.699703:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1789366597.867701:0:11133:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffffa09df20 20000000:00000080:1.0:1789366597.870928:0:11133:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff963882f77800 uarg=0000000000000000 20000000:01000000:0.0:1789366597.871542:0:11133:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:0.0:1789366597.871551:0:11133:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:0.0:1789366597.871557:0:11133:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:0.0:1789366597.878054:0:11134:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 7 20000000:00000400:1.0:1789366597.878451:0:11133:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:1.0:1789366597.887355:0:11133:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1789366597.890665:0:11133:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9638b720ca00/0x8da3486b955f3133 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366597.890702:0:11133:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9638832d3600/0x8da3486b955f30d8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.202.23@tcp remote: 0xda917a494d06bee0 expref: 12 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366597.890714:0:11133:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9638a0740600/0x8da3486b955f30e6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8da3486b955f30df expref: 18 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366597.891260:0:11133:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9638832d2200/0x8da3486b955f30f4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8da3486b955f30ed expref: 18 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366597.891269:0:11133:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff96388148fc00/0x8da3486b955f3102 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8da3486b955f30fb expref: 18 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366597.891278:0:11133:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9638827f6600/0x8da3486b955f3117 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.202.23@tcp remote: 0xda917a494d06bf18 expref: 12 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366597.891286:0:11133:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9638b720ca00/0x8da3486b955f3133 lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 11133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366597.891357:0:11133:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9638827f6600/0x8da3486b955f3117 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.202.23@tcp remote: 0xda917a494d06bf18 expref: 12 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366597.891380:0:11133:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9638827f6600/0x8da3486b955f3117 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.202.23@tcp remote: 0xda917a494d06bf18 expref: 12 pid: 5811 timeout: 273 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789366597.891401:0:11133:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9638af2d4a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11133:1876286758756096:192.168.202.23@tcp:104: 00010000:00010000:0.0:1789366597.891865:0:11133:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff96388148fc00/0x8da3486b955f3102 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x8da3486b955f30fb expref: 18 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366597.891900:0:11133:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff96388148fc00/0x8da3486b955f3102 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x8da3486b955f30fb expref: 18 pid: 5811 timeout: 323 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789366597.891912:0:11133:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9638af2d6680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11133:1876286758756224:0@lo:104: 00000100:00100000:0.0:1789366597.891965:0:11133:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789366597.892012:0:11133:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9638832d2200/0x8da3486b955f30f4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x8da3486b955f30ed expref: 18 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366597.892021:0:11133:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9638832d2200/0x8da3486b955f30f4 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x8da3486b955f30ed expref: 18 pid: 5811 timeout: 323 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789366597.892029:0:11133:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9638af2d4700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11133:1876286758756352:0@lo:104: 00000100:00100000:0.0:1789366597.892056:0:11133:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789366597.892110:0:11133:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9638a0740600/0x8da3486b955f30e6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x8da3486b955f30df expref: 18 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366597.892119:0:11133:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9638a0740600/0x8da3486b955f30e6 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x8da3486b955f30df expref: 18 pid: 5810 timeout: 323 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789366597.892127:0:11133:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9638b70cd500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11133:1876286758756480:0@lo:104: 00000100:00100000:0.0:1789366597.892152:0:11133:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789366597.892252:0:11133:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9638832d3600/0x8da3486b955f30d8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.202.23@tcp remote: 0xda917a494d06bee0 expref: 12 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366597.892261:0:11133:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9638832d3600/0x8da3486b955f30d8 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.202.23@tcp remote: 0xda917a494d06bee0 expref: 12 pid: 5811 timeout: 273 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789366597.892270:0:11133:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9638b70ce300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11133:1876286758756608:192.168.202.23@tcp:104: 00000100:00100000:0.0:1789366597.892305:0:11133:0:(client.c:2716:ptlrpc_set_wait()) set ffff96388a34d300 going to sleep for 11 seconds 00000100:00100000:1.0:1789366597.892411:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286758756224 00000100:00100000:1.0:1789366597.892421:0:6674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286758756224 00000100:00100000:1.0:1789366597.892483:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286758756352 00000100:00100000:1.0:1789366597.892486:0:6674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286758756352 00000100:00100000:1.0:1789366597.892496:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286758756480 00000100:00100000:1.0:1789366597.892499:0:6674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286758756480 00000100:00100000:1.0:1789366597.892512:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1789366597.892523:0:6674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638af2d5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:8cde4528-5832-4854-a387-4adacc3dd0ab+5:11133:x1876286758756224:12345-0@lo:104: 00010000:00010000:1.0:1789366597.892545:0:6674:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.123@tcp lock: ffff9638a0740800/0x8da3486b955f30fb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x8da3486b955f3102 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366597.892617:0:6674:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1789366597.892624:0:6674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638af2d5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:8cde4528-5832-4854-a387-4adacc3dd0ab+5:11133:x1876286758756224:12345-0@lo:104: Request processed in 103us (660us total) trans 0 rc 0/0 00000100:00100000:1.0:1789366597.892631:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1789366597.892651:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1789366597.892657:0:6674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638af2d5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:8cde4528-5832-4854-a387-4adacc3dd0ab+4:11133:x1876286758756352:12345-0@lo:104: 00010000:00010000:1.0:1789366597.892665:0:6674:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.123@tcp lock: ffff9638832d3e00/0x8da3486b955f30ed lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x8da3486b955f30f4 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366597.892700:0:6674:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1789366597.892705:0:6674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638af2d5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:8cde4528-5832-4854-a387-4adacc3dd0ab+4:11133:x1876286758756352:12345-0@lo:104: Request processed in 49us (649us total) trans 0 rc 0/0 00000100:00100000:1.0:1789366597.892711:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1789366597.892752:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1789366597.892759:0:6674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638b70cce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:8cde4528-5832-4854-a387-4adacc3dd0ab+3:11133:x1876286758756480:12345-0@lo:104: 00010000:00010000:1.0:1789366597.892767:0:6674:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.123@tcp lock: ffff9638a0740a00/0x8da3486b955f30df lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x8da3486b955f30e6 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366597.892797:0:6674:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:1.0:1789366597.892802:0:6674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638b70cce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:8cde4528-5832-4854-a387-4adacc3dd0ab+3:11133:x1876286758756480:12345-0@lo:104: Request processed in 44us (650us total) trans 0 rc 0/0 00000100:00100000:1.0:1789366597.892808:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00010000:00010000:1.0:1789366597.892830:0:5805:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1789366597.892838:0:5805:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.123@tcp lock: ffff9638a0740800/0x8da3486b955f30fb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x8da3486b955f3102 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366597.892853:0:5805:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9638a0740800 already unused, calling callback (ffffffffc1cc7c20) 10000000:00010000:1.0:1789366597.892858:0:5805:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.123@tcp lock: ffff9638a0740800/0x8da3486b955f30fb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x8da3486b955f3102 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366597.892869:0:5805:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.123@tcp lock: ffff9638a0740800/0x8da3486b955f30fb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x8da3486b955f3102 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789366597.892877:0:5805:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.123@tcp lock: ffff9638a0740800/0x8da3486b955f30fb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x8da3486b955f3102 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789366597.892883:0:5805:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1789366597.892918:0:5805:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.123@tcp lock: ffff9638a0740800/0x8da3486b955f30fb lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8da3486b955f3102 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366597.892926:0:5805:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789366597.892947:0:5805:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.123@tcp lock: ffff9638a0740800/0x8da3486b955f30fb lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8da3486b955f3102 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366597.892954:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.123@tcp lock: ffff9638a0740800/0x8da3486b955f30fb lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8da3486b955f3102 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366597.892969:0:5805:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1789366597.892973:0:5805:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.123@tcp lock: ffff9638832d3e00/0x8da3486b955f30ed lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x8da3486b955f30f4 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366597.892979:0:5805:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9638832d3e00 already unused, calling callback (ffffffffc1cc7c20) 10000000:00010000:1.0:1789366597.892981:0:5805:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.123@tcp lock: ffff9638832d3e00/0x8da3486b955f30ed lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x8da3486b955f30f4 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366597.892997:0:5805:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.123@tcp lock: ffff9638832d3e00/0x8da3486b955f30ed lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x8da3486b955f30f4 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789366597.893003:0:5805:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.123@tcp lock: ffff9638832d3e00/0x8da3486b955f30ed lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x8da3486b955f30f4 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789366597.893008:0:5805:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1789366597.893022:0:5805:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.123@tcp lock: ffff9638832d3e00/0x8da3486b955f30ed lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8da3486b955f30f4 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366597.893028:0:5805:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789366597.893046:0:5805:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.123@tcp lock: ffff9638832d3e00/0x8da3486b955f30ed lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8da3486b955f30f4 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366597.893052:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.123@tcp lock: ffff9638832d3e00/0x8da3486b955f30ed lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8da3486b955f30f4 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366597.893062:0:5805:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789366597.893065:0:5805:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.123@tcp lock: ffff9638a0740a00/0x8da3486b955f30df lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x8da3486b955f30e6 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366597.893071:0:5805:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9638a0740a00 already unused, calling callback (ffffffffc1cc7c20) 10000000:00010000:1.0:1789366597.893074:0:5805:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.123@tcp lock: ffff9638a0740a00/0x8da3486b955f30df lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x8da3486b955f30e6 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366597.893081:0:5805:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.123@tcp lock: ffff9638a0740a00/0x8da3486b955f30df lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x8da3486b955f30e6 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789366597.893088:0:5805:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.123@tcp lock: ffff9638a0740a00/0x8da3486b955f30df lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x8da3486b955f30e6 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789366597.893099:0:5805:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1789366597.893114:0:5805:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.123@tcp lock: ffff9638a0740a00/0x8da3486b955f30df lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8da3486b955f30e6 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366597.893119:0:5805:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789366597.893126:0:5805:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.123@tcp lock: ffff9638a0740a00/0x8da3486b955f30df lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8da3486b955f30e6 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366597.893133:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.123@tcp lock: ffff9638a0740a00/0x8da3486b955f30df lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8da3486b955f30e6 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366597.893508:0:5805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789366597.893511:0:5805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789366597.893513:0:5805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789366597.893523:0:6675:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789366597.893550:0:3287:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9638b6cbdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8cde4528-5832-4854-a387-4adacc3dd0ab:3287:1876286758756736:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789366597.893590:0:3287:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789366597.893644:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9638b6cbd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8cde4528-5832-4854-a387-4adacc3dd0ab:3284:1876286758756864:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789366597.893672:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789366597.893692:0:3284:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789366597.893697:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9638b6cbc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8cde4528-5832-4854-a387-4adacc3dd0ab:3284:1876286758756992:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789366597.893758:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789366597.893794:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286758756736 00000100:00100000:1.0:1789366597.893801:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286758756736 00010000:00010000:1.0:1789366597.893831:0:5802:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff96388148fc00/0x8da3486b955f3102 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8da3486b955f30fb expref: 19 pid: 5811 timeout: 323 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789366597.893855:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286758756864 00000100:00100000:1.0:1789366597.893866:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286758756864 00010000:00010000:1.0:1789366597.893879:0:5802:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9638832d2200/0x8da3486b955f30f4 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8da3486b955f30ed expref: 20 pid: 5811 timeout: 323 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789366597.893890:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286758756992 00000100:00100000:1.0:1789366597.893893:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286758756992 00010000:00010000:1.0:1789366597.893903:0:5802:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9638a0740600/0x8da3486b955f30e6 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8da3486b955f30df expref: 21 pid: 5810 timeout: 323 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789366597.893916:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1789366597.893924:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638b6cbed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8cde4528-5832-4854-a387-4adacc3dd0ab+21:3287:x1876286758756736:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789366597.893937:0:5802:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789366597.893944:0:5802:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff96388148fc00/0x8da3486b955f3102 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8da3486b955f30fb expref: 21 pid: 5811 timeout: 323 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366597.893955:0:5802:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff96388148fc00/0x8da3486b955f3102 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x8da3486b955f30fb expref: 21 pid: 5811 timeout: 323 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366597.893976:0:5802:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789366597.894009:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638b6cbed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8cde4528-5832-4854-a387-4adacc3dd0ab+21:3287:x1876286758756736:12345-0@lo:103:ldlm_bl.0 Request processed in 85us (418us total) trans 0 rc 0/0 00000100:00100000:1.0:1789366597.894015:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1789366597.894030:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1789366597.894036:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96389861dc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8cde4528-5832-4854-a387-4adacc3dd0ab+20:3284:x1876286758756864:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789366597.894044:0:5802:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789366597.894048:0:5802:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9638832d2200/0x8da3486b955f30f4 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8da3486b955f30ed expref: 20 pid: 5811 timeout: 323 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366597.894055:0:5802:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9638832d2200/0x8da3486b955f30f4 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x8da3486b955f30ed expref: 20 pid: 5811 timeout: 323 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366597.894077:0:5802:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789366597.894104:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96389861dc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8cde4528-5832-4854-a387-4adacc3dd0ab+20:3284:x1876286758756864:12345-0@lo:103:ldlm_bl.0 Request processed in 68us (431us total) trans 0 rc 0/0 00000100:00100000:1.0:1789366597.894111:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1789366597.894155:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1789366597.894161:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638b6cbca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8cde4528-5832-4854-a387-4adacc3dd0ab+19:3284:x1876286758756992:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789366597.894362:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789366597.894429:0:11133:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff96388148fc00/0x8da3486b955f3102 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x8da3486b955f30fb expref: 19 pid: 5811 timeout: 323 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789366597.894442:0:11133:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9638af2d6680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11133:1876286758756224:0@lo:104: 00010000:00010000:0.0:1789366597.894467:0:11133:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9638832d2200/0x8da3486b955f30f4 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x8da3486b955f30ed expref: 18 pid: 5811 timeout: 323 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789366597.894476:0:11133:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9638af2d4700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11133:1876286758756352:0@lo:104: 00000100:00100000:0.0:1789366597.894487:0:11133:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9638b70cd500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11133:1876286758756480:0@lo:104: 00010000:00010000:1.0:1789366597.894584:0:5802:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789366597.894590:0:5802:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9638a0740600/0x8da3486b955f30e6 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8da3486b955f30df expref: 17 pid: 5810 timeout: 323 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366597.894600:0:5802:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9638a0740600/0x8da3486b955f30e6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x8da3486b955f30df expref: 17 pid: 5810 timeout: 323 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366597.894611:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9638a0740600/0x8da3486b955f30e6 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x8da3486b955f30df expref: 17 pid: 5810 timeout: 323 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366597.894621:0:5802:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789366597.894648:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638b6cbca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8cde4528-5832-4854-a387-4adacc3dd0ab+16:3284:x1876286758756992:12345-0@lo:103:ldlm_bl.0 Request processed in 486us (890us total) trans 0 rc 0/0 00000100:00100000:1.0:1789366597.894654:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1789366597.894686:0:3287:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9638b6cbdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8cde4528-5832-4854-a387-4adacc3dd0ab:3287:1876286758756736:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789366597.894714:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9638b6cbc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8cde4528-5832-4854-a387-4adacc3dd0ab:3284:1876286758756992:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789366597.900779:0:11133:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9638af2d4a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11133:1876286758756096:192.168.202.23@tcp:104: 00000100:00100000:2.0:1789366597.900801:0:11133:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9638b70ce300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11133:1876286758756608:192.168.202.23@tcp:104: 00010000:00010000:2.0:1789366597.900864:0:11133:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9638b720ca00/0x8da3486b955f3133 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789366597.901673:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9638b6cbd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8cde4528-5832-4854-a387-4adacc3dd0ab:3284:1876286758756864:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789366597.915848:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:2.0:1789366597.915963:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:1.0:1789366597.917530:0:8419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751389056 00000100:00100000:1.0:1789366597.917548:0:8419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751389056 00010000:00010000:1.0:1789366597.917606:0:8419:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9638827f6600/0x8da3486b955f3117 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.23@tcp remote: 0xda917a494d06bf18 expref: 13 pid: 5811 timeout: 273 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789366597.917683:0:8419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751389184 00000100:00100000:1.0:1789366597.917688:0:8419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751389184 00010000:00010000:1.0:1789366597.917704:0:8419:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9638832d3600/0x8da3486b955f30d8 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.23@tcp remote: 0xda917a494d06bee0 expref: 14 pid: 5811 timeout: 273 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789366597.917778:0:8419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 27 00000100:00100000:1.0:1789366597.917791:0:8419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638c1e6f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:14a2847b-91d8-4d87-b71b-010443acc91a+14:2354:x1876286751389056:12345-192.168.202.23@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789366597.917809:0:8419:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789366597.917815:0:8419:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9638827f6600/0x8da3486b955f3117 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.202.23@tcp remote: 0xda917a494d06bf18 expref: 14 pid: 5811 timeout: 273 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366597.917829:0:8419:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9638827f6600/0x8da3486b955f3117 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.202.23@tcp remote: 0xda917a494d06bf18 expref: 14 pid: 5811 timeout: 273 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366597.917852:0:8419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9638827f6600/0x8da3486b955f3117 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.202.23@tcp remote: 0xda917a494d06bf18 expref: 14 pid: 5811 timeout: 273 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366597.917875:0:8419:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789366597.917957:0:8419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638c1e6f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:14a2847b-91d8-4d87-b71b-010443acc91a+13:2354:x1876286751389056:12345-192.168.202.23@tcp:103:ldlm_bl.0 Request processed in 169us (2124us total) trans 0 rc 0/0 00000100:00100000:1.0:1789366597.917964:0:8419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 27 00000100:00100000:1.0:1789366597.918585:0:8419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 28 00000100:00100000:1.0:1789366597.918602:0:8419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638c1e6ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:14a2847b-91d8-4d87-b71b-010443acc91a+12:2355:x1876286751389184:12345-192.168.202.23@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789366597.918615:0:8419:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789366597.918622:0:8419:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9638832d3600/0x8da3486b955f30d8 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.23@tcp remote: 0xda917a494d06bee0 expref: 12 pid: 5811 timeout: 273 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366597.918650:0:8419:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9638832d3600/0x8da3486b955f30d8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.202.23@tcp remote: 0xda917a494d06bee0 expref: 12 pid: 5811 timeout: 273 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366597.918663:0:8419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9638832d3600/0x8da3486b955f30d8 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.202.23@tcp remote: 0xda917a494d06bee0 expref: 12 pid: 5811 timeout: 273 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366597.918679:0:8419:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9638b720ca00/0x8da3486b955f3133 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366597.918689:0:8419:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9638b720ca00/0x8da3486b955f3133 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366597.918709:0:8419:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9638b720ca00/0x8da3486b955f3133 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366597.918781:0:8419:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9638b720ca00/0x8da3486b955f3133 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366597.918791:0:8419:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9638b720ca00/0x8da3486b955f3133 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366597.918800:0:8419:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9638b720ca00/0x8da3486b955f3133 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366597.918807:0:8419:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9638b720ca00 already unused, calling callback (ffffffffc16df520) 00010000:00010000:1.0:1789366597.918812:0:8419:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9638b720ca00/0x8da3486b955f3133 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366597.918822:0:8419:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9638b720ca00/0x8da3486b955f3133 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 11133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366597.918849:0:8419:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9638b720ca00/0x8da3486b955f3133 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366597.918862:0:8419:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789366597.918900:0:8419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638c1e6ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:14a2847b-91d8-4d87-b71b-010443acc91a+11:2355:x1876286751389184:12345-192.168.202.23@tcp:103:ldlm_bl.0 Request processed in 304us (2936us total) trans 0 rc 0/0 00000100:00100000:1.0:1789366597.918907:0:8419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 28 00010000:00010000:2.0:1789366597.920536:0:11133:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9638b720ca00/0x8da3486b955f3133 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366597.920560:0:11133:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9638b720ca00/0x8da3486b955f3133 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366597.920568:0:11133:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9638b720ca00/0x8da3486b955f3133 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366598.715004:0:5805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789366599.096130:0:3287:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789366599.096161:0:3287:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96388330b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3287:1876286758757120:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789366599.096250:0:3287:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789366599.096334:0:7134:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286758757120 00000100:00100000:3.0:1789366599.096344:0:7134:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286758757120 00000100:00100000:3.0:1789366599.096417:0:7134:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1789366599.096428:0:7134:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96388330b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3287:x1876286758757120:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789366599.096486:0:7134:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789366599.096554:0:7134:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96388330b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3287:x1876286758757120:12345-0@lo:13:osp-pre-0-0.0 Request processed in 128us (305us total) trans 0 rc 0/0 00000100:00100000:3.0:1789366599.096562:0:7134:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00080000:3.0:1789366599.096585:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1789366599.096634:0:3287:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96388330b100 x1876286758757120/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789366615 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789366599.096656:0:3287:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96388330b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3287:1876286758757120:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789366599.311810:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:2.0:1789366599.311895:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751389312 00000100:00100000:2.0:1789366599.311908:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751389312 00000100:00100000:2.0:1789366599.311970:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 214 00000100:00100000:2.0:1789366599.311988:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638b4e83850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:14a2847b-91d8-4d87-b71b-010443acc91a+11:5583:x1876286751389312:12345-192.168.202.23@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789366599.312009:0:5810:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789366599.312032:0:5810:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9638a0741c00/0x8da3486b955f313a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xda917a494d06bf42 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366599.312065:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9638a0741c00/0x8da3486b955f313a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.202.23@tcp remote: 0xda917a494d06bf42 expref: 12 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366599.312078:0:5810:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9638a0741c00/0x8da3486b955f313a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.202.23@tcp remote: 0xda917a494d06bf42 expref: 12 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366599.312088:0:5810:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9638a0741c00, rc 0) 00000100:00100000:2.0:1789366599.312151:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638b4e83850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:14a2847b-91d8-4d87-b71b-010443acc91a+12:5583:x1876286751389312:12345-192.168.202.23@tcp:101:ll_cfg_requeue.0 Request processed in 165us (359us total) trans 0 rc 0/0 00000100:00100000:2.0:1789366599.312159:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 214 00000100:00100000:1.0:1789366599.322909:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:1.0:1789366599.322972:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751389440 00000100:00100000:1.0:1789366599.322983:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751389440 00000100:00100000:1.0:1789366599.323042:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 215 00000100:00100000:1.0:1789366599.323053:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638b4e83c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:14a2847b-91d8-4d87-b71b-010443acc91a+12:5583:x1876286751389440:12345-192.168.202.23@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789366599.323415:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638b4e83c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:14a2847b-91d8-4d87-b71b-010443acc91a+12:5583:x1876286751389440:12345-192.168.202.23@tcp:501:ll_cfg_requeue.0 Request processed in 361us (520us total) trans 0 rc 0/0 00000100:00100000:1.0:1789366599.323424:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 215 00000100:00100000:2.0:1789366599.345085:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:1.0:1789366599.345250:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751389568 00000100:00100000:1.0:1789366599.345263:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751389568 00000100:00100000:1.0:1789366599.345330:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 216 00000100:00100000:1.0:1789366599.345341:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638b4e82c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:14a2847b-91d8-4d87-b71b-010443acc91a+12:5583:x1876286751389568:12345-192.168.202.23@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789366599.346735:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638b4e82c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:14a2847b-91d8-4d87-b71b-010443acc91a+12:5583:x1876286751389568:12345-192.168.202.23@tcp:503:ll_cfg_requeue.0 Request processed in 1359us (1629us total) trans 0 rc 0/0 00000100:00100000:1.0:1789366599.346749:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 216 00000100:00100000:1.0:1789366599.369665:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:3.0:1789366599.369988:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751389696 00000100:00100000:3.0:1789366599.370001:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751389696 00000100:00100000:3.0:1789366599.370083:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 217 00000100:00100000:3.0:1789366599.370097:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638b4e80450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:14a2847b-91d8-4d87-b71b-010443acc91a+12:5583:x1876286751389696:12345-192.168.202.23@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789366599.370121:0:5810:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789366599.370148:0:5810:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9638832d3a00/0x8da3486b955f3141 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xda917a494d06bf49 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366599.370191:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9638832d3a00/0x8da3486b955f3141 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.202.23@tcp remote: 0xda917a494d06bf49 expref: 13 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366599.370206:0:5810:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9638832d3a00/0x8da3486b955f3141 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.202.23@tcp remote: 0xda917a494d06bf49 expref: 13 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366599.370219:0:5810:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9638832d3a00, rc 0) 00000100:00100000:3.0:1789366599.370309:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638b4e80450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:14a2847b-91d8-4d87-b71b-010443acc91a+13:5583:x1876286751389696:12345-192.168.202.23@tcp:101:ll_cfg_requeue.0 Request processed in 214us (670us total) trans 0 rc 0/0 00000100:00100000:3.0:1789366599.370317:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 217 00000100:00100000:1.0:1789366599.376119:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:0.0:1789366599.376248:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751389824 00000100:00100000:0.0:1789366599.376267:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751389824 00000100:00100000:0.0:1789366599.376358:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 218 00000100:00100000:0.0:1789366599.376374:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638b4e83050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:14a2847b-91d8-4d87-b71b-010443acc91a+13:5583:x1876286751389824:12345-192.168.202.23@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789366599.376935:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638b4e83050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:14a2847b-91d8-4d87-b71b-010443acc91a+13:5583:x1876286751389824:12345-192.168.202.23@tcp:501:ll_cfg_requeue.0 Request processed in 560us (830us total) trans 0 rc 0/0 00000100:00100000:0.0:1789366599.376947:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 218 00000100:00100000:3.0:1789366599.389926:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:1.0:1789366599.390049:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751389952 00000100:00100000:1.0:1789366599.390062:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751389952 00000100:00100000:1.0:1789366599.390132:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 219 00000100:00100000:1.0:1789366599.390144:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638b4e81850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:14a2847b-91d8-4d87-b71b-010443acc91a+13:5583:x1876286751389952:12345-192.168.202.23@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789366599.390448:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638b4e81850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:14a2847b-91d8-4d87-b71b-010443acc91a+13:5583:x1876286751389952:12345-192.168.202.23@tcp:503:ll_cfg_requeue.0 Request processed in 305us (537us total) trans 0 rc 0/0 00000100:00100000:1.0:1789366599.390458:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 219 10000000:01000000:1.0:1789366599.417916:0:5813:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1789366599.417926:0:5813:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff963883577000 from 7 10000000:01000000:1.0:1789366599.417933:0:5813:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1789366599.417994:0:5813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.123@tcp lock: ffff96388148e800/0x8da3486b955f3148 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366599.418008:0:5813:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.123@tcp lock: ffff96388148e800/0x8da3486b955f3148 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366599.418022:0:5813:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.123@tcp lock: ffff96388148e800/0x8da3486b955f3148 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789366599.418055:0:5813:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9638b6cbdf80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8cde4528-5832-4854-a387-4adacc3dd0ab:5813:1876286758757248:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789366599.418141:0:5813:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789366599.418210:0:5813:0:(client.c:2716:ptlrpc_set_wait()) set ffff9638bf1ddcc0 going to sleep for 11 seconds 00000100:00100000:3.0:1789366599.418275:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286758757248 00000100:00100000:3.0:1789366599.418294:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286758757248 00000100:00100000:3.0:1789366599.418360:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 220 00000100:00100000:3.0:1789366599.418371:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638b4e82450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8cde4528-5832-4854-a387-4adacc3dd0ab+16:5813:x1876286758757248:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789366599.418388:0:5810:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789366599.418404:0:5810:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9638832d2a00/0x8da3486b955f314f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x8da3486b955f3148 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366599.418434:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9638832d2a00/0x8da3486b955f314f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8da3486b955f3148 expref: 17 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366599.418447:0:5810:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9638832d2a00/0x8da3486b955f314f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8da3486b955f3148 expref: 17 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366599.418458:0:5810:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9638832d2a00, rc 0) 00000100:00100000:3.0:1789366599.418522:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638b4e82450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8cde4528-5832-4854-a387-4adacc3dd0ab+17:5813:x1876286758757248:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 152us (381us total) trans 0 rc 0/0 00000100:00100000:3.0:1789366599.418531:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 220 00000100:00100000:2.0:1789366599.418628:0:5813:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9638b6cbdf80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8cde4528-5832-4854-a387-4adacc3dd0ab:5813:1876286758757248:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789366599.418647:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.123@tcp lock: ffff96388148e800/0x8da3486b955f3148 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8da3486b955f314f expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366599.418657:0:5813:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.123@tcp lock: ffff96388148e800/0x8da3486b955f3148 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x8da3486b955f314f expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789366599.418768:0:5813:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9638c1e6f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8cde4528-5832-4854-a387-4adacc3dd0ab:5813:1876286758757376:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789366599.418798:0:5813:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789366599.418818:0:5813:0:(client.c:2716:ptlrpc_set_wait()) set ffff9638b70ff180 going to sleep for 11 seconds 00000100:00100000:3.0:1789366599.418867:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286758757376 00000100:00100000:3.0:1789366599.418871:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286758757376 00000100:00100000:3.0:1789366599.418901:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 221 00000100:00100000:3.0:1789366599.418908:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638b4e82050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8cde4528-5832-4854-a387-4adacc3dd0ab+17:5813:x1876286758757376:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789366599.419185:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638b4e82050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8cde4528-5832-4854-a387-4adacc3dd0ab+17:5813:x1876286758757376:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 277us (386us total) trans 0 rc 0/0 00000100:00100000:3.0:1789366599.419192:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 221 00000100:00100000:2.0:1789366599.419260:0:5813:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9638c1e6f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8cde4528-5832-4854-a387-4adacc3dd0ab:5813:1876286758757376:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789366599.419306:0:5813:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9638c1e6f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8cde4528-5832-4854-a387-4adacc3dd0ab:5813:1876286758757504:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789366599.419348:0:5813:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789366599.419369:0:5813:0:(client.c:2716:ptlrpc_set_wait()) set ffff9638b70ff180 going to sleep for 11 seconds 00000100:00100000:2.0:1789366599.419383:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286758757504 00000100:00100000:2.0:1789366599.419386:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286758757504 00000100:00100000:2.0:1789366599.419406:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 222 00000100:00100000:2.0:1789366599.419412:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638b4e82850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8cde4528-5832-4854-a387-4adacc3dd0ab+17:5813:x1876286758757504:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789366599.419585:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638b4e82850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8cde4528-5832-4854-a387-4adacc3dd0ab+17:5813:x1876286758757504:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 173us (236us total) trans 0 rc 0/0 00000100:00100000:2.0:1789366599.419592:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 222 00000100:00100000:2.0:1789366599.419629:0:5813:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9638c1e6f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8cde4528-5832-4854-a387-4adacc3dd0ab:5813:1876286758757504:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1789366599.421915:0:11158:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:2.0:1789366599.422133:0:5813:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:2.0:1789366599.422157:0:5813:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.123@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1789366599.422170:0:5813:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.123@tcp lock: ffff96388148e800/0x8da3486b955f3148 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8da3486b955f314f expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366599.422184:0:5813:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.123@tcp lock: ffff96388148e800/0x8da3486b955f3148 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8da3486b955f314f expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789366599.422196:0:5813:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1789366599.422199:0:5813:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff963885b46000 from 7 10000000:01000000:2.0:1789366599.422202:0:5813:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1789366599.422247:0:5813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.123@tcp lock: ffff9638a0740800/0x8da3486b955f3156 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366599.422256:0:5813:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.123@tcp lock: ffff9638a0740800/0x8da3486b955f3156 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366599.422288:0:5813:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.123@tcp lock: ffff9638a0740800/0x8da3486b955f3156 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789366599.422318:0:5813:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9638c1e6f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8cde4528-5832-4854-a387-4adacc3dd0ab:5813:1876286758757632:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789366599.422396:0:5813:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789366599.422450:0:5813:0:(client.c:2716:ptlrpc_set_wait()) set ffff9638b70ff180 going to sleep for 11 seconds 00000100:00100000:3.0:1789366599.424029:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286758757632 00000100:00100000:3.0:1789366599.424049:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286758757632 00000100:00100000:3.0:1789366599.424132:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 223 00000100:00100000:3.0:1789366599.424144:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638b4e3cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8cde4528-5832-4854-a387-4adacc3dd0ab+17:5813:x1876286758757632:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789366599.424176:0:5810:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789366599.424198:0:5810:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9638832d3c00/0x8da3486b955f315d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x8da3486b955f3156 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366599.424237:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9638832d3c00/0x8da3486b955f315d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8da3486b955f3156 expref: 18 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366599.424253:0:5810:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9638832d3c00/0x8da3486b955f315d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8da3486b955f3156 expref: 18 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366599.424265:0:5810:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9638832d3c00, rc 0) 00000100:00100000:3.0:1789366599.424361:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638b4e3cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8cde4528-5832-4854-a387-4adacc3dd0ab+18:5813:x1876286758757632:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 219us (1965us total) trans 0 rc 0/0 00000100:00100000:3.0:1789366599.424369:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 223 00000100:00100000:3.0:1789366599.424435:0:5813:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9638c1e6f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8cde4528-5832-4854-a387-4adacc3dd0ab:5813:1876286758757632:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789366599.424460:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.123@tcp lock: ffff9638a0740800/0x8da3486b955f3156 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8da3486b955f315d expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366599.424472:0:5813:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.123@tcp lock: ffff9638a0740800/0x8da3486b955f3156 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x8da3486b955f315d expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789366599.424561:0:5813:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96388330b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8cde4528-5832-4854-a387-4adacc3dd0ab:5813:1876286758757760:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789366599.424602:0:5813:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789366599.424623:0:5813:0:(client.c:2716:ptlrpc_set_wait()) set ffff963882a2ac00 going to sleep for 11 seconds 00000100:00100000:1.0:1789366599.426939:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286758757760 00000100:00100000:1.0:1789366599.426963:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286758757760 00000100:00100000:1.0:1789366599.427048:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 224 00000100:00100000:1.0:1789366599.427060:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638b4e3dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8cde4528-5832-4854-a387-4adacc3dd0ab+18:5813:x1876286758757760:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789366599.427488:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638b4e3dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8cde4528-5832-4854-a387-4adacc3dd0ab+18:5813:x1876286758757760:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 428us (2883us total) trans 0 rc 0/0 00000100:00100000:1.0:1789366599.427503:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 224 00000100:00100000:3.0:1789366599.432977:0:5813:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96388330b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8cde4528-5832-4854-a387-4adacc3dd0ab:5813:1876286758757760:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789366599.433081:0:5813:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96388330b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8cde4528-5832-4854-a387-4adacc3dd0ab:5813:1876286758757888:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789366599.433214:0:5813:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789366599.433267:0:5813:0:(client.c:2716:ptlrpc_set_wait()) set ffff963882a2ac00 going to sleep for 11 seconds 00000100:00100000:3.0:1789366599.433297:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286758757888 00000100:00100000:3.0:1789366599.433305:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286758757888 00000100:00100000:3.0:1789366599.433370:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 225 00000100:00100000:3.0:1789366599.433381:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638b4e3f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8cde4528-5832-4854-a387-4adacc3dd0ab+18:5813:x1876286758757888:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789366599.433658:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638b4e3f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8cde4528-5832-4854-a387-4adacc3dd0ab+18:5813:x1876286758757888:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 278us (444us total) trans 0 rc 0/0 00000100:00100000:3.0:1789366599.433667:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 225 00000100:00100000:3.0:1789366599.433762:0:5813:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96388330b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8cde4528-5832-4854-a387-4adacc3dd0ab:5813:1876286758757888:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1789366599.442113:0:11159:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:0.0:1789366599.442323:0:5813:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:0.0:1789366599.442353:0:5813:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.123@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1789366599.442369:0:5813:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.123@tcp lock: ffff9638a0740800/0x8da3486b955f3156 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8da3486b955f315d expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366599.442386:0:5813:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.123@tcp lock: ffff9638a0740800/0x8da3486b955f3156 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8da3486b955f315d expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789366599.442426:0:5813:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1789366599.442429:0:5813:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff963884956000 from 7 10000000:01000000:0.0:1789366599.442432:0:5813:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1789366599.442489:0:5813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.123@tcp lock: ffff9638b720d000/0x8da3486b955f3164 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366599.442499:0:5813:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.123@tcp lock: ffff9638b720d000/0x8da3486b955f3164 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366599.442512:0:5813:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.123@tcp lock: ffff9638b720d000/0x8da3486b955f3164 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789366599.442547:0:5813:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9638b70cf100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8cde4528-5832-4854-a387-4adacc3dd0ab:5813:1876286758758016:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789366599.442642:0:5813:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789366599.442754:0:5813:0:(client.c:2716:ptlrpc_set_wait()) set ffff96388a34d540 going to sleep for 11 seconds 00000100:00100000:1.0:1789366599.442986:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286758758016 00000100:00100000:1.0:1789366599.442996:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286758758016 00000100:00100000:1.0:1789366599.443044:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 226 00000100:00100000:1.0:1789366599.443055:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638b4e3fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8cde4528-5832-4854-a387-4adacc3dd0ab+18:5813:x1876286758758016:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789366599.443073:0:5810:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789366599.443091:0:5810:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff96388148fa00/0x8da3486b955f316b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x8da3486b955f3164 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366599.443122:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff96388148fa00/0x8da3486b955f316b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8da3486b955f3164 expref: 19 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366599.443135:0:5810:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff96388148fa00/0x8da3486b955f316b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8da3486b955f3164 expref: 19 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366599.443145:0:5810:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96388148fa00, rc 0) 00000100:00100000:1.0:1789366599.443195:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638b4e3fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8cde4528-5832-4854-a387-4adacc3dd0ab+19:5813:x1876286758758016:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 141us (553us total) trans 0 rc 0/0 00000100:00100000:1.0:1789366599.443203:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 226 00000100:00100000:1.0:1789366599.443257:0:5813:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9638b70cf100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8cde4528-5832-4854-a387-4adacc3dd0ab:5813:1876286758758016:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789366599.443275:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.123@tcp lock: ffff9638b720d000/0x8da3486b955f3164 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x8da3486b955f316b expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366599.443285:0:5813:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.123@tcp lock: ffff9638b720d000/0x8da3486b955f3164 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x8da3486b955f316b expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789366599.443346:0:5813:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9638b6cbed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8cde4528-5832-4854-a387-4adacc3dd0ab:5813:1876286758758144:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789366599.443389:0:5813:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789366599.443410:0:5813:0:(client.c:2716:ptlrpc_set_wait()) set ffff9638bf1dd240 going to sleep for 11 seconds 00000100:00100000:0.0:1789366599.443473:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286758758144 00000100:00100000:0.0:1789366599.443478:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286758758144 00000100:00100000:0.0:1789366599.443512:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 227 00000100:00100000:0.0:1789366599.443520:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638b4e3ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8cde4528-5832-4854-a387-4adacc3dd0ab+19:5813:x1876286758758144:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789366599.443860:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638b4e3ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8cde4528-5832-4854-a387-4adacc3dd0ab+19:5813:x1876286758758144:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 340us (469us total) trans 0 rc 0/0 00000100:00100000:0.0:1789366599.443867:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 227 00000100:00100000:1.0:1789366599.447031:0:5813:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9638b6cbed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8cde4528-5832-4854-a387-4adacc3dd0ab:5813:1876286758758144:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789366599.447120:0:5813:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9638b6cbed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8cde4528-5832-4854-a387-4adacc3dd0ab:5813:1876286758758272:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789366599.447216:0:5813:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789366599.447262:0:5813:0:(client.c:2716:ptlrpc_set_wait()) set ffff9638bf1dd240 going to sleep for 11 seconds 00000100:00100000:1.0:1789366599.447283:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286758758272 00000100:00100000:1.0:1789366599.447290:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286758758272 00000100:00100000:1.0:1789366599.447348:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 228 00000100:00100000:1.0:1789366599.447356:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638b4e3c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8cde4528-5832-4854-a387-4adacc3dd0ab+19:5813:x1876286758758272:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789366599.447584:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638b4e3c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8cde4528-5832-4854-a387-4adacc3dd0ab+19:5813:x1876286758758272:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 226us (367us total) trans 0 rc 0/0 00000100:00100000:1.0:1789366599.447593:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 228 00000100:00100000:1.0:1789366599.447648:0:5813:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9638b6cbed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8cde4528-5832-4854-a387-4adacc3dd0ab:5813:1876286758758272:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1789366599.448354:0:11160:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:1.0:1789366599.448408:0:5813:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:1.0:1789366599.448425:0:5813:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.123@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1789366599.448435:0:5813:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.123@tcp lock: ffff9638b720d000/0x8da3486b955f3164 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x8da3486b955f316b expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366599.448447:0:5813:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.123@tcp lock: ffff9638b720d000/0x8da3486b955f3164 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x8da3486b955f316b expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366599.737445:0:6675:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789366600.760255:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1789366601.286797:0:6685:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of b9764435-e52f-45ac-a5f9-bab1231105ac 00000020:00000080:3.0:1789366601.286808:0:6685:0:(genops.c:885:class_export_put()) final put ffff9638b7026800/b9764435-e52f-45ac-a5f9-bab1231105ac 00000020:00000080:1.0:1789366601.286879:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9638b7026800/b9764435-e52f-45ac-a5f9-bab1231105ac for lustre-OST0000 00000020:00000080:1.0:1789366601.286938:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9638b7023800 for lustre-OST0000 00000100:00100000:1.0:1789366601.431923:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:1.0:1789366601.431972:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:1.0:1789366601.431998:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:1.0:1789366601.432032:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751390080 00000100:00100000:1.0:1789366601.432044:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751390080 00000100:00100000:1.0:1789366601.432121:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 229 00000100:00100000:1.0:1789366601.432133:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638b4e3f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:14a2847b-91d8-4d87-b71b-010443acc91a+13:2356:x1876286751390080:12345-192.168.202.23@tcp:400:kworker.0 00000100:00100000:1.0:1789366601.432232:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638b4e3f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:14a2847b-91d8-4d87-b71b-010443acc91a+13:2356:x1876286751390080:12345-192.168.202.23@tcp:400:kworker.0 Request processed in 100us (257us total) trans 0 rc 0/0 00000100:00100000:1.0:1789366601.432240:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 229 00000100:00100000:0.0:1789366601.433057:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751390208 00000100:00100000:0.0:1789366601.433070:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751390208 00000100:00100000:0.0:1789366601.433150:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751390336 00000100:00100000:0.0:1789366601.433155:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751390336 00000100:00080000:2.0:1789366601.433163:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789366601.433183:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 60 00000100:00100000:0.0:1789366601.433206:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638b6cbed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0ab23baa-a205-44ad-bf17-f7b47295d82b+6:2356:x1876286751390208:12345-192.168.202.23@tcp:400:kworker.0 00000100:00100000:0.0:1789366601.433279:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638b6cbed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0ab23baa-a205-44ad-bf17-f7b47295d82b+6:2356:x1876286751390208:12345-192.168.202.23@tcp:400:kworker.0 Request processed in 75us (1379us total) trans 0 rc 0/0 00000100:00100000:0.0:1789366601.433287:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 60 00000100:00100000:0.0:1789366601.433315:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 61 00000100:00100000:0.0:1789366601.433322:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638b6cbe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b9764435-e52f-45ac-a5f9-bab1231105ac+5:2356:x1876286751390336:12345-192.168.202.23@tcp:400:kworker.0 00000100:00100000:0.0:1789366601.433348:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638b6cbe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b9764435-e52f-45ac-a5f9-bab1231105ac+5:2356:x1876286751390336:12345-192.168.202.23@tcp:400:kworker.0 Request processed in 26us (1349us total) trans 0 rc 0/0 00000100:00100000:0.0:1789366601.433354:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 61 00000100:00100000:1.0:1789366601.656441:0:3286:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789366601.656471:0:3286:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9638b6cbdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3286:1876286758758400:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789366601.656561:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789366601.656646:0:6662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286758758400 00000100:00100000:1.0:1789366601.656655:0:6662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286758758400 00000100:00100000:1.0:1789366601.656749:0:6662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1789366601.656759:0:6662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638b6cbdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3286:x1876286758758400:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789366601.656804:0:6662:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789366601.656850:0:6662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638b6cbdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3286:x1876286758758400:12345-0@lo:13:osp-pre-1-0.0 Request processed in 92us (289us total) trans 0 rc 0/0 00000100:00100000:1.0:1789366601.656858:0:6662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00010000:00080000:1.0:1789366601.656904:0:3286:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9638b6cbdc00 x1876286758758400/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789366617 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789366601.656926:0:3286:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9638b6cbdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3286:1876286758758400:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789366601.661132:0:3287:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff963883308000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3287:1876286758758912:0@lo:400:kworker.0 00000100:00100000:3.0:1789366601.661241:0:3287:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789366601.661305:0:3287:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789366601.661312:0:3287:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96388330b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3287:1876286758758784:0@lo:400:kworker.0 00000100:00100000:3.0:1789366601.661343:0:3287:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789366601.661407:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286758758912 00000100:00100000:3.0:1789366601.661418:0:6661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286758758912 00000100:00100000:3.0:1789366601.661499:0:6661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1789366601.661511:0:6661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96388330bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3287:x1876286758758912:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789366601.661574:0:6661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96388330bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3287:x1876286758758912:12345-0@lo:400:kworker.0 Request processed in 64us (333us total) trans 0 rc 0/0 00000100:00100000:3.0:1789366601.661581:0:6661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00010000:00080000:3.0:1789366601.661631:0:3287:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff963883308000 x1876286758758912/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789366617 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789366601.661674:0:3287:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff963883308000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3287:1876286758758912:0@lo:400:kworker.0 00000100:00080000:2.0:1789366601.662037:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789366601.662043:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789366601.662140:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96388330b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8cde4528-5832-4854-a387-4adacc3dd0ab:3284:1876286758758528:0@lo:400:kworker.0 00000100:00100000:1.0:1789366601.662182:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789366601.662235:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff963883309f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3284:1876286758759040:0@lo:400:kworker.0 00000100:00100000:1.0:1789366601.662262:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789366601.662283:0:3284:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789366601.662289:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96388330aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3284:1876286758758656:0@lo:400:kworker.0 00000100:00100000:1.0:1789366601.662310:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789366601.662354:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286758758784 00000100:00100000:1.0:1789366601.662359:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286758758784 00000100:00100000:1.0:1789366601.662399:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286758759040 00000100:00100000:1.0:1789366601.662402:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286758759040 00000100:00100000:1.0:1789366601.662419:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286758758656 00000100:00100000:1.0:1789366601.662422:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286758758656 00000100:00100000:1.0:1789366601.662435:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1789366601.662441:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963883309880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3287:x1876286758758784:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789366601.662483:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963883309880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3287:x1876286758758784:12345-0@lo:400:kworker.0 Request processed in 42us (1139us total) trans 0 rc 0/0 00000100:00100000:1.0:1789366601.662490:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1789366601.662505:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1789366601.662511:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638b6cbdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3284:x1876286758759040:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789366601.662541:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638b6cbdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3284:x1876286758759040:12345-0@lo:400:kworker.0 Request processed in 31us (278us total) trans 0 rc 0/0 00000100:00100000:1.0:1789366601.662547:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1789366601.662557:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1789366601.662562:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638b6cbd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3284:x1876286758758656:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789366601.662587:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638b6cbd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3284:x1876286758758656:12345-0@lo:400:kworker.0 Request processed in 24us (276us total) trans 0 rc 0/0 00000100:00100000:1.0:1789366601.662593:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1789366601.662630:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96388330aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3284:1876286758758656:0@lo:400:kworker.0 00000100:00100000:1.0:1789366601.662650:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff963883309f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3284:1876286758759040:0@lo:400:kworker.0 00000100:00100000:2.0:1789366601.662768:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286758758528 00000100:00100000:2.0:1789366601.662772:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286758758528 00000100:00100000:2.0:1789366601.662806:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 230 00000100:00100000:2.0:1789366601.662813:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638b4e3d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8cde4528-5832-4854-a387-4adacc3dd0ab+19:3284:x1876286758758528:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789366601.662853:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638b4e3d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8cde4528-5832-4854-a387-4adacc3dd0ab+19:3284:x1876286758758528:12345-0@lo:400:kworker.0 Request processed in 41us (670us total) trans 0 rc 0/0 00000100:00100000:2.0:1789366601.662859:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 230 00000100:00080000:2.0:1789366601.662887:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789366601.662900:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96388330b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8cde4528-5832-4854-a387-4adacc3dd0ab:3284:1876286758758528:0@lo:400:kworker.0 00000100:00100000:3.0:1789366601.663171:0:3287:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96388330b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3287:1876286758758784:0@lo:400:kworker.0 00010000:00010000:1.0:1789366601.793166:0:5805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789366602.808263:0:6675:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789366603.841768:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789366604.216798:0:3284:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789366604.216826:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96388330b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3284:1876286758759168:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789366604.216905:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789366604.216995:0:6663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286758759168 00000100:00100000:0.0:1789366604.217004:0:6663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286758759168 00000100:00100000:0.0:1789366604.217173:0:6663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1789366604.217184:0:6663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638b70cc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1876286758759168:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789366604.217219:0:6663:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789366604.217259:0:6663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638b70cc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1876286758759168:12345-0@lo:13:osp-pre-0-0.0 Request processed in 77us (354us total) trans 0 rc 0/0 00000100:00100000:0.0:1789366604.217265:0:6663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00080000:0.0:1789366604.217285:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1789366604.217309:0:3284:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96388330b480 x1876286758759168/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789366620 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789366604.217329:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96388330b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3284:1876286758759168:0@lo:13:osp-pre-0-0.0 00000001:02000400:2.0:1789366604.361151:0:11333:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg223-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:1.0:1789366604.856917:0:5805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789366605.880741:0:6675:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789366606.542027:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:1.0:1789366606.542093:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:2.0:1789366606.542191:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751390464 00000100:00100000:2.0:1789366606.542217:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751390464 00000100:00100000:2.0:1789366606.542296:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 231 00000100:00100000:2.0:1789366606.542309:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638b4e3e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:14a2847b-91d8-4d87-b71b-010443acc91a+13:2356:x1876286751390464:12345-192.168.202.23@tcp:400:kworker.0 00000100:00100000:2.0:1789366606.542417:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638b4e3e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:14a2847b-91d8-4d87-b71b-010443acc91a+13:2356:x1876286751390464:12345-192.168.202.23@tcp:400:kworker.0 Request processed in 111us (407us total) trans 0 rc 0/0 00000100:00100000:2.0:1789366606.542444:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 231 00000100:00100000:1.0:1789366606.543334:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:0.0:1789366606.568393:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751390720 00000100:00100000:0.0:1789366606.568415:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751390720 00000100:00100000:0.0:1789366606.568621:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751390592 00000100:00100000:0.0:1789366606.568626:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751390592 00000100:00080000:1.0:1789366606.568707:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789366606.571182:0:7132:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 65 00000100:00100000:2.0:1789366606.571211:0:7132:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638b6cbc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b9764435-e52f-45ac-a5f9-bab1231105ac+5:2356:x1876286751390720:12345-192.168.202.23@tcp:400:kworker.0 00000100:00100000:2.0:1789366606.571332:0:7132:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638b6cbc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b9764435-e52f-45ac-a5f9-bab1231105ac+5:2356:x1876286751390720:12345-192.168.202.23@tcp:400:kworker.0 Request processed in 136us (29238us total) trans 0 rc 0/0 00000100:00100000:2.0:1789366606.571341:0:7132:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 65 00000100:00100000:2.0:1789366606.571378:0:7132:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 66 00000100:00100000:2.0:1789366606.571388:0:7132:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638b6cbd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0ab23baa-a205-44ad-bf17-f7b47295d82b+6:2356:x1876286751390592:12345-192.168.202.23@tcp:400:kworker.0 00000100:00100000:2.0:1789366606.571414:0:7132:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638b6cbd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0ab23baa-a205-44ad-bf17-f7b47295d82b+6:2356:x1876286751390592:12345-192.168.202.23@tcp:400:kworker.0 Request processed in 29us (28085us total) trans 0 rc 0/0 00000100:00100000:2.0:1789366606.571420:0:7132:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 66 00000100:00100000:3.0:1789366606.776011:0:3286:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9638bf5ab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3286:1876286758759296:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789366606.776112:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789366606.776297:0:7134:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286758759296 00000100:00100000:0.0:1789366606.776312:0:7134:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286758759296 00000100:00100000:0.0:1789366606.776395:0:7134:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1789366606.776406:0:7134:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963883308000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3286:x1876286758759296:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789366606.776450:0:7134:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00080000:1.0:1789366606.776539:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789366606.779170:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9638c1e6c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3284:1876286758759552:0@lo:400:kworker.0 00000100:00100000:2.0:1789366606.779187:0:3287:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9638c1e6c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8cde4528-5832-4854-a387-4adacc3dd0ab:3287:1876286758759424:0@lo:400:kworker.0 00000100:00100000:2.0:1789366606.788847:0:3287:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789366606.788973:0:7134:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963883308000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3286:x1876286758759296:12345-0@lo:13:osp-pre-1-0.0 Request processed in 12565us (12857us total) trans 0 rc 0/0 00000100:00100000:0.0:1789366606.789002:0:7134:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1789366606.789098:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9638c1e6ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3285:1876286758759680:0@lo:400:kworker.0 00000100:00100000:0.0:1789366606.789173:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789366606.789300:0:3287:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9638c1e6f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3287:1876286758759936:0@lo:400:kworker.0 00000100:00100000:2.0:1789366606.789333:0:3287:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789366606.789356:0:3287:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789366606.789363:0:3287:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9638c1e6ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3287:1876286758759808:0@lo:400:kworker.0 00000100:00100000:2.0:1789366606.789392:0:3287:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789366606.789425:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286758759808 00000100:00100000:2.0:1789366606.789434:0:6659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286758759808 00000100:00100000:2.0:1789366606.789506:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1789366606.789517:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638af2d4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3287:x1876286758759808:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789366606.789587:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638af2d4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3287:x1876286758759808:12345-0@lo:400:kworker.0 Request processed in 72us (194us total) trans 0 rc 0/0 00000100:00100000:2.0:1789366606.789614:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00080000:2.0:1789366606.789658:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1789366606.789698:0:3287:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9638c1e6ca80 x1876286758759808/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789366622 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789366606.789736:0:3287:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9638c1e6ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3287:1876286758759808:0@lo:400:kworker.0 00000100:00100000:2.0:1789366606.789787:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286758759680 00000100:00100000:2.0:1789366606.789792:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286758759680 00000100:00100000:2.0:1789366606.789826:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286758759936 00000100:00100000:2.0:1789366606.789830:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286758759936 00000100:00100000:2.0:1789366606.789851:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1789366606.789857:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638b70cf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3285:x1876286758759680:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789366606.789899:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638b70cf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3285:x1876286758759680:12345-0@lo:400:kworker.0 Request processed in 42us (726us total) trans 0 rc 0/0 00000100:00100000:2.0:1789366606.789905:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1789366606.789917:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1789366606.789923:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638af2d4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3287:x1876286758759936:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789366606.789952:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638af2d4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3287:x1876286758759936:12345-0@lo:400:kworker.0 Request processed in 29us (618us total) trans 0 rc 0/0 00000100:00100000:2.0:1789366606.789959:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1789366606.789986:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9638c1e6ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3285:1876286758759680:0@lo:400:kworker.0 00000100:00080000:2.0:1789366606.790012:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789366606.790032:0:3287:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9638c1e6f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3287:1876286758759936:0@lo:400:kworker.0 00010000:00080000:3.0:1789366606.791472:0:3286:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9638bf5ab480 x1876286758759296/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789366622 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789366606.791501:0:3286:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9638bf5ab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3286:1876286758759296:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789366606.795494:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789366606.798830:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286758759424 00000100:00100000:0.0:1789366606.798853:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286758759424 00000100:00100000:0.0:1789366606.798947:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 232 00000100:00100000:0.0:1789366606.798960:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638b4e3e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8cde4528-5832-4854-a387-4adacc3dd0ab+19:3287:x1876286758759424:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789366606.799112:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638b4e3e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8cde4528-5832-4854-a387-4adacc3dd0ab+19:3287:x1876286758759424:12345-0@lo:400:kworker.0 Request processed in 154us (10278us total) trans 0 rc 0/0 00000100:00100000:0.0:1789366606.799121:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 232 00000100:00100000:3.0:1789366606.799173:0:3287:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9638c1e6c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8cde4528-5832-4854-a387-4adacc3dd0ab:3287:1876286758759424:0@lo:400:kworker.0 00000100:00100000:3.0:1789366606.799227:0:7132:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286758759552 00000100:00100000:3.0:1789366606.799232:0:7132:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286758759552 00000100:00100000:3.0:1789366606.799709:0:7132:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1789366606.799740:0:7132:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638bf5ab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3284:x1876286758759552:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789366606.800183:0:7132:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638bf5ab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3284:x1876286758759552:12345-0@lo:400:kworker.0 Request processed in 466us (4703us total) trans 0 rc 0/0 00000100:00100000:3.0:1789366606.800191:0:7132:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1789366606.800841:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9638c1e6c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3284:1876286758759552:0@lo:400:kworker.0 00010000:00010000:0.0:1789366606.905090:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789366607.927945:0:5805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789366608.954658:0:6675:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789366609.341115:0:3285:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789366609.341148:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff963883308700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3285:1876286758760064:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789366609.341250:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789366609.345776:0:6662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286758760064 00000100:00100000:1.0:1789366609.345799:0:6662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286758760064 00000100:00100000:1.0:1789366609.345888:0:6662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1789366609.345902:0:6662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96388330ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1876286758760064:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789366609.345957:0:6662:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00080000:2.0:1789366609.346030:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789366609.346076:0:6662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96388330ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1876286758760064:12345-0@lo:13:osp-pre-0-0.0 Request processed in 177us (4825us total) trans 0 rc 0/0 00000100:00100000:1.0:1789366609.346085:0:6662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00010000:00080000:3.0:1789366609.346211:0:3285:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff963883308700 x1876286758760064/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789366625 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789366609.346239:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff963883308700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3285:1876286758760064:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1789366609.980291:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789366611.000487:0:5805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1789366611.496779:0:11433:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: finish setup 02:16:49 (1789366609) === 00000100:00100000:2.0:1789366611.677301:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:2.0:1789366611.677375:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:2.0:1789366611.677410:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:2.0:1789366611.677452:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751390976 00000100:00100000:2.0:1789366611.677464:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751390976 00000100:00100000:2.0:1789366611.677533:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751391104 00000100:00100000:2.0:1789366611.677536:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751391104 00000100:00100000:2.0:1789366611.677560:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 70 00000100:00100000:2.0:1789366611.677571:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638af2d6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0ab23baa-a205-44ad-bf17-f7b47295d82b+6:2355:x1876286751390976:12345-192.168.202.23@tcp:400:kworker.0 00000100:00100000:2.0:1789366611.677682:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638af2d6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0ab23baa-a205-44ad-bf17-f7b47295d82b+6:2355:x1876286751390976:12345-192.168.202.23@tcp:400:kworker.0 Request processed in 112us (396us total) trans 0 rc 0/0 00000100:00100000:2.0:1789366611.677691:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 70 00000100:00100000:2.0:1789366611.677711:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 71 00000100:00100000:2.0:1789366611.677737:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638c1e6c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b9764435-e52f-45ac-a5f9-bab1231105ac+5:2355:x1876286751391104:12345-192.168.202.23@tcp:400:kworker.0 00000100:00100000:2.0:1789366611.677762:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638c1e6c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b9764435-e52f-45ac-a5f9-bab1231105ac+5:2355:x1876286751391104:12345-192.168.202.23@tcp:400:kworker.0 Request processed in 45us (352us total) trans 0 rc 0/0 00000100:00100000:2.0:1789366611.677769:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 71 00000100:00080000:2.0:1789366611.677787:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789366611.678099:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751390848 00000100:00100000:0.0:1789366611.678105:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751390848 00000100:00100000:0.0:1789366611.678140:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 233 00000100:00100000:0.0:1789366611.678147:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638b4e3e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:14a2847b-91d8-4d87-b71b-010443acc91a+13:2355:x1876286751390848:12345-192.168.202.23@tcp:400:kworker.0 00000100:00100000:0.0:1789366611.678189:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638b4e3e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:14a2847b-91d8-4d87-b71b-010443acc91a+13:2355:x1876286751390848:12345-192.168.202.23@tcp:400:kworker.0 Request processed in 43us (814us total) trans 0 rc 0/0 00000100:00100000:0.0:1789366611.678197:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 233 00000100:00100000:1.0:1789366611.896955:0:3284:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789366611.896985:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9638b73cf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3284:1876286758760192:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789366611.897080:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789366611.897178:0:7134:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286758760192 00000100:00100000:1.0:1789366611.897195:0:7134:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286758760192 00000100:00100000:1.0:1789366611.897267:0:7134:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1789366611.897277:0:7134:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638b73cf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1876286758760192:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789366611.897341:0:7134:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789366611.897394:0:7134:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638b73cf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1876286758760192:12345-0@lo:13:osp-pre-1-0.0 Request processed in 117us (314us total) trans 0 rc 0/0 00000100:00100000:1.0:1789366611.897401:0:7134:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00080000:1.0:1789366611.897426:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1789366611.897461:0:3284:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9638b73cf100 x1876286758760192/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789366627 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789366611.897485:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9638b73cf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3284:1876286758760192:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789366611.907447:0:3286:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9638b70cea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8cde4528-5832-4854-a387-4adacc3dd0ab:3286:1876286758760320:0@lo:400:kworker.0 00000100:00100000:0.0:1789366611.907542:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789366611.907604:0:3286:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9638b70cfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3286:1876286758760832:0@lo:400:kworker.0 00000100:00100000:0.0:1789366611.907635:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789366611.907666:0:3286:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789366611.907672:0:3286:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9638b70cf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3286:1876286758760448:0@lo:400:kworker.0 00000100:00100000:0.0:1789366611.907694:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789366611.907745:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9638b70cdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3285:1876286758760704:0@lo:400:kworker.0 00000100:00100000:0.0:1789366611.907773:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789366611.907792:0:3285:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789366611.907798:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9638b70cc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3285:1876286758760576:0@lo:400:kworker.0 00000100:00100000:0.0:1789366611.907816:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789366611.907844:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286758760320 00000100:00100000:0.0:1789366611.907853:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286758760320 00000100:00100000:0.0:1789366611.907906:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 234 00000100:00100000:0.0:1789366611.907915:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638b4e3f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8cde4528-5832-4854-a387-4adacc3dd0ab+19:3286:x1876286758760320:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789366611.907978:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638b4e3f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8cde4528-5832-4854-a387-4adacc3dd0ab+19:3286:x1876286758760320:12345-0@lo:400:kworker.0 Request processed in 64us (438us total) trans 0 rc 0/0 00000100:00100000:0.0:1789366611.907987:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 234 00000100:00100000:0.0:1789366611.908022:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286758760832 00000100:00100000:0.0:1789366611.908025:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286758760832 00000100:00100000:0.0:1789366611.908061:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286758760448 00000100:00100000:0.0:1789366611.908484:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286758760448 00000100:00100000:0.0:1789366611.908512:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286758760576 00000100:00100000:0.0:1789366611.908515:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286758760576 00000100:00100000:0.0:1789366611.908532:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1789366611.908539:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638b70cd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3286:x1876286758760832:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789366611.908579:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638b70cd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3286:x1876286758760832:12345-0@lo:400:kworker.0 Request processed in 41us (943us total) trans 0 rc 0/0 00000100:00100000:0.0:1789366611.908586:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1789366611.908610:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1789366611.908617:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638b70cc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3286:x1876286758760448:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789366611.908641:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638b70cc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3286:x1876286758760448:12345-0@lo:400:kworker.0 Request processed in 26us (946us total) trans 0 rc 0/0 00000100:00100000:0.0:1789366611.908647:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1789366611.908656:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1789366611.908661:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638b70cca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3285:x1876286758760576:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789366611.908688:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638b70cca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3285:x1876286758760576:12345-0@lo:400:kworker.0 Request processed in 27us (871us total) trans 0 rc 0/0 00000100:00100000:0.0:1789366611.908694:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1789366611.908740:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286758760704 00000100:00100000:0.0:1789366611.908744:0:6661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286758760704 00000100:00100000:0.0:1789366611.908773:0:6661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1789366611.908780:0:6661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638b70ced80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3285:x1876286758760704:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789366611.908808:0:6661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638b70ced80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3285:x1876286758760704:12345-0@lo:400:kworker.0 Request processed in 29us (1035us total) trans 0 rc 0/0 00000100:00100000:0.0:1789366611.908814:0:6661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1789366611.908867:0:3286:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9638b70cf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3286:1876286758760448:0@lo:400:kworker.0 00000100:00100000:0.0:1789366611.908892:0:3286:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9638b70cea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8cde4528-5832-4854-a387-4adacc3dd0ab:3286:1876286758760320:0@lo:400:kworker.0 00000100:00100000:0.0:1789366611.908903:0:3286:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9638b70cfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3286:1876286758760832:0@lo:400:kworker.0 00000100:00100000:0.0:1789366611.913688:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9638b70cc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3285:1876286758760576:0@lo:400:kworker.0 00010000:00080000:0.0:1789366611.913737:0:3285:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9638b70cdf80 x1876286758760704/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789366627 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789366611.913751:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9638b70cdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3285:1876286758760704:0@lo:400:kworker.0 00000100:00080000:0.0:1789366611.913800:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789366611.913808:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789366611.931795:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:0.0:1789366611.932233:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751391232 00000100:00100000:0.0:1789366611.932247:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751391232 00000100:00100000:0.0:1789366611.932322:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 14 00000100:00100000:0.0:1789366611.932335:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638c1e6c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0ab23baa-a205-44ad-bf17-f7b47295d82b+6:2357:x1876286751391232:12345-192.168.202.23@tcp:41:mkdir.0 00000004:00000024:0.0:1789366611.932390:0:5816:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:0.0:1789366611.932501:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638c1e6c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0ab23baa-a205-44ad-bf17-f7b47295d82b+6:2357:x1876286751391232:12345-192.168.202.23@tcp:41:mkdir.0 Request processed in 168us (800us total) trans 0 rc 0/0 00000100:00100000:0.0:1789366611.932510:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 14 00000100:00100000:0.0:1789366611.935002:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:2.0:1789366611.935117:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751391360 00000100:00100000:2.0:1789366611.935130:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751391360 00000100:00100000:2.0:1789366611.935189:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 0 00000100:00100000:2.0:1789366611.935199:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638b70cdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:0ab23baa-a205-44ad-bf17-f7b47295d82b+6:9673:x1876286751391360:12345-192.168.202.23@tcp:700:mkdir.0 00000100:00100000:2.0:1789366611.935292:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638b70cdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:0ab23baa-a205-44ad-bf17-f7b47295d82b+6:9673:x1876286751391360:12345-192.168.202.23@tcp:700:mkdir.0 Request processed in 95us (303us total) trans 0 rc 0/0 00000100:00100000:2.0:1789366611.935301:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 0 00000100:00100000:0.0:1789366611.938791:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:2.0:1789366611.939431:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751391616 00000100:00100000:2.0:1789366611.939451:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751391616 00000100:00100000:2.0:1789366611.939524:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 15 00000100:00100000:2.0:1789366611.939536:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638b70cc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0ab23baa-a205-44ad-bf17-f7b47295d82b+6:9673:x1876286751391616:12345-192.168.202.23@tcp:36:mkdir.0 00010000:00010000:2.0:1789366611.939630:0:5817:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789366611.940280:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96388148e000/0x8da3486b955f3053 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.23@tcp remote: 0xda917a494d06becb expref: 6 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366611.940329:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff963887f88700) 00010000:00010000:2.0:1789366611.940350:0:5817:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789366611.940679:0:5817:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9638a0741000/0x8da3486b955f3172 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366611.940694:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9638a0741000/0x8da3486b955f3172 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366611.940704:0:5817:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9638a0741000/0x8da3486b955f3172 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366611.940744:0:5817:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9638a0740e00/0x8da3486b955f3179 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366611.940753:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9638a0740e00/0x8da3486b955f3179 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366611.940762:0:5817:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9638a0740e00/0x8da3486b955f3179 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789366611.943558:0:5817:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00010000:00010000:3.0:1789366611.944054:0:5817:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9638a0741000/0x8da3486b955f3172 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366611.944070:0:5817:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9638a0741000/0x8da3486b955f3172 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366611.944078:0:5817:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9638a0741000/0x8da3486b955f3172 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366611.944085:0:5817:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9638a0741000 already unused, calling callback (ffffffffc20ee4f0) 00010000:00010000:3.0:1789366611.944090:0:5817:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9638a0741000/0x8da3486b955f3172 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366611.944099:0:5817:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9638a0741000/0x8da3486b955f3172 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366611.944118:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9638a7404700) 00010000:00010000:3.0:1789366611.944121:0:5817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789366611.944126:0:5817:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9638a0741000/0x8da3486b955f3172 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366611.944132:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9638a0741000/0x8da3486b955f3172 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789366611.944158:0:5817:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000802e4659 reply state 000000005604b2ff transno 4294967297 ns: mdt-lustre-MDT0000_UUID lock: ffff9638a0740e00/0x8da3486b955f3179 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789366611.944167:0:5817:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789366611.944466:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638b70cc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0ab23baa-a205-44ad-bf17-f7b47295d82b+7:9673:x1876286751391616:12345-192.168.202.23@tcp:36:mkdir.0 Request processed in 4928us (5682us total) trans 4294967297 rc 0/0 00000100:00100000:3.0:1789366611.944475:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 15 00010000:00010000:3.0:1789366611.959808:0:3270:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9638a0740e00/0x8da3486b955f3179 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366611.959837:0:3270:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9638a0740e00/0x8da3486b955f3179 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366611.959847:0:3270:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9638a0740e00/0x8da3486b955f3179 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366611.959854:0:3270:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9638a0740e00 already unused, calling callback (ffffffffc20ee4f0) 00010000:00010000:3.0:1789366611.959859:0:3270:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9638a0740e00/0x8da3486b955f3179 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366611.959868:0:3270:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9638a0740e00/0x8da3486b955f3179 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366611.959884:0:3270:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff9638a7404d00) 00010000:00010000:3.0:1789366611.959887:0:3270:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789366611.959892:0:3270:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9638a0740e00/0x8da3486b955f3179 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366611.959899:0:3270:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9638a0740e00/0x8da3486b955f3179 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789366611.967863:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:3.0:1789366611.968052:0:7614:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751391744 00000100:00100000:3.0:1789366611.968069:0:7614:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751391744 00000100:00100000:3.0:1789366611.968171:0:7614:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 16 00000100:00100000:3.0:1789366611.968185:0:7614:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638c1e6f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0ab23baa-a205-44ad-bf17-f7b47295d82b+6:9674:x1876286751391744:12345-192.168.202.23@tcp:101:chmod.0 00010000:00010000:3.0:1789366611.968237:0:7614:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789366611.968276:0:7614:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9638832d3400/0x8da3486b955f3180 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xda917a494d06bf50 expref: -99 pid: 7614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366611.968435:0:7614:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9638832d3600/0x8da3486b955f3187 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7614 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366611.968462:0:7614:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9638832d3600/0x8da3486b955f3187 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7614 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366611.968477:0:7614:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9638832d3600/0x8da3486b955f3187 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7614 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789366611.968542:0:7614:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1789366611.968547:0:7614:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1789366611.968610:0:7614:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9638832d3600/0x8da3486b955f3187 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7614 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366611.968651:0:7614:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9638832d3400/0x8da3486b955f3180 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.23@tcp remote: 0xda917a494d06bf50 expref: 8 pid: 7614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366611.968677:0:7614:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9638832d3600/0x8da3486b955f3187 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.23@tcp remote: 0xda917a494d06bf50 expref: 7 pid: 7614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366611.968688:0:7614:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff96388c43f700) 00010000:00010000:3.0:1789366611.968692:0:7614:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789366611.968697:0:7614:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9638832d3600, rc 0) 00000100:00100000:3.0:1789366611.968814:0:7614:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638c1e6f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0ab23baa-a205-44ad-bf17-f7b47295d82b+7:9674:x1876286751391744:12345-192.168.202.23@tcp:101:chmod.0 Request processed in 633us (963us total) trans 0 rc 0/0 00000100:00100000:3.0:1789366611.968822:0:7614:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 16 00000100:00100000:2.0:1789366611.987383:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:0.0:1789366611.987478:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751392000 00000100:00100000:0.0:1789366611.987495:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751392000 00000100:00100000:0.0:1789366611.987602:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 17 00000100:00100000:0.0:1789366611.987626:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638c1e6ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0ab23baa-a205-44ad-bf17-f7b47295d82b+7:9674:x1876286751392000:12345-192.168.202.23@tcp:36:chmod.0 00010000:00010000:0.0:1789366611.987701:0:5815:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789366611.987797:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9638832d3600/0x8da3486b955f3187 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.23@tcp remote: 0xda917a494d06bf50 expref: 7 pid: 7614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366611.987838:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff96388c43f700) 00010000:00010000:0.0:1789366611.987856:0:5815:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789366611.987887:0:5815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720ce00/0x8da3486b955f318e lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366611.987901:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720ce00/0x8da3486b955f318e lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366611.987912:0:5815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720ce00/0x8da3486b955f318e lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789366611.989293:0:5815:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000009dbb0334 reply state 000000000325e8a7 transno 4294967298 ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720ce00/0x8da3486b955f318e lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789366611.989307:0:5815:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:1.0:1789366611.989319:0:5815:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000100:00100000:1.0:1789366611.989455:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638c1e6ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0ab23baa-a205-44ad-bf17-f7b47295d82b+8:9674:x1876286751392000:12345-192.168.202.23@tcp:36:chmod.0 Request processed in 1839us (2076us total) trans 4294967298 rc 0/0 00000100:00100000:1.0:1789366611.989465:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 17 00010000:00010000:3.0:1789366611.998549:0:3271:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720ce00/0x8da3486b955f318e lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366611.998629:0:3271:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720ce00/0x8da3486b955f318e lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366611.998650:0:3271:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720ce00/0x8da3486b955f318e lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366611.998657:0:3271:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9638b720ce00 already unused, calling callback (ffffffffc20ee4f0) 00010000:00010000:3.0:1789366611.998662:0:3271:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720ce00/0x8da3486b955f318e lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366611.998701:0:3271:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720ce00/0x8da3486b955f318e lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366611.999038:0:3271:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff963890797800) 00010000:00010000:3.0:1789366611.999042:0:3271:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1789366611.999048:0:3271:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720ce00/0x8da3486b955f318e lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366611.999055:0:3271:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720ce00/0x8da3486b955f318e lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366612.027282:0:6675:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789366612.078026:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:1.0:1789366612.080645:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751392128 00000100:00100000:1.0:1789366612.080667:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751392128 00000100:00100000:1.0:1789366612.080782:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 18 00000100:00100000:1.0:1789366612.080798:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963883308700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0ab23baa-a205-44ad-bf17-f7b47295d82b+7:9675:x1876286751392128:12345-192.168.202.23@tcp:101:chown.0 00010000:00010000:1.0:1789366612.080834:0:5817:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789366612.080866:0:5817:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96388148f800/0x8da3486b955f3195 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xda917a494d06bf57 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366612.080993:0:5817:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96388148fc00/0x8da3486b955f319c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366612.081012:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96388148fc00/0x8da3486b955f319c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366612.081027:0:5817:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96388148fc00/0x8da3486b955f319c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789366612.081086:0:5817:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:1.0:1789366612.081091:0:5817:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1789366612.081138:0:5817:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff96388148fc00/0x8da3486b955f319c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366612.081170:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96388148f800/0x8da3486b955f3195 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.23@tcp remote: 0xda917a494d06bf57 expref: 9 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366612.081191:0:5817:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96388148fc00/0x8da3486b955f319c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.23@tcp remote: 0xda917a494d06bf57 expref: 8 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366612.081201:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff963887f88000) 00010000:00010000:1.0:1789366612.081204:0:5817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789366612.081209:0:5817:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96388148fc00, rc 0) 00000100:00100000:1.0:1789366612.081302:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963883308700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0ab23baa-a205-44ad-bf17-f7b47295d82b+8:9675:x1876286751392128:12345-192.168.202.23@tcp:101:chown.0 Request processed in 509us (3290us total) trans 0 rc 0/0 00000100:00100000:1.0:1789366612.081324:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 18 00000100:00100000:1.0:1789366612.088186:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:3.0:1789366612.088269:0:7614:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751392256 00000100:00100000:3.0:1789366612.088286:0:7614:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751392256 00000100:00100000:3.0:1789366612.088350:0:7614:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 19 00000100:00100000:3.0:1789366612.088362:0:7614:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638b73cf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0ab23baa-a205-44ad-bf17-f7b47295d82b+8:9675:x1876286751392256:12345-192.168.202.23@tcp:101:chown.0 00010000:00010000:3.0:1789366612.088383:0:7614:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789366612.088404:0:7614:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9638832d3400/0x8da3486b955f31a3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xda917a494d06bf5e expref: -99 pid: 7614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366612.088488:0:7614:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9638832d3e00/0x8da3486b955f31aa lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7614 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366612.088505:0:7614:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9638832d3e00/0x8da3486b955f31aa lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7614 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366612.088517:0:7614:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9638832d3e00/0x8da3486b955f31aa lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7614 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366612.088535:0:7614:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9638832d2200/0x8da3486b955f31b1 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7614 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366612.088542:0:7614:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9638832d2200/0x8da3486b955f31b1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7614 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366612.088550:0:7614:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9638832d2200/0x8da3486b955f31b1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7614 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366612.088663:0:7614:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9638832d2000/0x8da3486b955f31b8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7614 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366612.088672:0:7614:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9638832d2000/0x8da3486b955f31b8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7614 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366612.088679:0:7614:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9638832d2000/0x8da3486b955f31b8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7614 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789366612.088708:0:7614:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1789366612.088712:0:7614:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1789366612.088763:0:7614:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9638832d2000/0x8da3486b955f31b8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7614 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366612.088787:0:7614:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9638832d3e00/0x8da3486b955f31aa lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7614 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366612.088794:0:7614:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9638832d3e00/0x8da3486b955f31aa lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7614 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366612.088801:0:7614:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9638832d3e00/0x8da3486b955f31aa lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7614 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366612.088808:0:7614:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9638832d3e00 already unused, calling callback (ffffffffc20ee4f0) 00010000:00010000:3.0:1789366612.088814:0:7614:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9638832d3e00/0x8da3486b955f31aa lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7614 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366612.088823:0:7614:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9638832d3e00/0x8da3486b955f31aa lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7614 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366612.088838:0:7614:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff963887f88000) 00010000:00010000:3.0:1789366612.088842:0:7614:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789366612.088846:0:7614:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9638832d3e00/0x8da3486b955f31aa lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7614 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366612.088853:0:7614:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9638832d3e00/0x8da3486b955f31aa lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7614 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366612.088865:0:7614:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9638832d2200/0x8da3486b955f31b1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7614 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366612.088871:0:7614:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9638832d2200/0x8da3486b955f31b1 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7614 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366612.088875:0:7614:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9638832d2200/0x8da3486b955f31b1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7614 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366612.088886:0:7614:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9638832d2200 already unused, calling callback (ffffffffc20ee4f0) 00010000:00010000:3.0:1789366612.088889:0:7614:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9638832d2200/0x8da3486b955f31b1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7614 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366612.088895:0:7614:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9638832d2200/0x8da3486b955f31b1 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7614 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366612.088902:0:7614:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff96388c43f500) 00010000:00010000:3.0:1789366612.088904:0:7614:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789366612.088907:0:7614:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9638832d2200/0x8da3486b955f31b1 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7614 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366612.088912:0:7614:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9638832d2200/0x8da3486b955f31b1 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7614 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366612.088943:0:7614:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9638832d3400/0x8da3486b955f31a3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.23@tcp remote: 0xda917a494d06bf5e expref: 10 pid: 7614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366612.088957:0:7614:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9638832d2000/0x8da3486b955f31b8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.23@tcp remote: 0xda917a494d06bf5e expref: 9 pid: 7614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366612.088963:0:7614:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff96388c43f000) 00010000:00010000:3.0:1789366612.088965:0:7614:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789366612.088967:0:7614:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9638832d2000, rc 0) 00000100:00100000:3.0:1789366612.089037:0:7614:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638b73cf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0ab23baa-a205-44ad-bf17-f7b47295d82b+9:9675:x1876286751392256:12345-192.168.202.23@tcp:101:chown.0 Request processed in 678us (867us total) trans 0 rc 0/0 00000100:00100000:3.0:1789366612.089045:0:7614:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 19 00000100:00100000:2.0:1789366612.093850:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:2.0:1789366612.093903:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751392512 00000100:00100000:2.0:1789366612.093912:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751392512 00000100:00100000:2.0:1789366612.093965:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 20 00000100:00100000:2.0:1789366612.093974:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638c1e6ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0ab23baa-a205-44ad-bf17-f7b47295d82b+9:9675:x1876286751392512:12345-192.168.202.23@tcp:36:chown.0 00010000:00010000:2.0:1789366612.094027:0:5815:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789366612.094053:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9638832d2000/0x8da3486b955f31b8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.23@tcp remote: 0xda917a494d06bf5e expref: 9 pid: 7614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366612.094073:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff96388c43f000) 00010000:00010000:2.0:1789366612.094085:0:5815:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789366612.094110:0:5815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9638a0740600/0x8da3486b955f31bf lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366612.094124:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9638a0740600/0x8da3486b955f31bf lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366612.094133:0:5815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9638a0740600/0x8da3486b955f31bf lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789366612.228025:0:5837:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967298 is committed 00000001:00080000:0.0:1789366612.228056:0:5837:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967299 is committed 00000004:00010000:2.0:1789366612.228180:0:5815:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000d1ace5bc reply state 0000000076b7b552 transno 4294967299 ns: mdt-lustre-MDT0000_UUID lock: ffff9638a0740600/0x8da3486b955f31bf lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789366612.228199:0:5815:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1789366612.228223:0:5815:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00010000:00080000:2.0:1789366612.228385:0:5815:0:(ldlm_lib.c:3482:target_send_reply()) Schedule reply immediately 00000100:00100000:2.0:1789366612.228416:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638c1e6ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0ab23baa-a205-44ad-bf17-f7b47295d82b+7:9675:x1876286751392512:12345-192.168.202.23@tcp:36:chown.0 Request processed in 134435us (134569us total) trans 4294967299 rc 0/0 00000100:00100000:2.0:1789366612.228428:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 20 00010000:00010000:2.0:1789366612.228477:0:3270:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9638a0740600/0x8da3486b955f31bf lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366612.228510:0:3270:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9638a0740600/0x8da3486b955f31bf lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366612.228519:0:3270:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9638a0740600/0x8da3486b955f31bf lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366612.228525:0:3270:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9638a0740600 already unused, calling callback (ffffffffc20ee4f0) 00010000:00010000:2.0:1789366612.228532:0:3270:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9638a0740600/0x8da3486b955f31bf lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366612.228541:0:3270:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9638a0740600/0x8da3486b955f31bf lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366612.228558:0:3270:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9638a7404c00) 00010000:00010000:2.0:1789366612.228562:0:3270:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1789366612.228567:0:3270:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9638a0740600/0x8da3486b955f31bf lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366612.228574:0:3270:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9638a0740600/0x8da3486b955f31bf lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789366612.344272:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:0.0:1789366612.345292:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751392640 00000100:00100000:0.0:1789366612.345319:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751392640 00000100:00100000:0.0:1789366612.345400:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 21 00000100:00100000:0.0:1789366612.345413:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638b702ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0ab23baa-a205-44ad-bf17-f7b47295d82b+6:9676:x1876286751392640:12345-192.168.202.23@tcp:101:touch.500 00010000:00010000:0.0:1789366612.345446:0:5816:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789366612.345472:0:5816:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720c000/0x8da3486b955f31c6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xda917a494d06bf65 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1789366612.347607:0:5816:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 500, time 2072us 00010000:00010000:1.0:1789366612.419608:0:5816:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96388148f800/0x8da3486b955f31cd lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366612.419658:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96388148f800/0x8da3486b955f31cd lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366612.419674:0:5816:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96388148f800/0x8da3486b955f31cd lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366612.419701:0:5816:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96388148ea00/0x8da3486b955f31d4 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366612.419708:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96388148ea00/0x8da3486b955f31d4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366612.419737:0:5816:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96388148ea00/0x8da3486b955f31d4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366612.420192:0:5816:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96388148f000/0x8da3486b955f31db lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366612.420202:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96388148f000/0x8da3486b955f31db lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366612.420212:0:5816:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96388148f000/0x8da3486b955f31db lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789366612.420241:0:5816:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00000004:00200000:1.0:1789366612.420245:0:5816:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1789366612.420297:0:5816:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff96388148f000/0x8da3486b955f31db lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366612.420312:0:5816:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96388148f800/0x8da3486b955f31cd lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366612.420341:0:5816:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96388148f800/0x8da3486b955f31cd lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366612.420348:0:5816:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96388148f800/0x8da3486b955f31cd lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366612.420355:0:5816:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96388148f800 already unused, calling callback (ffffffffc20ee4f0) 00010000:00010000:1.0:1789366612.420360:0:5816:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96388148f800/0x8da3486b955f31cd lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366612.420369:0:5816:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96388148f800/0x8da3486b955f31cd lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366612.420385:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff963887f88000) 00010000:00010000:1.0:1789366612.420389:0:5816:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789366612.420395:0:5816:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96388148f800/0x8da3486b955f31cd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366612.420402:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96388148f800/0x8da3486b955f31cd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366612.420415:0:5816:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96388148ea00/0x8da3486b955f31d4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366612.420420:0:5816:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96388148ea00/0x8da3486b955f31d4 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366612.420426:0:5816:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96388148ea00/0x8da3486b955f31d4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366612.420431:0:5816:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96388148ea00 already unused, calling callback (ffffffffc20ee4f0) 00010000:00010000:1.0:1789366612.420439:0:5816:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96388148ea00/0x8da3486b955f31d4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366612.420446:0:5816:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96388148ea00/0x8da3486b955f31d4 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366612.420454:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff963887f88900) 00010000:00010000:1.0:1789366612.420457:0:5816:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789366612.420460:0:5816:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96388148ea00/0x8da3486b955f31d4 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366612.420467:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96388148ea00/0x8da3486b955f31d4 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366612.420518:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720c000/0x8da3486b955f31c6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.23@tcp remote: 0xda917a494d06bf65 expref: 8 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366612.420536:0:5816:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96388148f000/0x8da3486b955f31db lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.23@tcp remote: 0xda917a494d06bf65 expref: 7 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366612.420544:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff963887f88d00) 00010000:00010000:1.0:1789366612.420547:0:5816:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1789366612.420550:0:5816:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96388148f000, rc 0) 00000100:00100000:1.0:1789366612.420655:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638b702ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0ab23baa-a205-44ad-bf17-f7b47295d82b+7:9676:x1876286751392640:12345-192.168.202.23@tcp:101:touch.500 Request processed in 75243us (76396us total) trans 0 rc 0/0 00000100:00100000:1.0:1789366612.420666:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 21 00000100:00100000:2.0:1789366612.427834:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:2.0:1789366612.427889:0:7614:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751392896 00000100:00100000:2.0:1789366612.427903:0:7614:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751392896 00000100:00100000:2.0:1789366612.427987:0:7614:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 22 00000100:00100000:2.0:1789366612.427999:0:7614:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638b702e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0ab23baa-a205-44ad-bf17-f7b47295d82b+7:9676:x1876286751392896:12345-192.168.202.23@tcp:101:touch.500 00010000:00010000:2.0:1789366612.428027:0:7614:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789366612.428058:0:7614:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9638a0740600/0x8da3486b955f31e2 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xda917a494d06bf6c expref: -99 pid: 7614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366612.428422:0:7614:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9638a0740a00/0x8da3486b955f31e9 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7614 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366612.428440:0:7614:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9638a0740a00/0x8da3486b955f31e9 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7614 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366612.428452:0:7614:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9638a0740a00/0x8da3486b955f31e9 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7614 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366612.432882:0:7614:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9638a0741000/0x8da3486b955f31f0 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0x369fa11a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7614 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366612.432908:0:7614:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9638a0741000/0x8da3486b955f31f0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x369fa11a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7614 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366612.432924:0:7614:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9638a0741000/0x8da3486b955f31f0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x369fa11a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7614 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1789366612.434086:0:7614:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x2:0x0], index 0: 0 00010000:00010000:2.0:1789366612.434358:0:7614:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9638a0740e00/0x8da3486b955f31f7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7614 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366612.434369:0:7614:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9638a0740e00/0x8da3486b955f31f7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7614 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366612.434377:0:7614:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9638a0740e00/0x8da3486b955f31f7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7614 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366612.434414:0:7614:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9638a0740a00/0x8da3486b955f31e9 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7614 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366612.434430:0:7614:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9638a0740a00/0x8da3486b955f31e9 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7614 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366612.435712:0:7614:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9638a0740a00/0x8da3486b955f31e9 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7614 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366612.435738:0:7614:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9638a0740a00 already unused, calling callback (ffffffffc20ee4f0) 00010000:00010000:2.0:1789366612.435745:0:7614:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9638a0740a00/0x8da3486b955f31e9 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7614 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366612.435754:0:7614:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9638a0740a00/0x8da3486b955f31e9 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7614 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366612.435773:0:7614:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff963887f88d00) 00010000:00010000:2.0:1789366612.435776:0:7614:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789366612.435781:0:7614:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9638a0740a00/0x8da3486b955f31e9 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7614 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366612.435788:0:7614:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9638a0740a00/0x8da3486b955f31e9 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7614 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789366612.435807:0:7614:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000fb49e1c9 reply state 000000005db35200 transno 4294967300 ns: mdt-lustre-MDT0000_UUID lock: ffff9638a0741000/0x8da3486b955f31f0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x369fa11a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7614 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789366612.435817:0:7614:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1789366612.435882:0:7614:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9638a0740600/0x8da3486b955f31e2 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.23@tcp remote: 0xda917a494d06bf6c expref: 10 pid: 7614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366612.435898:0:7614:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9638a0740e00/0x8da3486b955f31f7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.23@tcp remote: 0xda917a494d06bf6c expref: 9 pid: 7614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366612.435923:0:7614:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9638a7404e00) 00010000:00010000:2.0:1789366612.435925:0:7614:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789366612.435928:0:7614:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9638a0740e00, rc 0) 00000100:00100000:2.0:1789366612.436021:0:7614:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638b702e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0ab23baa-a205-44ad-bf17-f7b47295d82b+10:9676:x1876286751392896:12345-192.168.202.23@tcp:101:touch.500 Request processed in 8021us (8198us total) trans 4294967300 rc 0/0 00000100:00100000:2.0:1789366612.436032:0:7614:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 22 00010000:00010000:2.0:1789366612.451321:0:3270:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9638a0741000/0x8da3486b955f31f0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x369fa11a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7614 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366612.451366:0:3270:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9638a0741000/0x8da3486b955f31f0 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x369fa11a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7614 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366612.451376:0:3270:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9638a0741000/0x8da3486b955f31f0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x369fa11a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7614 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366612.451383:0:3270:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9638a0741000 already unused, calling callback (ffffffffc20ee4f0) 00010000:00010000:2.0:1789366612.451399:0:3270:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9638a0741000/0x8da3486b955f31f0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x369fa11a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7614 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366612.451408:0:3270:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9638a0741000/0x8da3486b955f31f0 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x369fa11a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7614 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366612.451444:0:3270:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x369fa11a (ffff9638a7404c00) 00010000:00010000:2.0:1789366612.451448:0:3270:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789366612.451453:0:3270:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9638a0741000/0x8da3486b955f31f0 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x369fa11a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7614 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366612.451461:0:3270:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9638a0741000/0x8da3486b955f31f0 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x369fa11a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7614 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789366612.463991:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:3.0:1789366612.464185:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751393152 00000100:00100000:3.0:1789366612.464204:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751393152 00000100:00100000:3.0:1789366612.464297:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 23 00000100:00100000:3.0:1789366612.464322:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638b702f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0ab23baa-a205-44ad-bf17-f7b47295d82b+9:9676:x1876286751393152:12345-192.168.202.23@tcp:36:touch.500 00010000:00010000:3.0:1789366612.464406:0:5815:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789366612.464442:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9638a0740e00/0x8da3486b955f31f7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.23@tcp remote: 0xda917a494d06bf6c expref: 9 pid: 7614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366612.464468:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9638a7404e00) 00010000:00010000:3.0:1789366612.464482:0:5815:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789366612.464539:0:5815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9638832d3400/0x8da3486b955f3205 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366612.464556:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9638832d3400/0x8da3486b955f3205 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366612.464568:0:5815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9638832d3400/0x8da3486b955f3205 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789366612.464808:0:5815:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000003180dea0 reply state 00000000a71ba4a8 transno 4294967301 ns: mdt-lustre-MDT0000_UUID lock: ffff9638832d3400/0x8da3486b955f3205 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789366612.464821:0:5815:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789366612.465324:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638b702f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0ab23baa-a205-44ad-bf17-f7b47295d82b+10:9676:x1876286751393152:12345-192.168.202.23@tcp:36:touch.500 Request processed in 1003us (1339us total) trans 4294967301 rc 0/0 00000100:00100000:3.0:1789366612.465334:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 23 00000100:00100000:0.0:1789366612.508635:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00010000:00010000:2.0:1789366612.509646:0:3271:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9638832d3400/0x8da3486b955f3205 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366612.509665:0:3271:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9638832d3400/0x8da3486b955f3205 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366612.509674:0:3271:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9638832d3400/0x8da3486b955f3205 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366612.509682:0:3271:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9638832d3400 already unused, calling callback (ffffffffc20ee4f0) 00010000:00010000:2.0:1789366612.509689:0:3271:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9638832d3400/0x8da3486b955f3205 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366612.509701:0:3271:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9638832d3400/0x8da3486b955f3205 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366612.509768:0:3271:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff96388c43f000) 00010000:00010000:2.0:1789366612.509772:0:3271:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789366612.509779:0:3271:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9638832d3400/0x8da3486b955f3205 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366612.509786:0:3271:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9638832d3400/0x8da3486b955f3205 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789366612.510583:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751393280 00000100:00100000:3.0:1789366612.510606:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751393280 00000100:00100000:3.0:1789366612.510688:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 24 00000100:00100000:3.0:1789366612.510701:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638b70cfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0ab23baa-a205-44ad-bf17-f7b47295d82b+9:9676:x1876286751393280:12345-192.168.202.23@tcp:101:touch.500 00010000:00010000:3.0:1789366612.510783:0:5816:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789366612.510810:0:5816:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9638832d2200/0x8da3486b955f320c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xda917a494d06bf73 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366612.510889:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9638832d2200/0x8da3486b955f320c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.23@tcp remote: 0xda917a494d06bf73 expref: 10 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366612.510906:0:5816:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9638832d2200/0x8da3486b955f320c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.23@tcp remote: 0xda917a494d06bf73 expref: 10 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366612.510942:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff96388c43f500) 00010000:00010000:3.0:1789366612.510945:0:5816:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1789366612.510948:0:5816:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9638832d2200, rc 0) 00000100:00100000:3.0:1789366612.511026:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638b70cfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0ab23baa-a205-44ad-bf17-f7b47295d82b+10:9676:x1876286751393280:12345-192.168.202.23@tcp:101:touch.500 Request processed in 328us (2405us total) trans 0 rc 0/0 00000100:00100000:3.0:1789366612.511035:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 24 00000100:00100000:2.0:1789366612.532260:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:3.0:1789366612.532580:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751393408 00000100:00100000:3.0:1789366612.532606:0:6659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751393408 00000100:00100000:3.0:1789366612.532670:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 16 00000100:00100000:3.0:1789366612.532681:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638b702c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2353:x1876286751393408:12345-192.168.202.23@tcp:8:touch.500 00010000:00080000:3.0:1789366612.532769:0:6659:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 0ab23baa-a205-44ad-bf17-f7b47295d82b@192.168.202.23@tcp t0 exp 0000000000000000 cur 187 last 0 00000020:00000080:3.0:1789366612.532816:0:6659:0:(genops.c:1385:class_connect()) connect: client 0ab23baa-a205-44ad-bf17-f7b47295d82b, cookie 0x8da3486b955f3213 00002000:00100000:3.0:1789366612.532831:0:6659:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 0ab23baa-a205-44ad-bf17-f7b47295d82b/ffff9638b730a000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a06 ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1789366612.532861:0:6659:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:3.0:1789366612.533164:0:6659:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1789366612.533206:0:6659:0:(import.c:65:import_set_state_nolock()) ffff9638bf51b800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789366612.533324:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638b702c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0ab23baa-a205-44ad-bf17-f7b47295d82b+6:2353:x1876286751393408:12345-192.168.202.23@tcp:8:touch.500 Request processed in 632us (1067us total) trans 0 rc 0/0 00000100:00100000:3.0:1789366612.533334:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 16 00000100:00100000:0.0:1789366612.539416:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:3.0:1789366612.540111:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751393536 00000100:00100000:3.0:1789366612.540127:0:6661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751393536 00000100:00100000:3.0:1789366612.540228:0:6661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 17 00000100:00100000:3.0:1789366612.540241:0:6661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638b70cea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0ab23baa-a205-44ad-bf17-f7b47295d82b+6:0:x1876286751393536:12345-192.168.202.23@tcp:2:touch.500 00000100:00080000:0.0:1789366612.540489:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00080000:3.0:1789366612.733536:0:6685:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967299 is committed 00000001:00100000:3.0:1789366612.733560:0:6685:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 0ab23baa-a205-44ad-bf17-f7b47295d82b 00000100:00100000:0.0:1789366612.733895:0:6661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638b70cea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0ab23baa-a205-44ad-bf17-f7b47295d82b+5:0:x1876286751393536:12345-192.168.202.23@tcp:2:touch.500 Request processed in 193648us (194486us total) trans 4294967299 rc 0/0 00000100:00100000:0.0:1789366612.733909:0:6661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 17 00000100:00100000:1.0:1789366612.742213:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:0.0:1789366612.743463:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751393792 00000100:00100000:0.0:1789366612.743486:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751393792 00000100:00100000:0.0:1789366612.743571:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 2 00000100:00100000:0.0:1789366612.743593:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638bfec9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0ab23baa-a205-44ad-bf17-f7b47295d82b+10:9676:x1876286751393792:12345-192.168.202.23@tcp:35:touch.500 00000100:00100000:0.0:1789366612.744744:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638bfec9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0ab23baa-a205-44ad-bf17-f7b47295d82b+11:9676:x1876286751393792:12345-192.168.202.23@tcp:35:touch.500 Request processed in 1125us (2509us total) trans 4294967302 rc 0/0 00000100:00100000:0.0:1789366612.744758:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 2 00000100:00100000:2.0:1789366612.801867:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:3.0:1789366612.802276:0:7614:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751393920 00000100:00100000:3.0:1789366612.802290:0:7614:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751393920 00000100:00100000:3.0:1789366612.802372:0:7614:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 25 00000100:00100000:3.0:1789366612.802384:0:7614:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638b702f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0ab23baa-a205-44ad-bf17-f7b47295d82b+11:9677:x1876286751393920:12345-192.168.202.23@tcp:101:rm.0 00010000:00010000:3.0:1789366612.802415:0:7614:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789366612.802444:0:7614:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9638832d3e00/0x8da3486b955f321a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xda917a494d06bf7a expref: -99 pid: 7614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366612.802528:0:7614:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9638832d3400/0x8da3486b955f3221 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7614 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366612.802545:0:7614:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9638832d3400/0x8da3486b955f3221 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7614 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366612.802561:0:7614:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9638832d3400/0x8da3486b955f3221 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7614 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789366612.802616:0:7614:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1789366612.802620:0:7614:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1789366612.802679:0:7614:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9638832d3400/0x8da3486b955f3221 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7614 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366612.802774:0:7614:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9638832d3e00/0x8da3486b955f321a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.23@tcp remote: 0xda917a494d06bf7a expref: 13 pid: 7614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366612.802797:0:7614:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9638832d3400/0x8da3486b955f3221 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.23@tcp remote: 0xda917a494d06bf7a expref: 12 pid: 7614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366612.802806:0:7614:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff963887f88d00) 00010000:00010000:3.0:1789366612.802809:0:7614:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789366612.802814:0:7614:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9638832d3400, rc 0) 00000100:00100000:3.0:1789366612.803332:0:7614:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638b702f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0ab23baa-a205-44ad-bf17-f7b47295d82b+12:9677:x1876286751393920:12345-192.168.202.23@tcp:101:rm.0 Request processed in 947us (1477us total) trans 0 rc 0/0 00000100:00100000:3.0:1789366612.803341:0:7614:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 25 00000100:00100000:0.0:1789366612.817699:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:2.0:1789366612.819002:0:7132:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751394176 00000100:00100000:2.0:1789366612.819024:0:7132:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751394176 00000100:00100000:2.0:1789366612.819121:0:7132:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 26 00000100:00100000:2.0:1789366612.819143:0:7132:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638b70cf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0ab23baa-a205-44ad-bf17-f7b47295d82b+12:9677:x1876286751394176:12345-192.168.202.23@tcp:101:rm.0 00010000:00010000:2.0:1789366612.819188:0:7132:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789366612.819217:0:7132:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9638a0740600/0x8da3486b955f3228 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xda917a494d06bf81 expref: -99 pid: 7132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789366612.819608:0:7132:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00010000:00010000:2.0:1789366612.820246:0:7132:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9638a0740600/0x8da3486b955f3228 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.23@tcp remote: 0xda917a494d06bf81 expref: 14 pid: 7132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366612.820266:0:7132:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff963887f88000) 00010000:00010000:2.0:1789366612.820269:0:7132:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789366612.820276:0:7132:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9638a0740600/0x8da3486b955f3228 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.23@tcp remote: 0xda917a494d06bf81 expref: 14 pid: 7132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366612.820294:0:7132:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9638a0740600, rc 0) 00000100:00100000:2.0:1789366612.820569:0:7132:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638b70cf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0ab23baa-a205-44ad-bf17-f7b47295d82b+13:9677:x1876286751394176:12345-192.168.202.23@tcp:101:rm.0 Request processed in 1428us (2884us total) trans 4294967303 rc 301/301 00000100:00100000:2.0:1789366612.820579:0:7132:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 26 00000100:00100000:2.0:1789366612.836999:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:1.0:1789366612.837181:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751394304 00000100:00100000:1.0:1789366612.837194:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751394304 00000100:00100000:1.0:1789366612.837269:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 3 00000100:00100000:1.0:1789366612.837299:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638b702ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0ab23baa-a205-44ad-bf17-f7b47295d82b+13:9677:x1876286751394304:12345-192.168.202.23@tcp:37:rm.0 00000100:00100000:1.0:1789366612.859628:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638b702ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0ab23baa-a205-44ad-bf17-f7b47295d82b+13:9677:x1876286751394304:12345-192.168.202.23@tcp:37:rm.0 Request processed in 22315us (22627us total) trans 0 rc 0/0 00000100:00100000:1.0:1789366612.859644:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 3 00000100:00100000:2.0:1789366612.881098:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:0.0:1789366612.881235:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751394560 00000100:00100000:0.0:1789366612.881249:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751394560 00000100:00100000:0.0:1789366612.881343:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 4 00000100:00100000:0.0:1789366612.881358:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963888cb8c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0ab23baa-a205-44ad-bf17-f7b47295d82b+13:9677:x1876286751394560:12345-192.168.202.23@tcp:35:rm.0 00000100:00100000:0.0:1789366612.881777:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963888cb8c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0ab23baa-a205-44ad-bf17-f7b47295d82b+14:9677:x1876286751394560:12345-192.168.202.23@tcp:35:rm.0 Request processed in 361us (634us total) trans 4294967304 rc 0/0 00000100:00100000:0.0:1789366612.881788:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 4 00000100:00100000:2.0:1789366612.900432:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:0.0:1789366612.901441:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751394816 00000100:00100000:0.0:1789366612.901455:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751394816 00000100:00100000:0.0:1789366612.901537:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 27 00000100:00100000:0.0:1789366612.901551:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638b702f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0ab23baa-a205-44ad-bf17-f7b47295d82b+14:9677:x1876286751394816:12345-192.168.202.23@tcp:101:rm.0 00010000:00010000:0.0:1789366612.901580:0:5817:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789366612.901619:0:5817:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720c200/0x8da3486b955f3236 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xda917a494d06bf88 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366612.901803:0:5817:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720da00/0x8da3486b955f323d lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366612.901821:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720da00/0x8da3486b955f323d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366612.901858:0:5817:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720da00/0x8da3486b955f323d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789366612.901874:0:5817:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00010000:00010000:0.0:1789366612.902078:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720c200/0x8da3486b955f3236 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.23@tcp remote: 0xda917a494d06bf88 expref: 17 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366612.902101:0:5817:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720da00/0x8da3486b955f323d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.23@tcp remote: 0xda917a494d06bf88 expref: 16 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366612.902112:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff963887f88d00) 00010000:00010000:0.0:1789366612.902116:0:5817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1789366612.902120:0:5817:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9638b720da00, rc 0) 00000100:00100000:0.0:1789366612.902201:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638b702f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0ab23baa-a205-44ad-bf17-f7b47295d82b+16:9677:x1876286751394816:12345-192.168.202.23@tcp:101:rm.0 Request processed in 654us (1785us total) trans 4294967305 rc 0/0 00000100:00100000:0.0:1789366612.902210:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 27 00000100:00100000:2.0:1789366612.912288:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:0.0:1789366612.912505:0:7614:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751394944 00000100:00100000:0.0:1789366612.912518:0:7614:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751394944 00000100:00100000:0.0:1789366612.912620:0:7614:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 28 00000100:00100000:0.0:1789366612.912633:0:7614:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638b702c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0ab23baa-a205-44ad-bf17-f7b47295d82b+16:9677:x1876286751394944:12345-192.168.202.23@tcp:41:rm.0 00000004:00000024:0.0:1789366612.912762:0:7614:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 7719616512 avail 7715422208 00000100:00100000:0.0:1789366612.912854:0:7614:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638b702c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0ab23baa-a205-44ad-bf17-f7b47295d82b+16:9677:x1876286751394944:12345-192.168.202.23@tcp:41:rm.0 Request processed in 224us (580us total) trans 0 rc 0/0 00000100:00100000:0.0:1789366612.912862:0:7614:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 28 00000100:00100000:1.0:1789366612.921457:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:2.0:1789366612.921774:0:7132:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751395072 00000100:00100000:2.0:1789366612.921787:0:7132:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751395072 00000100:00100000:2.0:1789366612.921858:0:7132:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 29 00000100:00100000:2.0:1789366612.921871:0:7132:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638bfecbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0ab23baa-a205-44ad-bf17-f7b47295d82b+16:9677:x1876286751395072:12345-192.168.202.23@tcp:101:rm.0 00010000:00010000:2.0:1789366612.921899:0:7132:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789366612.921940:0:7132:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9638a0740e00/0x8da3486b955f324b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xda917a494d06bf8f expref: -99 pid: 7132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366612.922054:0:7132:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9638a0740600/0x8da3486b955f3252 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366612.922075:0:7132:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9638a0740600/0x8da3486b955f3252 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366612.922089:0:7132:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9638a0740600/0x8da3486b955f3252 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366612.922106:0:7132:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9638a0740a00/0x8da3486b955f3259 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x369fa11a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366612.922112:0:7132:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9638a0740a00/0x8da3486b955f3259 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x369fa11a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366612.922119:0:7132:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9638a0740a00/0x8da3486b955f3259 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x369fa11a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366612.922253:0:7132:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9638a0741000/0x8da3486b955f3260 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366612.922261:0:7132:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9638a0741000/0x8da3486b955f3260 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366612.922268:0:7132:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9638a0741000/0x8da3486b955f3260 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789366612.922301:0:7132:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x2:0x0]: returning size 0 00000004:00200000:2.0:1789366612.922307:0:7132:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1789366612.922346:0:7132:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9638a0741000/0x8da3486b955f3260 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366612.922372:0:7132:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9638a0741000/0x8da3486b955f3260 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366612.922382:0:7132:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9638a0740600/0x8da3486b955f3252 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366612.922390:0:7132:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9638a0740600/0x8da3486b955f3252 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366612.922399:0:7132:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9638a0740600/0x8da3486b955f3252 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366612.922405:0:7132:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9638a0740600 already unused, calling callback (ffffffffc20ee4f0) 00010000:00010000:2.0:1789366612.922410:0:7132:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9638a0740600/0x8da3486b955f3252 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366612.922418:0:7132:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9638a0740600/0x8da3486b955f3252 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366612.922432:0:7132:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff963887f88d00) 00010000:00010000:2.0:1789366612.922436:0:7132:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789366612.922442:0:7132:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9638a0740600/0x8da3486b955f3252 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366612.922450:0:7132:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9638a0740600/0x8da3486b955f3252 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366612.922465:0:7132:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9638a0740a00/0x8da3486b955f3259 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x369fa11a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366612.922472:0:7132:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9638a0740a00/0x8da3486b955f3259 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x369fa11a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366612.922483:0:7132:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9638a0740a00/0x8da3486b955f3259 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x369fa11a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366612.922488:0:7132:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9638a0740a00 already unused, calling callback (ffffffffc20ee4f0) 00010000:00010000:2.0:1789366612.922491:0:7132:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9638a0740a00/0x8da3486b955f3259 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x369fa11a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366612.922497:0:7132:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9638a0740a00/0x8da3486b955f3259 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x369fa11a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366612.922505:0:7132:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x369fa11a (ffff9638a7404300) 00010000:00010000:2.0:1789366612.922507:0:7132:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789366612.922510:0:7132:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9638a0740a00/0x8da3486b955f3259 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x369fa11a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366612.922515:0:7132:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9638a0740a00/0x8da3486b955f3259 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x369fa11a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366612.922551:0:7132:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9638a0740e00/0x8da3486b955f324b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.23@tcp remote: 0xda917a494d06bf8f expref: 18 pid: 7132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366612.922566:0:7132:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9638a0741000/0x8da3486b955f3260 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.23@tcp remote: 0xda917a494d06bf8f expref: 17 pid: 7132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366612.922574:0:7132:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff96388c43f500) 00010000:00010000:2.0:1789366612.922577:0:7132:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789366612.922580:0:7132:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9638a0741000, rc 0) 00000100:00100000:2.0:1789366612.922682:0:7132:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638bfecbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0ab23baa-a205-44ad-bf17-f7b47295d82b+17:9677:x1876286751395072:12345-192.168.202.23@tcp:101:rm.0 Request processed in 814us (1241us total) trans 0 rc 0/0 00000100:00100000:2.0:1789366612.922700:0:7132:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 29 00000100:00100000:0.0:1789366612.931198:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:1.0:1789366612.931438:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751395328 00000100:00100000:1.0:1789366612.931453:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751395328 00000100:00100000:1.0:1789366612.931535:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 30 00000100:00100000:1.0:1789366612.931548:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638b70ce680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0ab23baa-a205-44ad-bf17-f7b47295d82b+17:9677:x1876286751395328:12345-192.168.202.23@tcp:36:rm.0 00010000:00010000:1.0:1789366612.931631:0:5815:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:1.0:1789366612.931668:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9638a0741000/0x8da3486b955f3260 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.23@tcp remote: 0xda917a494d06bf8f expref: 17 pid: 7132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366612.931695:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9638832d2200/0x8da3486b955f320c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.23@tcp remote: 0xda917a494d06bf73 expref: 16 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366612.931707:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff96388c43f500) 00010000:00010000:1.0:1789366612.931756:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9638832d3400/0x8da3486b955f3221 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.23@tcp remote: 0xda917a494d06bf7a expref: 15 pid: 7614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366612.931764:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff963887f88d00) 00010000:00010000:1.0:1789366612.931768:0:5815:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789366612.931794:0:5815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff96388148ea00/0x8da3486b955f3267 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366612.931809:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96388148ea00/0x8da3486b955f3267 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366612.931842:0:5815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96388148ea00/0x8da3486b955f3267 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366612.931861:0:5815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff96388148e000/0x8da3486b955f326e lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0x369fa11a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366612.931869:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96388148e000/0x8da3486b955f326e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x369fa11a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366612.931876:0:5815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96388148e000/0x8da3486b955f326e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x369fa11a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366612.932019:0:5815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff96388148f800/0x8da3486b955f3275 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366612.932028:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96388148f800/0x8da3486b955f3275 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366612.932034:0:5815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96388148f800/0x8da3486b955f3275 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1789366612.932932:0:5815:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].2, 64 off8320 00000004:00080000:1.0:1789366612.932944:0:5815:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 188397225092ns, next at 189397222447ns, rc = 0 00010000:00010000:1.0:1789366612.933039:0:5815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9638b6ce3200/0x8da3486b955f327c lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366612.933050:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9638b6ce3200/0x8da3486b955f327c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366612.933060:0:5815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9638b6ce3200/0x8da3486b955f327c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366612.933080:0:5815:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9638b6ce3200/0x8da3486b955f327c lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366612.933087:0:5815:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9638b6ce3200/0x8da3486b955f327c lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366612.933094:0:5815:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9638b6ce3200/0x8da3486b955f327c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366612.933120:0:5815:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789366612.933144:0:5815:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff96388148f800/0x8da3486b955f3275 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366612.933151:0:5815:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96388148f800/0x8da3486b955f3275 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366612.933157:0:5815:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96388148f800/0x8da3486b955f3275 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366612.933164:0:5815:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96388148f800 already unused, calling callback (ffffffffc20ee4f0) 00010000:00010000:1.0:1789366612.933169:0:5815:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96388148f800/0x8da3486b955f3275 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366612.933177:0:5815:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96388148f800/0x8da3486b955f3275 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366612.933187:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff963887f88800) 00010000:00010000:1.0:1789366612.933190:0:5815:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1789366612.933195:0:5815:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96388148f800/0x8da3486b955f3275 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366612.933212:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96388148f800/0x8da3486b955f3275 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366612.933232:0:5815:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff96388148ea00/0x8da3486b955f3267 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366612.933238:0:5815:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96388148ea00/0x8da3486b955f3267 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366612.933243:0:5815:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96388148ea00/0x8da3486b955f3267 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366612.933247:0:5815:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96388148ea00 already unused, calling callback (ffffffffc20ee4f0) 00010000:00010000:1.0:1789366612.933251:0:5815:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96388148ea00/0x8da3486b955f3267 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366612.933257:0:5815:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96388148ea00/0x8da3486b955f3267 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366612.933265:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff963887f88d00) 00010000:00010000:1.0:1789366612.933267:0:5815:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789366612.933270:0:5815:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96388148ea00/0x8da3486b955f3267 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366612.933276:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96388148ea00/0x8da3486b955f3267 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789366612.933286:0:5815:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000009db3bd66 reply state 00000000822c7b57 transno 4294967306 ns: mdt-lustre-MDT0000_UUID lock: ffff96388148e000/0x8da3486b955f326e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x369fa11a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789366612.933297:0:5815:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1789366612.933407:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638b70ce680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0ab23baa-a205-44ad-bf17-f7b47295d82b+16:9677:x1876286751395328:12345-192.168.202.23@tcp:36:rm.0 Request processed in 1859us (2222us total) trans 4294967306 rc 0/0 00000100:00100000:1.0:1789366612.933417:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 30 00010000:00010000:1.0:1789366612.933460:0:5804:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789366612.933467:0:5804:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9638b6ce3200/0x8da3486b955f327c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366612.933473:0:5804:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9638b6ce3200 already unused, calling callback (ffffffffc16df520) 00010000:00010000:1.0:1789366612.933477:0:5804:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9638b6ce3200/0x8da3486b955f327c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366612.933484:0:5804:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9638b6ce3200/0x8da3486b955f327c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366612.933492:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff963887f88800) 00010000:00010000:1.0:1789366612.933495:0:5804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1789366612.933498:0:5804:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9638b6ce3200/0x8da3486b955f327c lrc: 1/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366612.933503:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9638b6ce3200/0x8da3486b955f327c lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366612.933517:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789366612.933519:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789366612.933520:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789366612.951779:0:3270:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff96388148e000/0x8da3486b955f326e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x369fa11a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366612.951804:0:3270:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96388148e000/0x8da3486b955f326e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x369fa11a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366612.951813:0:3270:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96388148e000/0x8da3486b955f326e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x369fa11a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366612.951821:0:3270:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96388148e000 already unused, calling callback (ffffffffc20ee4f0) 00010000:00010000:3.0:1789366612.951827:0:3270:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96388148e000/0x8da3486b955f326e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x369fa11a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366612.951837:0:3270:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96388148e000/0x8da3486b955f326e lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x369fa11a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366612.951858:0:3270:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x369fa11a (ffff963887f88900) 00010000:00010000:3.0:1789366612.951880:0:3270:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789366612.951887:0:3270:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96388148e000/0x8da3486b955f326e lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x369fa11a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366612.951896:0:3270:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96388148e000/0x8da3486b955f326e lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x369fa11a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789366612.952805:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:3.0:1789366612.953524:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751395584 00000100:00100000:3.0:1789366612.953539:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751395584 00000100:00100000:3.0:1789366612.953616:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 5 00000100:00100000:3.0:1789366612.953628:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638b70cdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0ab23baa-a205-44ad-bf17-f7b47295d82b+15:9677:x1876286751395584:12345-192.168.202.23@tcp:35:rm.0 00000100:00100000:3.0:1789366612.953953:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638b70cdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0ab23baa-a205-44ad-bf17-f7b47295d82b+16:9677:x1876286751395584:12345-192.168.202.23@tcp:35:rm.0 Request processed in 327us (1155us total) trans 4294967307 rc 0/0 00000100:00100000:3.0:1789366612.953962:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 5 00000100:00100000:1.0:1789366612.965709:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:3.0:1789366612.965879:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751395840 00000100:00100000:3.0:1789366612.965891:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751395840 00000100:00100000:3.0:1789366612.965973:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 31 00000100:00100000:3.0:1789366612.965984:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638bfec9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0ab23baa-a205-44ad-bf17-f7b47295d82b+16:9677:x1876286751395840:12345-192.168.202.23@tcp:36:rm.0 00010000:00010000:3.0:1789366612.966067:0:5816:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:3.0:1789366612.966104:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720da00/0x8da3486b955f323d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.23@tcp remote: 0xda917a494d06bf88 expref: 16 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366612.966147:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96388148f000/0x8da3486b955f31db lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.23@tcp remote: 0xda917a494d06bf65 expref: 15 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366612.966161:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff963887f88d00) 00010000:00010000:3.0:1789366612.966179:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96388148fc00/0x8da3486b955f319c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.23@tcp remote: 0xda917a494d06bf57 expref: 14 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366612.966212:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff963887f88000) 00010000:00010000:3.0:1789366612.966221:0:5816:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789366612.966252:0:5816:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9638832d3e00/0x8da3486b955f3283 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366612.966268:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9638832d3e00/0x8da3486b955f3283 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366612.966280:0:5816:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9638832d3e00/0x8da3486b955f3283 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366612.966293:0:5816:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9638832d2000/0x8da3486b955f328a lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366612.966299:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9638832d2000/0x8da3486b955f328a lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366612.966305:0:5816:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9638832d2000/0x8da3486b955f328a lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366612.966617:0:5816:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9638832d3600/0x8da3486b955f3291 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366612.966625:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9638832d3600/0x8da3486b955f3291 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366612.966632:0:5816:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9638832d3600/0x8da3486b955f3291 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789366612.967371:0:5816:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00010000:00010000:3.0:1789366612.967393:0:5816:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9638832d3600/0x8da3486b955f3291 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366612.967408:0:5816:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9638832d3600/0x8da3486b955f3291 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366612.967415:0:5816:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9638832d3600/0x8da3486b955f3291 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366612.967422:0:5816:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9638832d3600 already unused, calling callback (ffffffffc20ee4f0) 00010000:00010000:3.0:1789366612.967428:0:5816:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9638832d3600/0x8da3486b955f3291 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366612.967437:0:5816:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9638832d3600/0x8da3486b955f3291 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366612.967449:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff96388c43f700) 00010000:00010000:3.0:1789366612.967452:0:5816:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1789366612.967457:0:5816:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9638832d3600/0x8da3486b955f3291 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366612.967464:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9638832d3600/0x8da3486b955f3291 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366612.967487:0:5816:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9638832d3e00/0x8da3486b955f3283 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366612.967493:0:5816:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9638832d3e00/0x8da3486b955f3283 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366612.967499:0:5816:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9638832d3e00/0x8da3486b955f3283 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366612.967504:0:5816:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9638832d3e00 already unused, calling callback (ffffffffc20ee4f0) 00010000:00010000:3.0:1789366612.967514:0:5816:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9638832d3e00/0x8da3486b955f3283 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366612.967522:0:5816:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9638832d3e00/0x8da3486b955f3283 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366612.967530:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff96388c43f100) 00010000:00010000:3.0:1789366612.967533:0:5816:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789366612.967535:0:5816:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9638832d3e00/0x8da3486b955f3283 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366612.967541:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9638832d3e00/0x8da3486b955f3283 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789366612.967554:0:5816:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000191e979e reply state 00000000e26d59cd transno 4294967308 ns: mdt-lustre-MDT0000_UUID lock: ffff9638832d2000/0x8da3486b955f328a lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789366612.967563:0:5816:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789366612.967694:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638bfec9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0ab23baa-a205-44ad-bf17-f7b47295d82b+15:9677:x1876286751395840:12345-192.168.202.23@tcp:36:rm.0 Request processed in 1707us (1997us total) trans 4294967308 rc 0/0 00000100:00100000:3.0:1789366612.967705:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 31 00010000:00010000:2.0:1789366612.983918:0:3271:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9638832d2000/0x8da3486b955f328a lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366612.983948:0:3271:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9638832d2000/0x8da3486b955f328a lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366612.983958:0:3271:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9638832d2000/0x8da3486b955f328a lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366612.983966:0:3271:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9638832d2000 already unused, calling callback (ffffffffc20ee4f0) 00010000:00010000:2.0:1789366612.983972:0:3271:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9638832d2000/0x8da3486b955f328a lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366612.983982:0:3271:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9638832d2000/0x8da3486b955f328a lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366612.984005:0:3271:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff96388c43f600) 00010000:00010000:2.0:1789366612.984008:0:3271:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789366612.984014:0:3271:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9638832d2000/0x8da3486b955f328a lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366612.984022:0:3271:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9638832d2000/0x8da3486b955f328a lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366613.055700:0:5805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789366614.072036:0:6675:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1789366614.455898:0:7131:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 189920177316ns, next at 190920174949ns, rc = 0 00000100:00100000:1.0:1789366614.456005:0:3286:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789366614.456027:0:3286:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff963883308a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3286:1876286758760960:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789366614.456094:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789366614.456248:0:6663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286758760960 00000100:00100000:3.0:1789366614.456255:0:6663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286758760960 00000100:00100000:3.0:1789366614.456331:0:6663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1789366614.456341:0:6663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638bfec8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3286:x1876286758760960:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789366614.456374:0:6663:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789366614.456419:0:6663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638bfec8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3286:x1876286758760960:12345-0@lo:13:osp-pre-0-0.0 Request processed in 80us (325us total) trans 0 rc 0/0 00000100:00100000:3.0:1789366614.456427:0:6663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00010000:00080000:1.0:1789366614.456553:0:3286:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff963883308a80 x1876286758760960/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789366630 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789366614.456591:0:3286:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff963883308a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3286:1876286758760960:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1789366614.456872:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1789366615.102073:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789366616.120632:0:5805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789366616.780212:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:1.0:1789366616.780328:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:1.0:1789366616.780367:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:1.0:1789366616.780405:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:1.0:1789366616.780455:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751396096 00000100:00100000:1.0:1789366616.780466:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751396096 00000100:00100000:1.0:1789366616.780528:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751396352 00000100:00100000:1.0:1789366616.780531:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751396352 00000100:00100000:1.0:1789366616.780580:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 75 00000100:00100000:1.0:1789366616.780589:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638bfecad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0ab23baa-a205-44ad-bf17-f7b47295d82b+14:2356:x1876286751396096:12345-192.168.202.23@tcp:400:kworker.0 00000100:00100000:1.0:1789366616.780675:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638bfecad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0ab23baa-a205-44ad-bf17-f7b47295d82b+14:2356:x1876286751396096:12345-192.168.202.23@tcp:400:kworker.0 Request processed in 88us (308us total) trans 0 rc 0/0 00000100:00100000:1.0:1789366616.780683:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 75 00000100:00100000:1.0:1789366616.780699:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 76 00000100:00100000:1.0:1789366616.780705:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638bfec8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b9764435-e52f-45ac-a5f9-bab1231105ac+5:2356:x1876286751396352:12345-192.168.202.23@tcp:400:kworker.0 00000100:00100000:1.0:1789366616.780760:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638bfec8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b9764435-e52f-45ac-a5f9-bab1231105ac+5:2356:x1876286751396352:12345-192.168.202.23@tcp:400:kworker.0 Request processed in 55us (356us total) trans 0 rc 0/0 00000100:00100000:1.0:1789366616.780767:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 76 00000100:00080000:1.0:1789366616.780782:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789366616.783638:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751396224 00000100:00100000:3.0:1789366616.783664:0:6659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751396224 00000100:00100000:3.0:1789366616.783816:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 36 00000100:00100000:3.0:1789366616.783828:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638b6fc4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0ab23baa-a205-44ad-bf17-f7b47295d82b+5:2356:x1876286751396224:12345-192.168.202.23@tcp:400:kworker.0 00000100:00100000:3.0:1789366616.783925:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638b6fc4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0ab23baa-a205-44ad-bf17-f7b47295d82b+5:2356:x1876286751396224:12345-192.168.202.23@tcp:400:kworker.0 Request processed in 99us (3596us total) trans 0 rc 0/0 00000100:00100000:3.0:1789366616.783933:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 36 00000100:00080000:1.0:1789366616.785000:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789366616.787980:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751395968 00000100:00100000:2.0:1789366616.787997:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751395968 00000100:00100000:0.0:1789366616.788700:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 235 00000100:00100000:0.0:1789366616.788715:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638b4e3d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:14a2847b-91d8-4d87-b71b-010443acc91a+13:2356:x1876286751395968:12345-192.168.202.23@tcp:400:kworker.0 00000100:00100000:0.0:1789366616.788978:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638b4e3d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:14a2847b-91d8-4d87-b71b-010443acc91a+13:2356:x1876286751395968:12345-192.168.202.23@tcp:400:kworker.0 Request processed in 266us (8776us total) trans 0 rc 0/0 00000100:00100000:0.0:1789366616.788987:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 235 00000100:00100000:2.0:1789366617.016025:0:3285:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789366617.016051:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9638bfeca680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3285:1876286758761088:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789366617.016143:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789366617.016442:0:6662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286758761088 00000100:00100000:1.0:1789366617.016450:0:6662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286758761088 00000100:00100000:1.0:1789366617.016519:0:6662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1789366617.016528:0:6662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638b702df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1876286758761088:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789366617.016591:0:6662:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789366617.016634:0:6662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638b702df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1876286758761088:12345-0@lo:13:osp-pre-1-0.0 Request processed in 108us (492us total) trans 0 rc 0/0 00000100:00100000:1.0:1789366617.016641:0:6662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00080000:2.0:1789366617.016925:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:2.0:1789366617.016956:0:3285:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9638bfeca680 x1876286758761088/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789366633 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789366617.016975:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9638bfeca680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3285:1876286758761088:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789366617.017128:0:3286:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9638bfec9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3286:1876286758761344:0@lo:400:kworker.0 00000100:00100000:1.0:1789366617.017158:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789366617.017176:0:3286:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789366617.017181:0:3286:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9638bfec9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3286:1876286758761472:0@lo:400:kworker.0 00000100:00100000:1.0:1789366617.017201:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789366617.017229:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286758761344 00000100:00100000:1.0:1789366617.017233:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286758761344 00000100:00100000:1.0:1789366617.017257:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286758761472 00000100:00100000:1.0:1789366617.017260:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286758761472 00000100:00100000:1.0:1789366617.017301:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1789366617.017307:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638bfecb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3286:x1876286758761344:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789366617.017341:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638bfecb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3286:x1876286758761344:12345-0@lo:400:kworker.0 Request processed in 34us (182us total) trans 0 rc 0/0 00000100:00100000:1.0:1789366617.017347:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1789366617.017359:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1789366617.017365:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638bfec8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3286:x1876286758761472:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789366617.017389:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638bfec8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3286:x1876286758761472:12345-0@lo:400:kworker.0 Request processed in 25us (187us total) trans 0 rc 0/0 00000100:00100000:1.0:1789366617.017395:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1789366617.017421:0:3286:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9638bfec9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3286:1876286758761472:0@lo:400:kworker.0 00000100:00100000:1.0:1789366617.017430:0:3286:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9638bfec9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3286:1876286758761344:0@lo:400:kworker.0 00000100:00100000:0.0:1789366617.017635:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9638bfec8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3284:1876286758761600:0@lo:400:kworker.0 00000100:00100000:0.0:1789366617.017667:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789366617.017695:0:3284:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1789366617.017701:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9638bfec9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8cde4528-5832-4854-a387-4adacc3dd0ab:3284:1876286758761216:0@lo:400:kworker.0 00000100:00100000:0.0:1789366617.017752:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789366617.017777:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9638bfeca300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3284:1876286758761728:0@lo:400:kworker.0 00000100:00100000:0.0:1789366617.017798:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789366617.017836:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286758761216 00000100:00100000:0.0:1789366617.017841:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286758761216 00000100:00100000:0.0:1789366617.017867:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 236 00000100:00100000:0.0:1789366617.017873:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638b4e3c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8cde4528-5832-4854-a387-4adacc3dd0ab+19:3284:x1876286758761216:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789366617.017907:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638b4e3c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8cde4528-5832-4854-a387-4adacc3dd0ab+19:3284:x1876286758761216:12345-0@lo:400:kworker.0 Request processed in 34us (155us total) trans 0 rc 0/0 00000100:00100000:0.0:1789366617.017913:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 236 00000100:00100000:0.0:1789366617.017939:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286758761728 00000100:00100000:0.0:1789366617.017942:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286758761728 00000100:00100000:0.0:1789366617.017978:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1789366617.017986:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638b70ced80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3284:x1876286758761728:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789366617.018015:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638b70ced80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3284:x1876286758761728:12345-0@lo:400:kworker.0 Request processed in 30us (216us total) trans 0 rc 0/0 00000100:00100000:0.0:1789366617.018028:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1789366617.018053:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9638bfec9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8cde4528-5832-4854-a387-4adacc3dd0ab:3284:1876286758761216:0@lo:400:kworker.0 00000100:00100000:0.0:1789366617.018062:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9638bfeca300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3284:1876286758761728:0@lo:400:kworker.0 00000100:00080000:2.0:1789366617.018638:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789366617.022068:0:8065:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286758761600 00000100:00100000:1.0:1789366617.022094:0:8065:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286758761600 00000100:00100000:1.0:1789366617.022172:0:8065:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1789366617.022183:0:8065:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638b70cd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3284:x1876286758761600:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789366617.023205:0:8065:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638b70cd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3284:x1876286758761600:12345-0@lo:400:kworker.0 Request processed in 1022us (5533us total) trans 0 rc 0/0 00000100:00100000:1.0:1789366617.023215:0:8065:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00080000:2.0:1789366617.023302:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1789366617.046180:0:3284:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9638bfec8e00 x1876286758761600/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789366633 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789366617.046201:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9638bfec8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3284:1876286758761600:0@lo:400:kworker.0 00010000:00010000:2.0:1789366617.143935:0:6675:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1789366617.609143:0:5837:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967305 is committed 00000001:00080000:1.0:1789366617.609165:0:5837:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967306 is committed 00000004:00080000:1.0:1789366617.609169:0:5837:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00000004:00080000:1.0:1789366617.609189:0:5837:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3 committed 00000001:00080000:1.0:1789366617.609194:0:5837:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967308 is committed 00000100:00100000:1.0:1789366617.609335:0:3287:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789366617.609356:0:3287:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9638bfec9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3287:1876286758761856:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1789366617.609418:0:3287:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789366617.609476:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286758761856 00000100:00100000:1.0:1789366617.609484:0:6660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286758761856 00000100:00100000:1.0:1789366617.609527:0:6660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1789366617.609536:0:6660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638bfec9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3287:x1876286758761856:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1789366617.609574:0:6660:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:2 count 1 00002000:00010000:1.0:1789366617.609608:0:6660:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x2:0x0] initial LVB size: 0, mtime: 0x6aa79154, atime: 0x6aa79154, ctime: 0x6aa79154, blocks: 0x1 00010000:00010000:1.0:1789366617.609616:0:6660:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e4010258/0x8da3486b955f3298 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366617.609632:0:6660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=193s v=(0 0) 00010000:00010000:1.0:1789366617.609637:0:6660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789366617.609643:0:6660:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e4010258/0x8da3486b955f3298 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366617.609674:0:6660:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e4010258/0x8da3486b955f3298 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366617.609684:0:6660:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e4010258/0x8da3486b955f3298 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366617.609692:0:6660:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e4010258/0x8da3486b955f3298 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366617.609707:0:6660:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1789366617.610587:0:6660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638bfec9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3287:x1876286758761856:12345-0@lo:6:osp-syn-0-0.0 Request processed in 1050us (1166us total) trans 4294967300 rc 0/0 00000100:00100000:1.0:1789366617.610596:0:6660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00010000:1.0:1789366617.610616:0:5804:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789366617.610623:0:5804:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e4010258/0x8da3486b955f3298 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366617.610632:0:5804:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9638b6ce2200 already unused, calling callback (ffffffffc16df520) 00010000:00010000:1.0:1789366617.610637:0:5804:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e4010258/0x8da3486b955f3298 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366617.610648:0:5804:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e4010258/0x8da3486b955f3298 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366617.610665:0:5804:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e4010258/0x8da3486b955f3298 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366617.610680:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e4010258/0x8da3486b955f3298 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366617.610699:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789366617.610701:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789366617.610703:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1789366617.615863:0:3287:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9638bfec9180/2, rc 0, transno 4294967300 00000100:00100000:0.0:1789366617.615877:0:3287:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9638bfec9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3287:1876286758761856:0@lo:6:osp-syn-0-0.0 00000001:00080000:2.0:1789366618.147804:0:6685:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967300 is committed 00010000:00010000:0.0:1789366618.168027:0:5805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1789366618.383056:0:11584:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: excepting tests: 6 7a 7b 23 35 33 00010000:00010000:2.0:1789366619.192702:0:6675:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789366619.576271:0:3286:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789366619.576294:0:3286:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96388330a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3286:1876286758761984:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789366619.576362:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789366619.576482:0:7134:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286758761984 00000100:00100000:2.0:1789366619.576489:0:7134:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286758761984 00000100:00100000:2.0:1789366619.576559:0:7134:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1789366619.576569:0:7134:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638bfecb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3286:x1876286758761984:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789366619.576602:0:7134:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789366619.576654:0:7134:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638bfecb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3286:x1876286758761984:12345-0@lo:13:osp-pre-0-0.0 Request processed in 87us (292us total) trans 0 rc 0/0 00000100:00100000:2.0:1789366619.576661:0:7134:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1789366619.576786:0:3286:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967300 gen 2 00000004:00080000:1.0:1789366619.576791:0:3286:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9638bfec9180, transno 4294967300 00000100:00100000:1.0:1789366619.576815:0:3286:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96388330a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3286:1876286758761984:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1789366619.576981:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000020:00000080:2.0:1789366619.952423:0:11632:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffe6185c140 20000000:00000080:2.0:1789366619.952442:0:11632:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9638af304c00 uarg=0000000000000000 20000000:01000000:2.0:1789366619.956996:0:11632:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='lustre' param='mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:2.0:1789366619.957006:0:11632:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:2.0:1789366619.957011:0:11632:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/lustre/mdt.lustre-MDT0000.hsm_control=enabled del=0 00000040:00080000:2.0:1789366619.961244:0:11633:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 20000000:02000000:1.0:1789366619.961443:0:11632:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre.mdt.lustre-MDT0000.hsm_control=enabled in log params 00000040:00080000:0.0:1789366619.977189:0:11632:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9536 00000040:00080000:0.0:1789366619.978589:0:11632:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].8, 128 off9664 00000040:00080000:0.0:1789366619.979023:0:11632:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].9, 224 off9888 10000000:01000000:0.0:1789366619.979056:0:11632:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1789366619.979076:0:11632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9638b720c400/0x8da3486b955f329f lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366619.979097:0:11632:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9638a0741c00/0x8da3486b955f313a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.202.23@tcp remote: 0xda917a494d06bf42 expref: 12 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366619.979104:0:11632:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9638832d3a00/0x8da3486b955f3141 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.202.23@tcp remote: 0xda917a494d06bf49 expref: 12 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366619.979111:0:11632:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9638832d2a00/0x8da3486b955f314f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8da3486b955f3148 expref: 18 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366619.979117:0:11632:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9638832d3c00/0x8da3486b955f315d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8da3486b955f3156 expref: 18 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366619.979124:0:11632:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff96388148fa00/0x8da3486b955f316b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8da3486b955f3164 expref: 18 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366619.979148:0:11632:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9638b720c400/0x8da3486b955f329f lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 11632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366619.979187:0:11632:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff96388148fa00/0x8da3486b955f316b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x8da3486b955f3164 expref: 18 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366619.979202:0:11632:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff96388148fa00/0x8da3486b955f316b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x8da3486b955f3164 expref: 18 pid: 5810 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789366619.979216:0:11632:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9638b70cea00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11632:1876286758762112:0@lo:104: 00000100:00100000:0.0:1789366619.979628:0:11632:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789366619.979840:0:11632:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9638832d3c00/0x8da3486b955f315d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x8da3486b955f3156 expref: 18 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366619.979850:0:11632:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9638832d3c00/0x8da3486b955f315d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x8da3486b955f3156 expref: 18 pid: 5810 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789366619.980015:0:11632:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9638b70ce300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11632:1876286758762240:0@lo:104: 00000100:00100000:0.0:1789366619.980341:0:11632:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789366619.990694:0:11632:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9638832d2a00/0x8da3486b955f314f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x8da3486b955f3148 expref: 18 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366619.990715:0:11632:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9638832d2a00/0x8da3486b955f314f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x8da3486b955f3148 expref: 18 pid: 5810 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789366619.990993:0:11632:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9638bf5a9880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11632:1876286758762368:0@lo:104: 00000100:00100000:0.0:1789366619.991064:0:11632:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789366619.992463:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286758762112 00000100:00100000:1.0:1789366619.992475:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286758762112 00000100:00100000:1.0:1789366619.992550:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286758762240 00000100:00100000:1.0:1789366619.992555:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286758762240 00000100:00100000:1.0:1789366619.992571:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1789366619.992580:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638b70cf100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8cde4528-5832-4854-a387-4adacc3dd0ab+4:11632:x1876286758762112:12345-0@lo:104: 00010000:00010000:1.0:1789366619.992596:0:5800:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.123@tcp lock: ffff9638b720d000/0x8da3486b955f3164 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x8da3486b955f316b expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366619.992680:0:5800:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1789366619.992686:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638b70cf100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8cde4528-5832-4854-a387-4adacc3dd0ab+4:11632:x1876286758762112:12345-0@lo:104: Request processed in 108us (13067us total) trans 0 rc 0/0 00000100:00100000:1.0:1789366619.992694:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1789366619.992835:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1789366619.992846:0:6674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638b70cd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:8cde4528-5832-4854-a387-4adacc3dd0ab+3:11632:x1876286758762240:12345-0@lo:104: 00010000:00010000:3.0:1789366619.992855:0:6674:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.123@tcp lock: ffff9638a0740800/0x8da3486b955f3156 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x8da3486b955f315d expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366619.992913:0:6674:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1789366619.992919:0:6674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638b70cd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:8cde4528-5832-4854-a387-4adacc3dd0ab+3:11632:x1876286758762240:12345-0@lo:104: Request processed in 77us (12877us total) trans 0 rc 0/0 00000100:00100000:3.0:1789366619.992925:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00010000:00010000:3.0:1789366619.992943:0:5805:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1789366619.992948:0:5805:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.123@tcp lock: ffff9638b720d000/0x8da3486b955f3164 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x8da3486b955f316b expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366619.992956:0:5805:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9638b720d000 already unused, calling callback (ffffffffc1cc7c20) 10000000:00010000:3.0:1789366619.992960:0:5805:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.123@tcp lock: ffff9638b720d000/0x8da3486b955f3164 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x8da3486b955f316b expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366619.992974:0:5805:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.123@tcp lock: ffff9638b720d000/0x8da3486b955f3164 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x8da3486b955f316b expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789366619.992981:0:5805:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.123@tcp lock: ffff9638b720d000/0x8da3486b955f3164 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x8da3486b955f316b expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789366619.992986:0:5805:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1789366619.993019:0:5805:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.123@tcp lock: ffff9638b720d000/0x8da3486b955f3164 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8da3486b955f316b expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366619.993025:0:5805:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789366619.993057:0:5805:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.123@tcp lock: ffff9638b720d000/0x8da3486b955f3164 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8da3486b955f316b expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366619.993066:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.123@tcp lock: ffff9638b720d000/0x8da3486b955f3164 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8da3486b955f316b expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366619.993079:0:5805:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789366619.993082:0:5805:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.123@tcp lock: ffff9638a0740800/0x8da3486b955f3156 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x8da3486b955f315d expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366619.993088:0:5805:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9638a0740800 already unused, calling callback (ffffffffc1cc7c20) 10000000:00010000:3.0:1789366619.993091:0:5805:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.123@tcp lock: ffff9638a0740800/0x8da3486b955f3156 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x8da3486b955f315d expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366619.993097:0:5805:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.123@tcp lock: ffff9638a0740800/0x8da3486b955f3156 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x8da3486b955f315d expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789366619.993103:0:5805:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.123@tcp lock: ffff9638a0740800/0x8da3486b955f3156 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x8da3486b955f315d expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789366619.993115:0:5805:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1789366619.993130:0:5805:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.123@tcp lock: ffff9638a0740800/0x8da3486b955f3156 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8da3486b955f315d expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366619.993136:0:5805:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789366619.993143:0:5805:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.123@tcp lock: ffff9638a0740800/0x8da3486b955f3156 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8da3486b955f315d expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366619.993149:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.123@tcp lock: ffff9638a0740800/0x8da3486b955f3156 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8da3486b955f315d expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366619.993158:0:5805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789366619.993160:0:5805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789366619.993161:0:5805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789366619.993176:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96388330bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8cde4528-5832-4854-a387-4adacc3dd0ab:3284:1876286758762496:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789366619.993207:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789366619.993243:0:3284:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789366619.993414:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96388330a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8cde4528-5832-4854-a387-4adacc3dd0ab:3284:1876286758762624:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789366619.993440:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789366619.993472:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286758762496 00000100:00100000:3.0:1789366619.993476:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286758762496 00010000:00010000:3.0:1789366619.993497:0:5801:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff96388148fa00/0x8da3486b955f316b lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8da3486b955f3164 expref: 19 pid: 5810 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789366619.993528:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286758762624 00000100:00100000:3.0:1789366619.993532:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286758762624 00010000:00010000:3.0:1789366619.993543:0:5801:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9638832d3c00/0x8da3486b955f315d lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8da3486b955f3156 expref: 20 pid: 5810 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789366619.993572:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1789366619.993577:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963883309c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8cde4528-5832-4854-a387-4adacc3dd0ab+20:3284:x1876286758762496:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789366619.993588:0:5801:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789366619.993594:0:5801:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff96388148fa00/0x8da3486b955f316b lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8da3486b955f3164 expref: 20 pid: 5810 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366619.993606:0:5801:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff96388148fa00/0x8da3486b955f316b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x8da3486b955f3164 expref: 20 pid: 5810 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366619.993630:0:5801:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789366619.993659:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963883309c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8cde4528-5832-4854-a387-4adacc3dd0ab+20:3284:x1876286758762496:12345-0@lo:103:ldlm_bl.0 Request processed in 82us (451us total) trans 0 rc 0/0 00000100:00100000:3.0:1789366619.993665:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1789366619.993678:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1789366619.993684:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963883309180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8cde4528-5832-4854-a387-4adacc3dd0ab+19:3284:x1876286758762624:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789366619.993692:0:5801:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789366619.993695:0:5801:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9638832d3c00/0x8da3486b955f315d lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8da3486b955f3156 expref: 19 pid: 5810 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366619.993704:0:5801:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9638832d3c00/0x8da3486b955f315d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x8da3486b955f3156 expref: 19 pid: 5810 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366619.993714:0:5801:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789366619.993771:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963883309180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8cde4528-5832-4854-a387-4adacc3dd0ab+19:3284:x1876286758762624:12345-0@lo:103:ldlm_bl.0 Request processed in 87us (330us total) trans 0 rc 0/0 00000100:00100000:3.0:1789366619.993778:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1789366619.993830:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96388330a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8cde4528-5832-4854-a387-4adacc3dd0ab:3284:1876286758762624:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789366619.993847:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96388330bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8cde4528-5832-4854-a387-4adacc3dd0ab:3284:1876286758762496:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789366619.994358:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789366620.001903:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286758762368 00000100:00100000:3.0:1789366620.001918:0:6674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286758762368 00000100:00100000:3.0:1789366620.001967:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1789366620.001978:0:6674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638bf5aa300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:8cde4528-5832-4854-a387-4adacc3dd0ab+3:11632:x1876286758762368:12345-0@lo:104: 00010000:00010000:3.0:1789366620.001994:0:6674:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.123@tcp lock: ffff96388148e800/0x8da3486b955f3148 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x8da3486b955f314f expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366620.002076:0:6674:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1789366620.002082:0:6674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638bf5aa300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:8cde4528-5832-4854-a387-4adacc3dd0ab+3:11632:x1876286758762368:12345-0@lo:104: Request processed in 106us (11018us total) trans 0 rc 0/0 00000100:00100000:3.0:1789366620.002089:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00010000:00010000:2.0:1789366620.002336:0:6675:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789366620.002345:0:6675:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.123@tcp lock: ffff96388148e800/0x8da3486b955f3148 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x8da3486b955f314f expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366620.002353:0:6675:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96388148e800 already unused, calling callback (ffffffffc1cc7c20) 10000000:00010000:2.0:1789366620.002372:0:6675:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.123@tcp lock: ffff96388148e800/0x8da3486b955f3148 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x8da3486b955f314f expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366620.002381:0:6675:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.123@tcp lock: ffff96388148e800/0x8da3486b955f3148 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x8da3486b955f314f expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789366620.002388:0:6675:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.123@tcp lock: ffff96388148e800/0x8da3486b955f3148 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x8da3486b955f314f expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789366620.002394:0:6675:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1789366620.002440:0:6675:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.123@tcp lock: ffff96388148e800/0x8da3486b955f3148 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8da3486b955f314f expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366620.002447:0:6675:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789366620.002478:0:6675:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.123@tcp lock: ffff96388148e800/0x8da3486b955f3148 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8da3486b955f314f expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366620.002486:0:6675:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.123@tcp lock: ffff96388148e800/0x8da3486b955f3148 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8da3486b955f314f expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366620.002503:0:6675:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789366620.002505:0:6675:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789366620.002507:0:6675:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789366620.002533:0:3286:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9638b702fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8cde4528-5832-4854-a387-4adacc3dd0ab:3286:1876286758762880:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789366620.002583:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789366620.003137:0:11632:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9638832d3a00/0x8da3486b955f3141 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.202.23@tcp remote: 0xda917a494d06bf49 expref: 12 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366620.003165:0:11632:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9638832d3a00/0x8da3486b955f3141 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.202.23@tcp remote: 0xda917a494d06bf49 expref: 12 pid: 5810 timeout: 295 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789366620.003178:0:11632:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9638bf5ab800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11632:1876286758762752:192.168.202.23@tcp:104: 00010000:00010000:0.0:1789366620.003305:0:11632:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9638a0741c00/0x8da3486b955f313a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.202.23@tcp remote: 0xda917a494d06bf42 expref: 12 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366620.003316:0:11632:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9638a0741c00/0x8da3486b955f313a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.202.23@tcp remote: 0xda917a494d06bf42 expref: 12 pid: 5810 timeout: 295 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789366620.003325:0:11632:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9638bf5ab100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11632:1876286758763008:192.168.202.23@tcp:104: 00000100:00100000:0.0:1789366620.003351:0:11632:0:(client.c:2716:ptlrpc_set_wait()) set ffff96388a342cc0 going to sleep for 10 seconds 00010000:00010000:0.0:1789366620.003372:0:11632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff96388148fa00/0x8da3486b955f316b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x8da3486b955f3164 expref: 18 pid: 5810 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789366620.003384:0:11632:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9638b70cea00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11632:1876286758762112:0@lo:104: 00010000:00010000:0.0:1789366620.003396:0:11632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9638832d3c00/0x8da3486b955f315d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x8da3486b955f3156 expref: 17 pid: 5810 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789366620.003403:0:11632:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9638b70ce300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11632:1876286758762240:0@lo:104: 00000100:00100000:0.0:1789366620.003411:0:11632:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9638bf5a9880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11632:1876286758762368:0@lo:104: 00000100:00100000:3.0:1789366620.003615:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286758762880 00000100:00100000:3.0:1789366620.003629:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286758762880 00010000:00010000:3.0:1789366620.003649:0:5801:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9638832d2a00/0x8da3486b955f314f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8da3486b955f3148 expref: 17 pid: 5810 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789366620.003680:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1789366620.003688:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638b702d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8cde4528-5832-4854-a387-4adacc3dd0ab+17:3286:x1876286758762880:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789366620.003698:0:5801:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789366620.003703:0:5801:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9638832d2a00/0x8da3486b955f314f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8da3486b955f3148 expref: 17 pid: 5810 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366620.003713:0:5801:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9638832d2a00/0x8da3486b955f314f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x8da3486b955f3148 expref: 17 pid: 5810 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366620.003870:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9638832d2a00/0x8da3486b955f314f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x8da3486b955f3148 expref: 17 pid: 5810 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366620.003899:0:5801:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789366620.003950:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638b702d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8cde4528-5832-4854-a387-4adacc3dd0ab+16:3286:x1876286758762880:12345-0@lo:103:ldlm_bl.0 Request processed in 263us (1367us total) trans 0 rc 0/0 00000100:00100000:3.0:1789366620.003957:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1789366620.004064:0:3286:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9638b702fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8cde4528-5832-4854-a387-4adacc3dd0ab:3286:1876286758762880:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789366620.012253:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:1.0:1789366620.012289:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:0.0:1789366620.012377:0:11632:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9638bf5ab800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11632:1876286758762752:192.168.202.23@tcp:104: 00000100:00100000:0.0:1789366620.012389:0:11632:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9638bf5ab100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11632:1876286758763008:192.168.202.23@tcp:104: 00010000:00010000:0.0:1789366620.012439:0:11632:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9638b720c400/0x8da3486b955f329f lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789366620.012577:0:8419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751396480 00000100:00100000:2.0:1789366620.012584:0:8419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751396480 00010000:00010000:2.0:1789366620.012629:0:8419:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9638832d3a00/0x8da3486b955f3141 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.23@tcp remote: 0xda917a494d06bf49 expref: 13 pid: 5810 timeout: 295 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789366620.012679:0:8419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751396608 00000100:00100000:2.0:1789366620.012683:0:8419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751396608 00010000:00010000:2.0:1789366620.012698:0:8419:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9638a0741c00/0x8da3486b955f313a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.23@tcp remote: 0xda917a494d06bf42 expref: 14 pid: 5810 timeout: 295 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789366620.012753:0:8419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 32 00000100:00100000:2.0:1789366620.012762:0:8419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96389861f850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:14a2847b-91d8-4d87-b71b-010443acc91a+14:2354:x1876286751396480:12345-192.168.202.23@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789366620.012776:0:8419:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789366620.012782:0:8419:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9638832d3a00/0x8da3486b955f3141 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.202.23@tcp remote: 0xda917a494d06bf49 expref: 14 pid: 5810 timeout: 295 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366620.012794:0:8419:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9638832d3a00/0x8da3486b955f3141 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.202.23@tcp remote: 0xda917a494d06bf49 expref: 14 pid: 5810 timeout: 295 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366620.012811:0:8419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9638832d3a00/0x8da3486b955f3141 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.202.23@tcp remote: 0xda917a494d06bf49 expref: 14 pid: 5810 timeout: 295 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366620.012825:0:8419:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789366620.013013:0:8419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96389861f850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:14a2847b-91d8-4d87-b71b-010443acc91a+13:2354:x1876286751396480:12345-192.168.202.23@tcp:103:ldlm_bl.0 Request processed in 113us (630us total) trans 0 rc 0/0 00000100:00100000:2.0:1789366620.013023:0:8419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 32 00000100:00100000:2.0:1789366620.013075:0:8419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 33 00000100:00100000:2.0:1789366620.013081:0:8419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638bfecaa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:14a2847b-91d8-4d87-b71b-010443acc91a+12:2354:x1876286751396608:12345-192.168.202.23@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789366620.013089:0:8419:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789366620.013093:0:8419:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9638a0741c00/0x8da3486b955f313a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.23@tcp remote: 0xda917a494d06bf42 expref: 12 pid: 5810 timeout: 295 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366620.013113:0:8419:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9638a0741c00/0x8da3486b955f313a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.202.23@tcp remote: 0xda917a494d06bf42 expref: 12 pid: 5810 timeout: 295 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366620.013123:0:8419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9638a0741c00/0x8da3486b955f313a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.202.23@tcp remote: 0xda917a494d06bf42 expref: 12 pid: 5810 timeout: 295 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366620.013135:0:8419:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9638b720c400/0x8da3486b955f329f lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366620.013143:0:8419:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9638b720c400/0x8da3486b955f329f lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366620.013159:0:8419:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9638b720c400/0x8da3486b955f329f lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366620.013166:0:8419:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9638b720c400/0x8da3486b955f329f lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366620.013173:0:8419:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9638b720c400/0x8da3486b955f329f lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366620.013180:0:8419:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9638b720c400/0x8da3486b955f329f lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366620.013186:0:8419:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9638b720c400 already unused, calling callback (ffffffffc16df520) 00010000:00010000:2.0:1789366620.013190:0:8419:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9638b720c400/0x8da3486b955f329f lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366620.013197:0:8419:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9638b720c400/0x8da3486b955f329f lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 11632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366620.013217:0:8419:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9638b720c400/0x8da3486b955f329f lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366620.013226:0:8419:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789366620.013245:0:8419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638bfecaa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:14a2847b-91d8-4d87-b71b-010443acc91a+11:2354:x1876286751396608:12345-192.168.202.23@tcp:103:ldlm_bl.0 Request processed in 164us (956us total) trans 0 rc 0/0 00000100:00100000:2.0:1789366620.013252:0:8419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 33 00010000:00010000:0.0:1789366620.013499:0:11632:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9638b720c400/0x8da3486b955f329f lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366620.013508:0:11632:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9638b720c400/0x8da3486b955f329f lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366620.013514:0:11632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9638b720c400/0x8da3486b955f329f lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366620.216275:0:5805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1789366621.240900:0:5813:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1789366621.240912:0:5813:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff963883577000 from 7 10000000:01000000:1.0:1789366621.240919:0:5813:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1789366621.240984:0:5813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.123@tcp lock: ffff9638b6ce2c00/0x8da3486b955f32a6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366621.240998:0:5813:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.123@tcp lock: ffff9638b6ce2c00/0x8da3486b955f32a6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366621.241011:0:5813:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.123@tcp lock: ffff9638b6ce2c00/0x8da3486b955f32a6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789366621.241043:0:5813:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9638bfecb480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8cde4528-5832-4854-a387-4adacc3dd0ab:5813:1876286758763136:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789366621.241135:0:5813:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789366621.241222:0:5813:0:(client.c:2716:ptlrpc_set_wait()) set ffff9638bf0cb240 going to sleep for 11 seconds 00000100:00100000:3.0:1789366621.241244:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286758763136 00000100:00100000:3.0:1789366621.241258:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286758763136 00000100:00100000:3.0:1789366621.241323:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 237 00000100:00100000:3.0:1789366621.241334:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638b4e3c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8cde4528-5832-4854-a387-4adacc3dd0ab+16:5813:x1876286758763136:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789366621.241350:0:5808:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789366621.241369:0:5808:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9638832d2a00/0x8da3486b955f32ad lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x8da3486b955f32a6 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366621.241396:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9638832d2a00/0x8da3486b955f32ad lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8da3486b955f32a6 expref: 17 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366621.241406:0:5808:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9638832d2a00/0x8da3486b955f32ad lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8da3486b955f32a6 expref: 17 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366621.241415:0:5808:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9638832d2a00, rc 0) 00000100:00100000:3.0:1789366621.241487:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638b4e3c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8cde4528-5832-4854-a387-4adacc3dd0ab+17:5813:x1876286758763136:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 155us (352us total) trans 0 rc 0/0 00000100:00100000:3.0:1789366621.241494:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 237 00000100:00100000:1.0:1789366621.241785:0:5813:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9638bfecb480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8cde4528-5832-4854-a387-4adacc3dd0ab:5813:1876286758763136:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789366621.241807:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.123@tcp lock: ffff9638b6ce2c00/0x8da3486b955f32a6 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8da3486b955f32ad expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366621.241818:0:5813:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.123@tcp lock: ffff9638b6ce2c00/0x8da3486b955f32a6 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x8da3486b955f32ad expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789366621.241907:0:5813:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9638bfecb480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8cde4528-5832-4854-a387-4adacc3dd0ab:5813:1876286758763264:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789366621.241939:0:5813:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789366621.241969:0:5813:0:(client.c:2716:ptlrpc_set_wait()) set ffff9638bf0cb240 going to sleep for 11 seconds 00010000:00010000:2.0:1789366621.242246:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789366621.242347:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286758763264 00000100:00100000:3.0:1789366621.242353:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286758763264 00000100:00100000:3.0:1789366621.242399:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 238 00000100:00100000:3.0:1789366621.242407:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638b4e3d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8cde4528-5832-4854-a387-4adacc3dd0ab+17:5813:x1876286758763264:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789366621.242699:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638b4e3d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8cde4528-5832-4854-a387-4adacc3dd0ab+17:5813:x1876286758763264:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 292us (757us total) trans 0 rc 0/0 00000100:00100000:3.0:1789366621.242706:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 238 00000100:00100000:2.0:1789366621.243078:0:5813:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9638bfecb480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8cde4528-5832-4854-a387-4adacc3dd0ab:5813:1876286758763264:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789366621.243128:0:5813:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9638b702d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8cde4528-5832-4854-a387-4adacc3dd0ab:5813:1876286758763392:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789366621.243186:0:5813:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789366621.243225:0:5813:0:(client.c:2716:ptlrpc_set_wait()) set ffff9638bf1dd600 going to sleep for 11 seconds 00000100:00100000:3.0:1789366621.243371:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286758763392 00000100:00100000:3.0:1789366621.243376:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286758763392 00000100:00100000:3.0:1789366621.243410:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 239 00000100:00100000:3.0:1789366621.243417:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638b4e39450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8cde4528-5832-4854-a387-4adacc3dd0ab+17:5813:x1876286758763392:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789366621.243572:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638b4e39450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8cde4528-5832-4854-a387-4adacc3dd0ab+17:5813:x1876286758763392:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 155us (386us total) trans 0 rc 0/0 00000100:00100000:3.0:1789366621.243579:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 239 00000100:00100000:1.0:1789366621.243653:0:5813:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9638b702d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8cde4528-5832-4854-a387-4adacc3dd0ab:5813:1876286758763392:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789366621.244317:0:11645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9638b702fb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8cde4528-5832-4854-a387-4adacc3dd0ab:11645:1876286758763520:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789366621.244353:0:11645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789366621.244386:0:11645:0:(client.c:2716:ptlrpc_set_wait()) set ffff9638bf1ddf00 going to sleep for 11 seconds 00000100:00100000:1.0:1789366621.244429:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286758763520 00000100:00100000:1.0:1789366621.244434:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286758763520 00000100:00100000:1.0:1789366621.244469:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 240 00000100:00100000:1.0:1789366621.244476:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638b4e38c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8cde4528-5832-4854-a387-4adacc3dd0ab+17:11645:x1876286758763520:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789366621.244636:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638b4e38c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8cde4528-5832-4854-a387-4adacc3dd0ab+17:11645:x1876286758763520:12345-0@lo:502:llog_process_th.0 Request processed in 159us (282us total) trans 0 rc 0/0 00000100:00100000:1.0:1789366621.244643:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 240 00000100:00100000:2.0:1789366621.244771:0:11645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9638b702fb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8cde4528-5832-4854-a387-4adacc3dd0ab:11645:1876286758763520:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1789366621.245030:0:11645:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789366621.245040:0:11645:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789366621.245042:0:11645:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1789366621.245052:0:11645:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff963883577000 00000020:00000080:2.0:1789366621.245054:0:11645:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1789366621.245123:0:11645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9638b702fb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8cde4528-5832-4854-a387-4adacc3dd0ab:11645:1876286758763648:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789366621.245217:0:11645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789366621.245308:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286758763648 00000100:00100000:3.0:1789366621.245313:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286758763648 00000100:00100000:3.0:1789366621.245336:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 241 00000100:00100000:3.0:1789366621.245341:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638b4e39c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8cde4528-5832-4854-a387-4adacc3dd0ab+17:11645:x1876286758763648:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789366621.249994:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638b4e39c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8cde4528-5832-4854-a387-4adacc3dd0ab+17:11645:x1876286758763648:12345-0@lo:502:llog_process_th.0 Request processed in 4645us (4770us total) trans 0 rc 0/0 00000100:00100000:3.0:1789366621.250008:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 241 00000100:00100000:2.0:1789366621.250219:0:11645:0:(client.c:2716:ptlrpc_set_wait()) set ffff9638bf1ddf00 going to sleep for 11 seconds 00000100:00100000:2.0:1789366621.250310:0:11645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9638b702fb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8cde4528-5832-4854-a387-4adacc3dd0ab:11645:1876286758763648:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1789366621.250350:0:11645:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789366621.250358:0:11645:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789366621.250360:0:11645:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:2.0:1789366621.250368:0:11645:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:3.0:1789366621.250648:0:5813:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:3.0:1789366621.250667:0:5813:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.123@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1789366621.250678:0:5813:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.123@tcp lock: ffff9638b6ce2c00/0x8da3486b955f32a6 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8da3486b955f32ad expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366621.250689:0:5813:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.123@tcp lock: ffff9638b6ce2c00/0x8da3486b955f32a6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8da3486b955f32ad expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789366621.250700:0:5813:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1789366621.250703:0:5813:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff963885b46000 from 7 10000000:01000000:3.0:1789366621.250712:0:5813:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1789366621.251058:0:5813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.123@tcp lock: ffff9638832d3e00/0x8da3486b955f32b4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366621.251067:0:5813:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.123@tcp lock: ffff9638832d3e00/0x8da3486b955f32b4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366621.251076:0:5813:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.123@tcp lock: ffff9638832d3e00/0x8da3486b955f32b4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789366621.251096:0:5813:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96388330bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8cde4528-5832-4854-a387-4adacc3dd0ab:5813:1876286758763776:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789366621.251134:0:5813:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789366621.251215:0:5813:0:(client.c:2716:ptlrpc_set_wait()) set ffff9638aef8c900 going to sleep for 11 seconds 00000100:00100000:2.0:1789366621.251765:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286758763776 00000100:00100000:2.0:1789366621.251772:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286758763776 00000100:00100000:2.0:1789366621.251979:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 242 00000100:00100000:2.0:1789366621.251989:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638b4e3bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8cde4528-5832-4854-a387-4adacc3dd0ab+17:5813:x1876286758763776:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789366621.252004:0:5808:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789366621.252017:0:5808:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9638a0741000/0x8da3486b955f32bb lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x8da3486b955f32b4 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366621.252039:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9638a0741000/0x8da3486b955f32bb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8da3486b955f32b4 expref: 18 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366621.252049:0:5808:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9638a0741000/0x8da3486b955f32bb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8da3486b955f32b4 expref: 18 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366621.252058:0:5808:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9638a0741000, rc 0) 00000100:00100000:2.0:1789366621.252104:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638b4e3bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8cde4528-5832-4854-a387-4adacc3dd0ab+18:5813:x1876286758763776:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 117us (969us total) trans 0 rc 0/0 00000100:00100000:2.0:1789366621.252111:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 242 00000100:00100000:2.0:1789366621.252902:0:5813:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96388330bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8cde4528-5832-4854-a387-4adacc3dd0ab:5813:1876286758763776:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789366621.252920:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.123@tcp lock: ffff9638832d3e00/0x8da3486b955f32b4 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8da3486b955f32bb expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366621.252930:0:5813:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.123@tcp lock: ffff9638832d3e00/0x8da3486b955f32b4 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x8da3486b955f32bb expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789366621.253001:0:5813:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9638b702fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8cde4528-5832-4854-a387-4adacc3dd0ab:5813:1876286758763904:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789366621.253033:0:5813:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789366621.253059:0:5813:0:(client.c:2716:ptlrpc_set_wait()) set ffff9638bf1dda80 going to sleep for 11 seconds 00000100:00100000:3.0:1789366621.253737:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286758763904 00000100:00100000:3.0:1789366621.253745:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286758763904 00000100:00100000:3.0:1789366621.253792:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 243 00000100:00100000:3.0:1789366621.253906:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638b4e3b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8cde4528-5832-4854-a387-4adacc3dd0ab+18:5813:x1876286758763904:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789366621.255929:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638b4e3b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8cde4528-5832-4854-a387-4adacc3dd0ab+18:5813:x1876286758763904:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 2123us (2889us total) trans 0 rc 0/0 00000100:00100000:3.0:1789366621.255941:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 243 00000100:00100000:2.0:1789366621.258862:0:5813:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9638b702fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8cde4528-5832-4854-a387-4adacc3dd0ab:5813:1876286758763904:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789366621.258928:0:5813:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9638b702fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8cde4528-5832-4854-a387-4adacc3dd0ab:5813:1876286758764032:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789366621.258996:0:5813:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789366621.259032:0:5813:0:(client.c:2716:ptlrpc_set_wait()) set ffff9638bf1dda80 going to sleep for 11 seconds 00000100:00100000:2.0:1789366621.259053:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286758764032 00000100:00100000:2.0:1789366621.259059:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286758764032 00000100:00100000:2.0:1789366621.259101:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 244 00000100:00100000:2.0:1789366621.259109:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638b4e3ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8cde4528-5832-4854-a387-4adacc3dd0ab+18:5813:x1876286758764032:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789366621.259298:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638b4e3ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8cde4528-5832-4854-a387-4adacc3dd0ab+18:5813:x1876286758764032:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 189us (302us total) trans 0 rc 0/0 00000100:00100000:2.0:1789366621.259316:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 244 00000100:00100000:2.0:1789366621.259365:0:5813:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9638b702fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8cde4528-5832-4854-a387-4adacc3dd0ab:5813:1876286758764032:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789366621.259645:0:11648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9638b702fb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8cde4528-5832-4854-a387-4adacc3dd0ab:11648:1876286758764160:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789366621.259678:0:11648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789366621.259698:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286758764160 00000100:00100000:2.0:1789366621.259702:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286758764160 00000100:00100000:2.0:1789366621.259743:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 245 00000100:00100000:2.0:1789366621.259750:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638b4e38450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8cde4528-5832-4854-a387-4adacc3dd0ab+18:11648:x1876286758764160:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789366621.259941:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638b4e38450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8cde4528-5832-4854-a387-4adacc3dd0ab+18:11648:x1876286758764160:12345-0@lo:502:llog_process_th.0 Request processed in 190us (262us total) trans 0 rc 0/0 00000100:00100000:2.0:1789366621.259956:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 245 00000100:00100000:2.0:1789366621.259984:0:11648:0:(client.c:2716:ptlrpc_set_wait()) set ffff9638bf1dd240 going to sleep for 11 seconds 00000100:00100000:2.0:1789366621.259997:0:11648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9638b702fb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8cde4528-5832-4854-a387-4adacc3dd0ab:11648:1876286758764160:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1789366621.260016:0:11648:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789366621.260025:0:11648:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789366621.260027:0:11648:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1789366621.260036:0:11648:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff963885b46000 00000020:00000080:2.0:1789366621.260038:0:11648:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1789366621.260107:0:11648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9638b702fb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8cde4528-5832-4854-a387-4adacc3dd0ab:11648:1876286758764288:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789366621.260138:0:11648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789366621.260273:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286758764288 00000100:00100000:2.0:1789366621.260278:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286758764288 00000100:00100000:2.0:1789366621.260300:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 246 00000100:00100000:2.0:1789366621.260307:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638b4e3b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8cde4528-5832-4854-a387-4adacc3dd0ab+18:11648:x1876286758764288:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789366621.260407:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638b4e3b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8cde4528-5832-4854-a387-4adacc3dd0ab+18:11648:x1876286758764288:12345-0@lo:502:llog_process_th.0 Request processed in 100us (268us total) trans 0 rc 0/0 00000100:00100000:2.0:1789366621.260414:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 246 00000100:00100000:2.0:1789366621.260443:0:11648:0:(client.c:2716:ptlrpc_set_wait()) set ffff9638bfe9cc00 going to sleep for 11 seconds 00000100:00100000:2.0:1789366621.260454:0:11648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9638b702fb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8cde4528-5832-4854-a387-4adacc3dd0ab:11648:1876286758764288:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1789366621.260469:0:11648:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789366621.260473:0:11648:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789366621.260475:0:11648:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:2.0:1789366621.260479:0:11648:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:2.0:1789366621.262574:0:5813:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:2.0:1789366621.262599:0:5813:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.123@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1789366621.262610:0:5813:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.123@tcp lock: ffff9638832d3e00/0x8da3486b955f32b4 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8da3486b955f32bb expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366621.262630:0:5813:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.123@tcp lock: ffff9638832d3e00/0x8da3486b955f32b4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8da3486b955f32bb expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789366621.262642:0:5813:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1789366621.262645:0:5813:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff963884956000 from 7 10000000:01000000:2.0:1789366621.262648:0:5813:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1789366621.262679:0:5813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.123@tcp lock: ffff9638a0740e00/0x8da3486b955f32c2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366621.262687:0:5813:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.123@tcp lock: ffff9638a0740e00/0x8da3486b955f32c2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366621.262698:0:5813:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.123@tcp lock: ffff9638a0740e00/0x8da3486b955f32c2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789366621.262733:0:5813:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9638b702fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8cde4528-5832-4854-a387-4adacc3dd0ab:5813:1876286758764416:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789366621.262782:0:5813:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789366621.263626:0:5813:0:(client.c:2716:ptlrpc_set_wait()) set ffff9638bfe9cc00 going to sleep for 11 seconds 00000100:00100000:2.0:1789366621.263645:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286758764416 00000100:00100000:2.0:1789366621.263651:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286758764416 00000100:00100000:2.0:1789366621.263690:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 247 00000100:00100000:2.0:1789366621.263699:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638b4e39850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8cde4528-5832-4854-a387-4adacc3dd0ab+18:5813:x1876286758764416:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789366621.263713:0:5808:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789366621.263742:0:5808:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9638a0740a00/0x8da3486b955f32c9 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x8da3486b955f32c2 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366621.264289:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9638a0740a00/0x8da3486b955f32c9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8da3486b955f32c2 expref: 19 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366621.264312:0:5808:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9638a0740a00/0x8da3486b955f32c9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8da3486b955f32c2 expref: 19 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366621.264321:0:5808:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9638a0740a00, rc 0) 00000100:00100000:2.0:1789366621.264370:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638b4e39850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8cde4528-5832-4854-a387-4adacc3dd0ab+19:5813:x1876286758764416:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 671us (1586us total) trans 0 rc 0/0 00000100:00100000:2.0:1789366621.264377:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 247 00000100:00100000:2.0:1789366621.264423:0:5813:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9638b702fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8cde4528-5832-4854-a387-4adacc3dd0ab:5813:1876286758764416:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789366621.264438:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.123@tcp lock: ffff9638a0740e00/0x8da3486b955f32c2 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x8da3486b955f32c9 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366621.264448:0:5813:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.123@tcp lock: ffff9638a0740e00/0x8da3486b955f32c2 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x8da3486b955f32c9 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789366621.264945:0:5813:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9638b702fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8cde4528-5832-4854-a387-4adacc3dd0ab:5813:1876286758764544:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789366621.264974:0:5813:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789366621.264990:0:5813:0:(client.c:2716:ptlrpc_set_wait()) set ffff9638bfe9cc00 going to sleep for 11 seconds 00000100:00100000:2.0:1789366621.265007:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286758764544 00000100:00100000:2.0:1789366621.265011:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286758764544 00000100:00100000:2.0:1789366621.265037:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 248 00000100:00100000:2.0:1789366621.265043:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638b4e3a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8cde4528-5832-4854-a387-4adacc3dd0ab+19:5813:x1876286758764544:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789366621.265734:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638b4e3a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8cde4528-5832-4854-a387-4adacc3dd0ab+19:5813:x1876286758764544:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 671us (739us total) trans 0 rc 0/0 00000100:00100000:2.0:1789366621.265743:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 248 00000100:00100000:2.0:1789366621.265914:0:5813:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9638b702fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8cde4528-5832-4854-a387-4adacc3dd0ab:5813:1876286758764544:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789366621.265957:0:5813:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9638b702fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8cde4528-5832-4854-a387-4adacc3dd0ab:5813:1876286758764672:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789366621.265992:0:5813:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789366621.266006:0:5813:0:(client.c:2716:ptlrpc_set_wait()) set ffff9638bfe9cc00 going to sleep for 11 seconds 00000100:00100000:2.0:1789366621.266020:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286758764672 00000100:00100000:2.0:1789366621.266024:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286758764672 00000100:00100000:2.0:1789366621.266046:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 249 00000100:00100000:2.0:1789366621.266052:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638b4e3a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8cde4528-5832-4854-a387-4adacc3dd0ab+19:5813:x1876286758764672:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789366621.267587:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638b4e3a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8cde4528-5832-4854-a387-4adacc3dd0ab+19:5813:x1876286758764672:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 1529us (1589us total) trans 0 rc 0/0 00000100:00100000:2.0:1789366621.267599:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 249 00000100:00100000:1.0:1789366621.269267:0:5813:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9638b702fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8cde4528-5832-4854-a387-4adacc3dd0ab:5813:1876286758764672:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789366621.270139:0:11649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9638b702c700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8cde4528-5832-4854-a387-4adacc3dd0ab:11649:1876286758764800:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789366621.270213:0:11649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789366621.270260:0:11649:0:(client.c:2716:ptlrpc_set_wait()) set ffff9638bfe9cb40 going to sleep for 11 seconds 00000100:00100000:1.0:1789366621.270349:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286758764800 00000100:00100000:1.0:1789366621.270357:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286758764800 00000100:00100000:1.0:1789366621.270400:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 250 00000100:00100000:1.0:1789366621.270409:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638b4e3a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8cde4528-5832-4854-a387-4adacc3dd0ab+19:11649:x1876286758764800:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789366621.270611:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638b4e3a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8cde4528-5832-4854-a387-4adacc3dd0ab+19:11649:x1876286758764800:12345-0@lo:502:llog_process_th.0 Request processed in 202us (397us total) trans 0 rc 0/0 00000100:00100000:1.0:1789366621.270619:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 250 00000100:00100000:2.0:1789366621.271592:0:11649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9638b702c700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8cde4528-5832-4854-a387-4adacc3dd0ab:11649:1876286758764800:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1789366621.271634:0:11649:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789366621.271643:0:11649:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789366621.271645:0:11649:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1789366621.271655:0:11649:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff963884956000 00000020:00000080:2.0:1789366621.271657:0:11649:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1789366621.271765:0:11649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9638b702c700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8cde4528-5832-4854-a387-4adacc3dd0ab:11649:1876286758764928:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789366621.272286:0:11649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789366621.272325:0:11649:0:(client.c:2716:ptlrpc_set_wait()) set ffff9638bfe9cb40 going to sleep for 11 seconds 00000100:00100000:1.0:1789366621.272778:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286758764928 00000100:00100000:1.0:1789366621.272784:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286758764928 00000100:00100000:1.0:1789366621.272966:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 251 00000100:00100000:1.0:1789366621.272974:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638b4e3b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8cde4528-5832-4854-a387-4adacc3dd0ab+19:11649:x1876286758764928:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789366621.273138:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638b4e3b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8cde4528-5832-4854-a387-4adacc3dd0ab+19:11649:x1876286758764928:12345-0@lo:502:llog_process_th.0 Request processed in 164us (852us total) trans 0 rc 0/0 00000100:00100000:1.0:1789366621.273928:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 251 00000100:00100000:2.0:1789366621.274040:0:11649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9638b702c700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8cde4528-5832-4854-a387-4adacc3dd0ab:11649:1876286758764928:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1789366621.274066:0:11649:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789366621.274073:0:11649:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789366621.274080:0:11649:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:2.0:1789366621.274087:0:11649:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:1.0:1789366621.274208:0:5813:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:1.0:1789366621.274230:0:5813:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.123@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1789366621.274239:0:5813:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.123@tcp lock: ffff9638a0740e00/0x8da3486b955f32c2 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x8da3486b955f32c9 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366621.274256:0:5813:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.123@tcp lock: ffff9638a0740e00/0x8da3486b955f32c2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x8da3486b955f32c9 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1789366621.279491:0:11650:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1789366621.580886:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:2.0:1789366621.580975:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751396736 00000100:00100000:2.0:1789366621.580986:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751396736 00000100:00100000:2.0:1789366621.581042:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 252 00000100:00100000:2.0:1789366621.581052:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638b4e39050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:14a2847b-91d8-4d87-b71b-010443acc91a+11:5583:x1876286751396736:12345-192.168.202.23@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789366621.581067:0:5811:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789366621.581084:0:5811:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9638a0740600/0x8da3486b955f32d0 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xda917a494d06bf96 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366621.581114:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9638a0740600/0x8da3486b955f32d0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.202.23@tcp remote: 0xda917a494d06bf96 expref: 12 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366621.581126:0:5811:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9638a0740600/0x8da3486b955f32d0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.202.23@tcp remote: 0xda917a494d06bf96 expref: 12 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366621.581146:0:5811:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9638a0740600, rc 0) 00000100:00100000:2.0:1789366621.581208:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638b4e39050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:14a2847b-91d8-4d87-b71b-010443acc91a+12:5583:x1876286751396736:12345-192.168.202.23@tcp:101:ll_cfg_requeue.0 Request processed in 157us (333us total) trans 0 rc 0/0 00000100:00100000:2.0:1789366621.581216:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 252 00000100:00100000:2.0:1789366621.587920:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:1.0:1789366621.588018:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751396864 00000100:00100000:1.0:1789366621.588029:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751396864 00000100:00100000:1.0:1789366621.588084:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 253 00000100:00100000:1.0:1789366621.588094:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638b4e38850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:14a2847b-91d8-4d87-b71b-010443acc91a+12:5583:x1876286751396864:12345-192.168.202.23@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789366621.588419:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638b4e38850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:14a2847b-91d8-4d87-b71b-010443acc91a+12:5583:x1876286751396864:12345-192.168.202.23@tcp:501:ll_cfg_requeue.0 Request processed in 325us (508us total) trans 0 rc 0/0 00000100:00100000:1.0:1789366621.588428:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 253 00000100:00100000:3.0:1789366621.595124:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:1.0:1789366621.595214:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751396992 00000100:00100000:1.0:1789366621.595224:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751396992 00000100:00100000:1.0:1789366621.595290:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 254 00000100:00100000:1.0:1789366621.595301:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638b4e38050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:14a2847b-91d8-4d87-b71b-010443acc91a+12:5583:x1876286751396992:12345-192.168.202.23@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789366621.595552:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638b4e38050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:14a2847b-91d8-4d87-b71b-010443acc91a+12:5583:x1876286751396992:12345-192.168.202.23@tcp:503:ll_cfg_requeue.0 Request processed in 252us (435us total) trans 0 rc 0/0 00000100:00100000:1.0:1789366621.595560:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 254 00000100:00100000:3.0:1789366621.604339:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:2.0:1789366621.611010:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751397120 00000100:00100000:2.0:1789366621.611024:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751397120 00000100:00100000:2.0:1789366621.611102:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 255 00000100:00100000:2.0:1789366621.611113:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638987e6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:14a2847b-91d8-4d87-b71b-010443acc91a+12:9947:x1876286751397120:12345-192.168.202.23@tcp:502:llog_process_th.0 00000100:00100000:2.0:1789366621.611943:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638987e6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:14a2847b-91d8-4d87-b71b-010443acc91a+12:9947:x1876286751397120:12345-192.168.202.23@tcp:502:llog_process_th.0 Request processed in 829us (7619us total) trans 0 rc 0/0 00000100:00100000:2.0:1789366621.611962:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 255 00000100:00100000:3.0:1789366621.617008:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:1.0:1789366621.619437:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751397248 00000100:00100000:1.0:1789366621.619450:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751397248 00000100:00100000:1.0:1789366621.619523:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 256 00000100:00100000:1.0:1789366621.619533:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638b4e84050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:14a2847b-91d8-4d87-b71b-010443acc91a+12:9947:x1876286751397248:12345-192.168.202.23@tcp:502:llog_process_th.0 00000100:00100000:1.0:1789366621.619820:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638b4e84050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:14a2847b-91d8-4d87-b71b-010443acc91a+12:9947:x1876286751397248:12345-192.168.202.23@tcp:502:llog_process_th.0 Request processed in 287us (2821us total) trans 0 rc 0/0 00000100:00100000:1.0:1789366621.619838:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 256 00000100:00100000:3.0:1789366621.632188:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:2.0:1789366621.634525:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751397376 00000100:00100000:2.0:1789366621.634539:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751397376 00000100:00100000:2.0:1789366621.634663:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 257 00000100:00100000:2.0:1789366621.634675:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638b4e85450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:14a2847b-91d8-4d87-b71b-010443acc91a+12:5583:x1876286751397376:12345-192.168.202.23@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789366621.634691:0:5811:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789366621.634710:0:5811:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9638a0741c00/0x8da3486b955f32d7 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xda917a494d06bf9d expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366621.634775:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9638a0741c00/0x8da3486b955f32d7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.202.23@tcp remote: 0xda917a494d06bf9d expref: 13 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366621.634788:0:5811:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9638a0741c00/0x8da3486b955f32d7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.202.23@tcp remote: 0xda917a494d06bf9d expref: 13 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366621.634797:0:5811:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9638a0741c00, rc 0) 00000100:00100000:2.0:1789366621.634919:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638b4e85450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:14a2847b-91d8-4d87-b71b-010443acc91a+13:5583:x1876286751397376:12345-192.168.202.23@tcp:101:ll_cfg_requeue.0 Request processed in 246us (2740us total) trans 0 rc 0/0 00000100:00100000:2.0:1789366621.634926:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 257 00000100:00100000:3.0:1789366621.658940:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:2.0:1789366621.659037:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751397504 00000100:00100000:2.0:1789366621.659048:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751397504 00000100:00100000:2.0:1789366621.659105:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 258 00000100:00100000:2.0:1789366621.659116:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638b4e84c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:14a2847b-91d8-4d87-b71b-010443acc91a+13:5583:x1876286751397504:12345-192.168.202.23@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789366621.659815:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638b4e84c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:14a2847b-91d8-4d87-b71b-010443acc91a+13:5583:x1876286751397504:12345-192.168.202.23@tcp:501:ll_cfg_requeue.0 Request processed in 699us (883us total) trans 0 rc 0/0 00000100:00100000:2.0:1789366621.659824:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 258 00000100:00100000:3.0:1789366621.671374:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:2.0:1789366621.675530:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751397632 00000100:00100000:2.0:1789366621.675544:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751397632 00000100:00100000:2.0:1789366621.675619:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 259 00000100:00100000:2.0:1789366621.675630:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638b4e85c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:14a2847b-91d8-4d87-b71b-010443acc91a+13:5583:x1876286751397632:12345-192.168.202.23@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789366621.675917:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638b4e85c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:14a2847b-91d8-4d87-b71b-010443acc91a+13:5583:x1876286751397632:12345-192.168.202.23@tcp:503:ll_cfg_requeue.0 Request processed in 288us (4558us total) trans 0 rc 0/0 00000100:00100000:2.0:1789366621.675925:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 259 00000100:00100000:3.0:1789366621.681049:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:1.0:1789366621.694879:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751397760 00000100:00100000:1.0:1789366621.694896:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751397760 00000100:00100000:1.0:1789366621.694973:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 260 00000100:00100000:1.0:1789366621.694984:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638b4e87850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:14a2847b-91d8-4d87-b71b-010443acc91a+13:9950:x1876286751397760:12345-192.168.202.23@tcp:502:llog_process_th.0 00000100:00100000:1.0:1789366621.695247:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638b4e87850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:14a2847b-91d8-4d87-b71b-010443acc91a+13:9950:x1876286751397760:12345-192.168.202.23@tcp:502:llog_process_th.0 Request processed in 264us (14206us total) trans 0 rc 0/0 00000100:00100000:1.0:1789366621.695256:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 260 00000100:00100000:3.0:1789366621.701837:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:1.0:1789366621.703770:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751397888 00000100:00100000:1.0:1789366621.703783:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751397888 00000100:00100000:1.0:1789366621.703856:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 261 00000100:00100000:1.0:1789366621.703866:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638b4e87c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:14a2847b-91d8-4d87-b71b-010443acc91a+13:9950:x1876286751397888:12345-192.168.202.23@tcp:502:llog_process_th.0 00000100:00100000:1.0:1789366621.704115:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638b4e87c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:14a2847b-91d8-4d87-b71b-010443acc91a+13:9950:x1876286751397888:12345-192.168.202.23@tcp:502:llog_process_th.0 Request processed in 250us (2285us total) trans 0 rc 0/0 00000100:00100000:1.0:1789366621.704124:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 261 00000100:00100000:3.0:1789366621.911583:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:3.0:1789366621.911648:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:3.0:1789366621.911685:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:2.0:1789366621.911894:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751398144 00000100:00100000:2.0:1789366621.911904:0:6661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751398144 00000100:00100000:2.0:1789366621.911963:0:6661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 38 00000100:00100000:2.0:1789366621.911973:0:6661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963883308e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0ab23baa-a205-44ad-bf17-f7b47295d82b+5:2354:x1876286751398144:12345-192.168.202.23@tcp:400:kworker.0 00000100:00100000:2.0:1789366621.912040:0:6661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963883308e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0ab23baa-a205-44ad-bf17-f7b47295d82b+5:2354:x1876286751398144:12345-192.168.202.23@tcp:400:kworker.0 Request processed in 69us (354us total) trans 0 rc 0/0 00000100:00100000:2.0:1789366621.912047:0:6661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 38 00000100:00100000:0.0:1789366621.912220:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751398016 00000100:00100000:0.0:1789366621.912225:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751398016 00000100:00100000:0.0:1789366621.912262:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751398272 00000100:00100000:0.0:1789366621.912265:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751398272 00000100:00100000:0.0:1789366621.912286:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 80 00000100:00100000:0.0:1789366621.912293:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96388330a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0ab23baa-a205-44ad-bf17-f7b47295d82b+5:2354:x1876286751398016:12345-192.168.202.23@tcp:400:kworker.0 00000100:00100000:0.0:1789366621.912327:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96388330a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0ab23baa-a205-44ad-bf17-f7b47295d82b+5:2354:x1876286751398016:12345-192.168.202.23@tcp:400:kworker.0 Request processed in 34us (752us total) trans 0 rc 0/0 00000100:00100000:0.0:1789366621.912333:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 80 00000100:00100000:0.0:1789366621.912347:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 81 00000100:00100000:0.0:1789366621.912354:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963883309500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b9764435-e52f-45ac-a5f9-bab1231105ac+5:2354:x1876286751398272:12345-192.168.202.23@tcp:400:kworker.0 00000100:00100000:0.0:1789366621.912376:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963883309500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b9764435-e52f-45ac-a5f9-bab1231105ac+5:2354:x1876286751398272:12345-192.168.202.23@tcp:400:kworker.0 Request processed in 23us (728us total) trans 0 rc 0/0 00000100:00100000:0.0:1789366621.912382:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 81 00000100:00080000:3.0:1789366621.913071:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789366621.913076:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789366622.153113:0:3286:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9638b702e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3286:1876286758765440:0@lo:400:kworker.0 00000100:00100000:2.0:1789366622.153181:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789366622.153201:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9638b702ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3284:1876286758765184:0@lo:400:kworker.0 00000100:00100000:3.0:1789366622.153232:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789366622.153251:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9638b702d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3284:1876286758765696:0@lo:400:kworker.0 00000100:00100000:2.0:1789366622.153252:0:3286:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1789366622.153257:0:3286:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9638b702c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8cde4528-5832-4854-a387-4adacc3dd0ab:3286:1876286758765056:0@lo:400:kworker.0 00000100:00100000:3.0:1789366622.153281:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789366622.153281:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789366622.153303:0:3286:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9638b702dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3286:1876286758765568:0@lo:400:kworker.0 00000100:00100000:3.0:1789366622.153304:0:3284:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789366622.153308:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9638b702ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3284:1876286758765312:0@lo:400:kworker.0 00000100:00100000:2.0:1789366622.153323:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789366622.153338:0:7614:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286758765184 00000100:00100000:3.0:1789366622.153344:0:7614:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286758765184 00000100:00100000:2.0:1789366622.153348:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286758765568 00000100:00100000:2.0:1789366622.153350:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286758765568 00000100:00100000:2.0:1789366622.153395:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1789366622.153404:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638b702fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3286:x1876286758765568:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789366622.153461:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638b702fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3286:x1876286758765568:12345-0@lo:400:kworker.0 Request processed in 58us (136us total) trans 0 rc 0/0 00000100:00100000:2.0:1789366622.153469:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1789366622.153479:0:7614:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1789366622.153485:0:7614:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96388330bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3284:x1876286758765184:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789366622.153522:0:3286:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9638b702dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3286:1876286758765568:0@lo:400:kworker.0 00000100:00100000:3.0:1789366622.153527:0:7614:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96388330bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3284:x1876286758765184:12345-0@lo:400:kworker.0 Request processed in 42us (295us total) trans 0 rc 0/0 00000100:00100000:3.0:1789366622.153532:0:7614:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1789366622.153544:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286758765056 00000100:00100000:2.0:1789366622.153547:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286758765056 00000100:00100000:3.0:1789366622.153550:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286758765440 00000100:00100000:3.0:1789366622.153552:0:6659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286758765440 00000100:00100000:2.0:1789366622.153569:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 262 00000100:00100000:3.0:1789366622.153571:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286758765696 00000100:00100000:3.0:1789366622.153573:0:6659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286758765696 00000100:00100000:2.0:1789366622.153574:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638b4e86c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8cde4528-5832-4854-a387-4adacc3dd0ab+19:3286:x1876286758765056:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789366622.153590:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1789366622.153595:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638b702d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3286:x1876286758765440:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789366622.153605:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638b4e86c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8cde4528-5832-4854-a387-4adacc3dd0ab+19:3286:x1876286758765056:12345-0@lo:400:kworker.0 Request processed in 31us (323us total) trans 0 rc 0/0 00000100:00100000:2.0:1789366622.153617:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 262 00000100:00100000:3.0:1789366622.153622:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638b702d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3286:x1876286758765440:12345-0@lo:400:kworker.0 Request processed in 27us (441us total) trans 0 rc 0/0 00000100:00100000:3.0:1789366622.153627:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1789366622.153635:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1789366622.153647:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963883309c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3284:x1876286758765696:12345-0@lo:400:kworker.0 00000100:00080000:0.0:1789366622.153779:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789366622.153783:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789366622.153786:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789366622.154393:0:3286:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9638b702c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8cde4528-5832-4854-a387-4adacc3dd0ab:3286:1876286758765056:0@lo:400:kworker.0 00000100:00100000:1.0:1789366622.154406:0:3286:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9638b702e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3286:1876286758765440:0@lo:400:kworker.0 00000100:00100000:2.0:1789366622.154573:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789366622.154607:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9638b702ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3284:1876286758765184:0@lo:400:kworker.0 00000100:00100000:2.0:1789366622.154617:0:3284:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789366622.154625:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9638bfec8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3284:1876286758765824:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789366622.154653:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789366622.154760:0:6663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286758765824 00000100:00100000:2.0:1789366622.154765:0:6663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286758765824 00000100:00100000:2.0:1789366622.154850:0:6663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1789366622.154859:0:6663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638b702ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3284:x1876286758765824:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789366622.154890:0:6663:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789366622.154942:0:6663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638b702ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3284:x1876286758765824:12345-0@lo:13:osp-pre-1-0.0 Request processed in 84us (287us total) trans 0 rc 0/0 00000100:00100000:2.0:1789366622.154948:0:6663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1789366622.155145:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286758765312 00000100:00100000:1.0:1789366622.155151:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286758765312 00000100:00100000:1.0:1789366622.155195:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1789366622.155202:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638b702dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3284:x1876286758765312:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789366622.155249:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638b702dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3284:x1876286758765312:12345-0@lo:400:kworker.0 Request processed in 47us (676us total) trans 0 rc 0/0 00000100:00100000:1.0:1789366622.155255:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00080000:2.0:1789366622.155421:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789366622.155580:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963883309c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3284:x1876286758765696:12345-0@lo:400:kworker.0 Request processed in 1931us (2306us total) trans 0 rc 0/0 00000100:00100000:3.0:1789366622.155587:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00010000:00080000:0.0:1789366622.156684:0:3284:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9638bfec8000 x1876286758765824/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789366638 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789366622.156758:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9638bfec8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3284:1876286758765824:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789366622.156777:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9638b702ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3284:1876286758765312:0@lo:400:kworker.0 00010000:00080000:0.0:1789366622.156788:0:3284:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9638b702d180 x1876286758765696/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789366638 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789366622.156808:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9638b702d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3284:1876286758765696:0@lo:400:kworker.0 00010000:00010000:2.0:1789366622.264124:0:6675:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1789366622.328475:0:11650:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1789366623.288532:0:5805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789366624.316022:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789366624.696759:0:3286:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9638bfec8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3286:1876286758765952:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789366624.696833:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789366624.697124:0:6662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286758765952 00000100:00100000:1.0:1789366624.697133:0:6662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286758765952 00000100:00100000:1.0:1789366624.697196:0:6662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1789366624.697216:0:6662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638bf5ab100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3286:x1876286758765952:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789366624.697262:0:6662:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789366624.697307:0:6662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638bf5ab100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3286:x1876286758765952:12345-0@lo:13:osp-pre-0-0.0 Request processed in 103us (474us total) trans 0 rc 0/0 00000100:00100000:1.0:1789366624.697314:0:6662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00080000:0.0:1789366624.697672:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789366624.697742:0:3286:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9638bfec8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3286:1876286758765952:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1789366625.335947:0:6675:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789366626.359896:0:5805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789366627.021136:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:3.0:1789366627.021189:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:2.0:1789366627.021299:0:7132:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751398528 00000100:00100000:2.0:1789366627.021310:0:7132:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751398528 00000100:00080000:0.0:1789366627.021347:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789366627.021369:0:7132:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751398784 00000100:00100000:2.0:1789366627.021372:0:7132:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751398784 00000100:00100000:0.0:1789366627.021385:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 85 00000100:00100000:0.0:1789366627.021400:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963883309180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0ab23baa-a205-44ad-bf17-f7b47295d82b+5:2357:x1876286751398528:12345-192.168.202.23@tcp:400:kworker.0 00000100:00100000:2.0:1789366627.021407:0:7132:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 86 00000100:00100000:2.0:1789366627.021418:0:7132:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96388330a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b9764435-e52f-45ac-a5f9-bab1231105ac+5:2357:x1876286751398784:12345-192.168.202.23@tcp:400:kworker.0 00000100:00100000:3.0:1789366627.021539:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:2.0:1789366627.021567:0:7132:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96388330a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b9764435-e52f-45ac-a5f9-bab1231105ac+5:2357:x1876286751398784:12345-192.168.202.23@tcp:400:kworker.0 Request processed in 150us (376us total) trans 0 rc 0/0 00000100:00100000:2.0:1789366627.021575:0:7132:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 86 00000100:00100000:2.0:1789366627.021600:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751398400 00000100:00100000:2.0:1789366627.021603:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751398400 00000100:00100000:2.0:1789366627.021627:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 263 00000100:00100000:2.0:1789366627.021705:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638b4e84450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:14a2847b-91d8-4d87-b71b-010443acc91a+13:2357:x1876286751398400:12345-192.168.202.23@tcp:400:kworker.0 00000100:00080000:1.0:1789366627.030387:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789366627.031784:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963883309180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0ab23baa-a205-44ad-bf17-f7b47295d82b+5:2357:x1876286751398528:12345-192.168.202.23@tcp:400:kworker.0 Request processed in 10380us (11194us total) trans 0 rc 0/0 00000100:00100000:1.0:1789366627.031838:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:1.0:1789366627.031873:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751398656 00000100:00100000:1.0:1789366627.031882:0:6660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751398656 00000100:00100000:1.0:1789366627.031939:0:6660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 41 00000100:00100000:1.0:1789366627.031949:0:6660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638bfecb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0ab23baa-a205-44ad-bf17-f7b47295d82b+5:2357:x1876286751398656:12345-192.168.202.23@tcp:400:kworker.0 00000100:00100000:0.0:1789366627.031970:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 85 00000100:00080000:0.0:1789366627.032009:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789366627.032026:0:6660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638bfecb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0ab23baa-a205-44ad-bf17-f7b47295d82b+5:2357:x1876286751398656:12345-192.168.202.23@tcp:400:kworker.0 Request processed in 77us (187us total) trans 0 rc 0/0 00000100:00100000:1.0:1789366627.032034:0:6660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 41 00000100:00100000:2.0:1789366627.034298:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638b4e84450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:14a2847b-91d8-4d87-b71b-010443acc91a+13:2357:x1876286751398400:12345-192.168.202.23@tcp:400:kworker.0 Request processed in 12655us (12751us total) trans 0 rc 0/0 00000100:00100000:2.0:1789366627.034311:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 263 00000100:00100000:0.0:1789366627.256159:0:3287:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9638bfec9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3287:1876286758766080:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789366627.256239:0:3287:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789366627.257325:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9638bf5aaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3285:1876286758766336:0@lo:400:kworker.0 00000100:00100000:0.0:1789366627.257367:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789366627.257392:0:3285:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1789366627.257398:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9638bf5a9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8cde4528-5832-4854-a387-4adacc3dd0ab:3285:1876286758766208:0@lo:400:kworker.0 00000100:00100000:0.0:1789366627.257442:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789366627.257478:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9638b70ce300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3285:1876286758766720:0@lo:400:kworker.0 00000100:00100000:0.0:1789366627.257501:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789366627.257527:0:3287:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9638bf5a8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3287:1876286758766592:0@lo:400:kworker.0 00000100:00100000:0.0:1789366627.257552:0:3287:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789366627.257569:0:3287:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789366627.257575:0:3287:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9638bf5a9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3287:1876286758766464:0@lo:400:kworker.0 00000100:00100000:0.0:1789366627.257610:0:3287:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789366627.257636:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286758766592 00000100:00100000:0.0:1789366627.257643:0:6661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286758766592 00000100:00100000:0.0:1789366627.257696:0:6661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1789366627.257705:0:6661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638bf4b0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3287:x1876286758766592:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789366627.257780:0:6661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638bf4b0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3287:x1876286758766592:12345-0@lo:400:kworker.0 Request processed in 76us (227us total) trans 0 rc 0/0 00000100:00100000:0.0:1789366627.257788:0:6661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00080000:0.0:1789366627.257808:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789366627.257846:0:3287:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9638bf5a8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3287:1876286758766592:0@lo:400:kworker.0 00000100:00100000:1.0:1789366627.258289:0:6663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286758766080 00000100:00100000:1.0:1789366627.258295:0:6663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286758766080 00000100:00100000:1.0:1789366627.258342:0:6663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1789366627.258350:0:6663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638bf5ab800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3287:x1876286758766080:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789366627.258380:0:6663:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789366627.258422:0:6663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638bf5ab800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3287:x1876286758766080:12345-0@lo:13:osp-pre-1-0.0 Request processed in 73us (2183us total) trans 0 rc 0/0 00000100:00100000:1.0:1789366627.258429:0:6663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1789366627.258448:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286758766336 00000100:00100000:1.0:1789366627.258464:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286758766336 00000100:00100000:1.0:1789366627.258497:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286758766720 00000100:00100000:1.0:1789366627.258501:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286758766720 00000100:00100000:1.0:1789366627.258518:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286758766464 00000100:00100000:1.0:1789366627.258521:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286758766464 00000100:00100000:1.0:1789366627.258534:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1789366627.258540:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638b70cea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3285:x1876286758766336:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789366627.258587:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638b70cea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3285:x1876286758766336:12345-0@lo:400:kworker.0 Request processed in 47us (1220us total) trans 0 rc 0/0 00000100:00100000:1.0:1789366627.258594:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1789366627.258605:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1789366627.258611:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638bf4b3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3285:x1876286758766720:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789366627.258636:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638bf4b3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3285:x1876286758766720:12345-0@lo:400:kworker.0 Request processed in 25us (1133us total) trans 0 rc 0/0 00000100:00100000:1.0:1789366627.258643:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1789366627.258654:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1789366627.258662:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638bf4b0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3287:x1876286758766464:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789366627.258683:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286758766208 00000100:00100000:1.0:1789366627.258689:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638bf4b0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3287:x1876286758766464:12345-0@lo:400:kworker.0 Request processed in 28us (1078us total) trans 0 rc 0/0 00000100:00100000:2.0:1789366627.258690:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286758766208 00000100:00100000:1.0:1789366627.258698:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1789366627.258758:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 264 00000100:00100000:2.0:1789366627.258767:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638b4e87050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8cde4528-5832-4854-a387-4adacc3dd0ab+19:3285:x1876286758766208:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789366627.258779:0:3287:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9638bf5a9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3287:1876286758766464:0@lo:400:kworker.0 00010000:00080000:1.0:1789366627.258796:0:3287:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9638bfec9180 x1876286758766080/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789366643 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789366627.258809:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638b4e87050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8cde4528-5832-4854-a387-4adacc3dd0ab+19:3285:x1876286758766208:12345-0@lo:400:kworker.0 Request processed in 43us (1364us total) trans 0 rc 0/0 00000100:00100000:1.0:1789366627.258814:0:3287:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9638bfec9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3287:1876286758766080:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789366627.258820:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 264 00000100:00080000:0.0:1789366627.264174:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789366627.264185:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789366627.264239:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9638bf5a9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8cde4528-5832-4854-a387-4adacc3dd0ab:3285:1876286758766208:0@lo:400:kworker.0 00000100:00100000:0.0:1789366627.264258:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9638b70ce300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3285:1876286758766720:0@lo:400:kworker.0 00000100:00100000:0.0:1789366627.264270:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9638bf5aaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3285:1876286758766336:0@lo:400:kworker.0 00010000:00010000:2.0:1789366627.392062:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789366628.407999:0:6675:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789366629.431962:0:5805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789366629.816066:0:3284:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789366629.816104:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9638bfec9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3284:1876286758766848:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789366629.816175:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789366629.816230:0:7134:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286758766848 00000100:00100000:0.0:1789366629.816240:0:7134:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286758766848 00000100:00080000:2.0:1789366629.816278:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789366629.816306:0:7134:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1789366629.816329:0:7134:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638b702d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1876286758766848:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789366629.816365:0:7134:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789366629.816420:0:7134:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638b702d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1876286758766848:12345-0@lo:13:osp-pre-0-0.0 Request processed in 93us (245us total) trans 0 rc 0/0 00000100:00100000:0.0:1789366629.816426:0:7134:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1789366629.816710:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9638bfec9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3284:1876286758766848:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1789366630.457619:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789366631.480004:0:6675:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789366632.143342:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:3.0:1789366632.143377:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:3.0:1789366632.143439:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:0.0:1789366632.143489:0:8065:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751399168 00000100:00100000:0.0:1789366632.143507:0:8065:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751399168 00000100:00100000:0.0:1789366632.143609:0:8065:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 43 00000100:00100000:0.0:1789366632.143621:0:8065:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963883308a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0ab23baa-a205-44ad-bf17-f7b47295d82b+5:2355:x1876286751399168:12345-192.168.202.23@tcp:400:kworker.0 00000100:00100000:3.0:1789366632.143707:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:0.0:1789366632.144010:0:8065:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963883308a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0ab23baa-a205-44ad-bf17-f7b47295d82b+5:2355:x1876286751399168:12345-192.168.202.23@tcp:400:kworker.0 Request processed in 386us (626us total) trans 0 rc 0/0 00000100:00100000:0.0:1789366632.144018:0:8065:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 43 00000100:00100000:1.0:1789366632.144273:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751399040 00000100:00100000:1.0:1789366632.144284:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751399040 00000100:00100000:2.0:1789366632.144297:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751398912 00000100:00100000:2.0:1789366632.144305:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751398912 00000100:00100000:1.0:1789366632.144347:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751399296 00000100:00100000:2.0:1789366632.144357:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 265 00000100:00100000:1.0:1789366632.144366:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751399296 00000100:00100000:2.0:1789366632.144369:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638b4e85850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:14a2847b-91d8-4d87-b71b-010443acc91a+13:2355:x1876286751398912:12345-192.168.202.23@tcp:400:kworker.0 00000100:00100000:1.0:1789366632.144423:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 90 00000100:00100000:1.0:1789366632.144434:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96388330b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0ab23baa-a205-44ad-bf17-f7b47295d82b+5:2355:x1876286751399040:12345-192.168.202.23@tcp:400:kworker.0 00000100:00100000:0.0:1789366632.147073:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 91 00000100:00100000:0.0:1789366632.147099:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96388330b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b9764435-e52f-45ac-a5f9-bab1231105ac+5:2355:x1876286751399296:12345-192.168.202.23@tcp:400:kworker.0 00000100:00100000:0.0:1789366632.147174:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96388330b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b9764435-e52f-45ac-a5f9-bab1231105ac+5:2355:x1876286751399296:12345-192.168.202.23@tcp:400:kworker.0 Request processed in 88us (3470us total) trans 0 rc 0/0 00000100:00100000:0.0:1789366632.147182:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 91 00000100:00080000:0.0:1789366632.147261:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789366632.147267:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789366632.147669:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638b4e85850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:14a2847b-91d8-4d87-b71b-010443acc91a+13:2355:x1876286751398912:12345-192.168.202.23@tcp:400:kworker.0 Request processed in 3301us (4335us total) trans 0 rc 0/0 00000100:00100000:2.0:1789366632.147679:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 265 00000100:00100000:1.0:1789366632.148289:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96388330b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0ab23baa-a205-44ad-bf17-f7b47295d82b+5:2355:x1876286751399040:12345-192.168.202.23@tcp:400:kworker.0 Request processed in 3844us (4836us total) trans 0 rc 0/0 00000100:00100000:1.0:1789366632.148305:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 90 00000040:00080000:3.0:1789366632.184638:0:11650:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1789366632.376178:0:3287:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789366632.376206:0:3287:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9638bfec8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3287:1876286758766976:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789366632.376279:0:3287:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789366632.376488:0:6662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286758766976 00000100:00100000:1.0:1789366632.376497:0:6662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286758766976 00000100:00100000:1.0:1789366632.376559:0:6662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1789366632.376568:0:6662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638bf4b1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3287:x1876286758766976:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789366632.376615:0:6662:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789366632.376664:0:6662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638bf4b1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3287:x1876286758766976:12345-0@lo:13:osp-pre-1-0.0 Request processed in 97us (385us total) trans 0 rc 0/0 00000100:00100000:1.0:1789366632.376671:0:6662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00080000:0.0:1789366632.376971:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:2.0:1789366632.377277:0:3287:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9638bfec8e00 x1876286758766976/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789366648 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789366632.377306:0:3287:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9638bfec8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3287:1876286758766976:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789366632.377636:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9638b6ea0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3285:1876286758767360:0@lo:400:kworker.0 00000100:00100000:0.0:1789366632.377677:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789366632.377770:0:3285:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789366632.377777:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96388330aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3285:1876286758767232:0@lo:400:kworker.0 00000100:00100000:0.0:1789366632.377801:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789366632.377826:0:3286:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9638b6ea3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3286:1876286758767488:0@lo:400:kworker.0 00000100:00100000:0.0:1789366632.377852:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789366632.377870:0:3286:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1789366632.377875:0:3286:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff963883309f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8cde4528-5832-4854-a387-4adacc3dd0ab:3286:1876286758767104:0@lo:400:kworker.0 00000100:00100000:0.0:1789366632.377901:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789366632.377922:0:3286:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9638b6ea3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3286:1876286758767616:0@lo:400:kworker.0 00000100:00100000:0.0:1789366632.377942:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789366632.377968:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286758767488 00000100:00100000:0.0:1789366632.377973:0:6661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286758767488 00000100:00100000:0.0:1789366632.378010:0:6661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1789366632.378018:0:6661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638bf5aaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3286:x1876286758767488:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789366632.378057:0:6661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638bf5aaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3286:x1876286758767488:12345-0@lo:400:kworker.0 Request processed in 40us (203us total) trans 0 rc 0/0 00000100:00100000:0.0:1789366632.378063:0:6661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1789366632.378080:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286758767104 00000100:00100000:0.0:1789366632.378083:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286758767104 00000100:00100000:0.0:1789366632.378103:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 266 00000100:00100000:0.0:1789366632.378109:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638b4e86450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8cde4528-5832-4854-a387-4adacc3dd0ab+19:3286:x1876286758767104:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789366632.378136:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638b4e86450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8cde4528-5832-4854-a387-4adacc3dd0ab+19:3286:x1876286758767104:12345-0@lo:400:kworker.0 Request processed in 27us (234us total) trans 0 rc 0/0 00000100:00100000:0.0:1789366632.378141:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 266 00000100:00100000:0.0:1789366632.378173:0:7614:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286758767360 00000100:00100000:0.0:1789366632.378176:0:7614:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286758767360 00000100:00100000:0.0:1789366632.378200:0:7614:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286758767232 00000100:00100000:0.0:1789366632.378209:0:7614:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286758767232 00000100:00100000:0.0:1789366632.378227:0:7614:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286758767616 00000100:00100000:0.0:1789366632.378230:0:7614:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286758767616 00000100:00100000:0.0:1789366632.378243:0:7614:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:0.0:1789366632.378248:0:7614:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638bf4b2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3285:x1876286758767360:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789366632.378281:0:7614:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638bf4b2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3285:x1876286758767360:12345-0@lo:400:kworker.0 Request processed in 33us (604us total) trans 0 rc 0/0 00000100:00100000:0.0:1789366632.378287:0:7614:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:0.0:1789366632.378299:0:7614:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1789366632.378304:0:7614:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638b70ce300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3285:x1876286758767232:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789366632.378328:0:7614:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638b70ce300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3285:x1876286758767232:12345-0@lo:400:kworker.0 Request processed in 24us (526us total) trans 0 rc 0/0 00000100:00100000:0.0:1789366632.378334:0:7614:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1789366632.378354:0:7614:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1789366632.378361:0:7614:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638bf5a9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3286:x1876286758767616:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789366632.378383:0:7614:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638bf5a9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3286:x1876286758767616:12345-0@lo:400:kworker.0 Request processed in 24us (441us total) trans 0 rc 0/0 00000100:00100000:0.0:1789366632.378388:0:7614:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00080000:0.0:1789366632.378427:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789366632.378431:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789366632.378452:0:3286:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff963883309f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8cde4528-5832-4854-a387-4adacc3dd0ab:3286:1876286758767104:0@lo:400:kworker.0 00000100:00100000:0.0:1789366632.378463:0:3286:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9638b6ea3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3286:1876286758767616:0@lo:400:kworker.0 00000100:00100000:0.0:1789366632.378471:0:3286:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9638b6ea3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3286:1876286758767488:0@lo:400:kworker.0 00000100:00100000:0.0:1789366632.378498:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96388330aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3285:1876286758767232:0@lo:400:kworker.0 00000100:00100000:0.0:1789366632.378505:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9638b6ea0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3285:1876286758767360:0@lo:400:kworker.0 00010000:00010000:3.0:1789366632.507154:0:5805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789366633.532439:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789366634.553355:0:6675:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789366634.936397:0:3285:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789366634.936431:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9638bfeca300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3285:1876286758767744:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789366634.936536:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789366634.936641:0:6663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286758767744 00000100:00100000:1.0:1789366634.936654:0:6663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286758767744 00000100:00100000:1.0:1789366634.936771:0:6663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1789366634.936784:0:6663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638bf5a9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1876286758767744:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789366634.936833:0:6663:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789366634.936896:0:6663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638bf5a9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1876286758767744:12345-0@lo:13:osp-pre-0-0.0 Request processed in 116us (360us total) trans 0 rc 0/0 00000100:00100000:1.0:1789366634.936905:0:6663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1789366634.936968:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9638bfeca300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3285:1876286758767744:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1789366634.939652:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1789366635.580322:0:5805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789366636.600409:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789366637.263569:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:1.0:1789366637.263629:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:2.0:1789366637.263671:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751399424 00000100:00100000:2.0:1789366637.263687:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751399424 00000100:00100000:0.0:1789366637.263692:0:7614:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751399552 00000100:00100000:0.0:1789366637.263700:0:7614:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751399552 00000100:00100000:0.0:1789366637.263798:0:7614:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 95 00000100:00100000:2.0:1789366637.263799:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 267 00000100:00100000:2.0:1789366637.263818:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638b4e86050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:14a2847b-91d8-4d87-b71b-010443acc91a+13:2356:x1876286751399424:12345-192.168.202.23@tcp:400:kworker.0 00000100:00100000:0.0:1789366637.263819:0:7614:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638bfeca300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0ab23baa-a205-44ad-bf17-f7b47295d82b+5:2356:x1876286751399552:12345-192.168.202.23@tcp:400:kworker.0 00000100:00080000:3.0:1789366637.263903:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789366637.264044:0:7614:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638bfeca300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0ab23baa-a205-44ad-bf17-f7b47295d82b+5:2356:x1876286751399552:12345-192.168.202.23@tcp:400:kworker.0 Request processed in 232us (414us total) trans 0 rc 0/0 00000100:00100000:0.0:1789366637.264054:0:7614:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 95 00000100:00100000:2.0:1789366637.265741:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638b4e86050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:14a2847b-91d8-4d87-b71b-010443acc91a+13:2356:x1876286751399424:12345-192.168.202.23@tcp:400:kworker.0 Request processed in 1905us (2164us total) trans 0 rc 0/0 00000100:00100000:2.0:1789366637.265775:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 267 00000100:00100000:0.0:1789366637.270815:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:2.0:1789366637.270890:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751399808 00000100:00100000:0.0:1789366637.270923:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:2.0:1789366637.271298:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751399808 00000100:00100000:1.0:1789366637.271319:0:8065:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751399680 00000100:00100000:1.0:1789366637.271344:0:8065:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751399680 00000100:00100000:2.0:1789366637.271460:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 96 00000100:00100000:2.0:1789366637.271481:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638bf5a8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b9764435-e52f-45ac-a5f9-bab1231105ac+5:2357:x1876286751399808:12345-192.168.202.23@tcp:400:kworker.0 00000100:00100000:2.0:1789366637.271566:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638bf5a8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b9764435-e52f-45ac-a5f9-bab1231105ac+5:2357:x1876286751399808:12345-192.168.202.23@tcp:400:kworker.0 Request processed in 86us (764us total) trans 0 rc 0/0 00000100:00100000:2.0:1789366637.271573:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 96 00000100:00080000:3.0:1789366637.277970:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789366637.277986:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789366637.286588:0:8065:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 19 00000100:00100000:1.0:1789366637.286624:0:8065:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96388330aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0ab23baa-a205-44ad-bf17-f7b47295d82b+5:2353:x1876286751399680:12345-192.168.202.23@tcp:9:kworker.0 00000020:00000080:1.0:1789366637.286671:0:8065:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x8da3486b955f3213 00000100:00080000:1.0:1789366637.286686:0:8065:0:(import.c:65:import_set_state_nolock()) ffff9638bf51b800 : changing import state from FULL to CLOSED 00010000:00010000:3.0:1789366637.286978:0:6675:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00000004:1.0:1789366637.287326:0:8065:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967300 00000100:00100000:1.0:1789366637.288082:0:8065:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96388330aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0ab23baa-a205-44ad-bf17-f7b47295d82b+2:2353:x1876286751399680:12345-192.168.202.23@tcp:9:kworker.0 Request processed in 1463us (17152us total) trans 0 rc 0/0 00000100:00100000:1.0:1789366637.288095:0:8065:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 19 00000100:00100000:1.0:1789366637.496084:0:3287:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9638bfec9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3287:1876286758768128:0@lo:400:kworker.0 00000100:00100000:1.0:1789366637.496208:0:3287:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789366637.496295:0:3287:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1789366637.496302:0:3287:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9638bfeca680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3287:1876286758768000:0@lo:400:kworker.0 00000100:00100000:1.0:1789366637.496330:0:3287:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789366637.496350:0:3287:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9638bfec8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3287:1876286758768512:0@lo:400:kworker.0 00000100:00100000:1.0:1789366637.496392:0:3287:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789366637.496429:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286758768512 00000100:00100000:1.0:1789366637.496439:0:6661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286758768512 00000100:00100000:1.0:1789366637.496516:0:6661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1789366637.496529:0:6661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963890777800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3287:x1876286758768512:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789366637.496593:0:6661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963890777800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3287:x1876286758768512:12345-0@lo:400:kworker.0 Request processed in 67us (199us total) trans 0 rc 0/0 00000100:00100000:1.0:1789366637.496609:0:6661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1789366637.496641:0:7132:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286758768128 00000100:00100000:1.0:1789366637.496646:0:7132:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286758768128 00000100:00100000:1.0:1789366637.496673:0:7132:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286758768000 00000100:00100000:1.0:1789366637.496677:0:7132:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286758768000 00000100:00100000:1.0:1789366637.496706:0:7132:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:1.0:1789366637.496712:0:7132:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963890777100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3287:x1876286758768128:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789366637.496783:0:7132:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963890777100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3287:x1876286758768128:12345-0@lo:400:kworker.0 Request processed in 71us (575us total) trans 0 rc 0/0 00000100:00100000:1.0:1789366637.496790:0:7132:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:1.0:1789366637.496802:0:7132:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:1.0:1789366637.496809:0:7132:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963890774380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3287:x1876286758768000:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789366637.496835:0:7132:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963890774380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3287:x1876286758768000:12345-0@lo:400:kworker.0 Request processed in 28us (505us total) trans 0 rc 0/0 00000100:00100000:1.0:1789366637.496841:0:7132:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:1.0:1789366637.496884:0:3287:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9638bfeca680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3287:1876286758768000:0@lo:400:kworker.0 00010000:00080000:1.0:1789366637.496901:0:3287:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9638bfec8000 x1876286758768512/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789366653 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789366637.496913:0:3287:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9638bfec8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3287:1876286758768512:0@lo:400:kworker.0 00000100:00100000:1.0:1789366637.496923:0:3287:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9638bfec9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3287:1876286758768128:0@lo:400:kworker.0 00000100:00100000:0.0:1789366637.497037:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9638bfec9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8cde4528-5832-4854-a387-4adacc3dd0ab:3285:1876286758767872:0@lo:400:kworker.0 00000100:00100000:0.0:1789366637.497076:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789366637.497111:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9638bfec9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3285:1876286758768384:0@lo:400:kworker.0 00000100:00100000:0.0:1789366637.497134:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789366637.497154:0:3285:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789366637.497160:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9638bfec8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3285:1876286758768256:0@lo:400:kworker.0 00000100:00100000:0.0:1789366637.497197:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789366637.497229:0:7614:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286758768384 00000100:00100000:0.0:1789366637.497234:0:7614:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286758768384 00000100:00100000:0.0:1789366637.497265:0:7614:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1789366637.497272:0:7614:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963883309f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3285:x1876286758768384:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789366637.497309:0:7614:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963883309f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3285:x1876286758768384:12345-0@lo:400:kworker.0 Request processed in 37us (173us total) trans 0 rc 0/0 00000100:00100000:0.0:1789366637.497325:0:7614:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1789366637.497369:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9638bfec9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3285:1876286758768384:0@lo:400:kworker.0 00000100:00100000:1.0:1789366637.497506:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286758767872 00000100:00100000:1.0:1789366637.497511:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286758767872 00000100:00100000:1.0:1789366637.497579:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 268 00000100:00100000:1.0:1789366637.497587:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638b4e86850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8cde4528-5832-4854-a387-4adacc3dd0ab+19:3285:x1876286758767872:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789366637.497625:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638b4e86850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8cde4528-5832-4854-a387-4adacc3dd0ab+19:3285:x1876286758767872:12345-0@lo:400:kworker.0 Request processed in 40us (548us total) trans 0 rc 0/0 00000100:00100000:1.0:1789366637.497631:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 268 00000100:00080000:3.0:1789366637.497710:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789366637.497737:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789366637.500666:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286758768256 00000100:00100000:2.0:1789366637.500688:0:6660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286758768256 00000100:00100000:2.0:1789366637.500807:0:6660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1789366637.500820:0:6660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96389077ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3285:x1876286758768256:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789366637.500929:0:6660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96389077ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3285:x1876286758768256:12345-0@lo:400:kworker.0 Request processed in 112us (3730us total) trans 0 rc 0/0 00000100:00100000:2.0:1789366637.500938:0:6660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00080000:2.0:1789366637.500967:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789366637.501034:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9638bfec8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3285:1876286758768256:0@lo:400:kworker.0 00000100:00100000:3.0:1789366637.501210:0:3286:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789366637.501228:0:3286:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9638b6ea1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3286:1876286758768640:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789366637.501572:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9638bfec9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8cde4528-5832-4854-a387-4adacc3dd0ab:3285:1876286758767872:0@lo:400:kworker.0 00000100:00100000:3.0:1789366637.503579:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789366637.506324:0:6662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286758768640 00000100:00100000:1.0:1789366637.506345:0:6662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286758768640 00000100:00100000:1.0:1789366637.506506:0:6662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1789366637.506539:0:6662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638b6ea3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3286:x1876286758768640:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789366637.506665:0:6662:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789366637.506886:0:6662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638b6ea3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3286:x1876286758768640:12345-0@lo:13:osp-pre-1-0.0 Request processed in 350us (3314us total) trans 0 rc 0/0 00000100:00100000:1.0:1789366637.506894:0:6662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00010000:00080000:3.0:1789366637.511686:0:3286:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9638b6ea1500 x1876286758768640/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789366653 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789366637.512164:0:3286:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9638b6ea1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3286:1876286758768640:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1789366637.627054:0:5805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1789366638.544915:0:6685:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 0ab23baa-a205-44ad-bf17-f7b47295d82b 00000020:00000080:0.0:1789366638.544922:0:6685:0:(genops.c:885:class_export_put()) final put ffff9638b730a000/0ab23baa-a205-44ad-bf17-f7b47295d82b 00000020:00000080:3.0:1789366638.545006:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9638b730a000/0ab23baa-a205-44ad-bf17-f7b47295d82b for lustre-OST0000 00000020:00000080:3.0:1789366638.545170:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9638bf51b800 for lustre-OST0000 00010000:00010000:2.0:1789366638.651647:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789366639.672045:0:6675:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789366640.055977:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff963890776a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3284:1876286758768768:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789366640.056052:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789366640.056605:0:7134:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286758768768 00000100:00100000:1.0:1789366640.056614:0:7134:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286758768768 00000100:00100000:1.0:1789366640.056687:0:7134:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1789366640.056697:0:7134:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638b702c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1876286758768768:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789366640.056751:0:7134:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789366640.056811:0:7134:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638b702c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1876286758768768:12345-0@lo:13:osp-pre-0-0.0 Request processed in 115us (758us total) trans 0 rc 0/0 00000100:00100000:1.0:1789366640.056818:0:7134:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00080000:2.0:1789366640.056882:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789366640.057089:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff963890776a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3284:1876286758768768:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1789366640.695829:0:5805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789366641.721264:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789366642.379035:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:0.0:1789366642.379099:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:2.0:1789366642.379203:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751399936 00000100:00100000:2.0:1789366642.379215:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751399936 00000100:00100000:2.0:1789366642.379281:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 269 00000100:00100000:2.0:1789366642.379308:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638b4e87450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:14a2847b-91d8-4d87-b71b-010443acc91a+13:2355:x1876286751399936:12345-192.168.202.23@tcp:400:kworker.0 00000100:00100000:2.0:1789366642.379398:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638b4e87450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:14a2847b-91d8-4d87-b71b-010443acc91a+13:2355:x1876286751399936:12345-192.168.202.23@tcp:400:kworker.0 Request processed in 93us (377us total) trans 0 rc 0/0 00000100:00100000:2.0:1789366642.379406:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 269 00000100:00100000:0.0:1789366642.379585:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:2.0:1789366642.380961:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751400192 00000100:00100000:2.0:1789366642.380972:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751400192 00000100:00100000:2.0:1789366642.381079:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751400064 00000100:00100000:2.0:1789366642.381083:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751400064 00000100:00100000:1.0:1789366642.381140:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 100 00000100:00100000:1.0:1789366642.381152:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96389077ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b9764435-e52f-45ac-a5f9-bab1231105ac+5:2355:x1876286751400192:12345-192.168.202.23@tcp:400:kworker.0 00000100:00100000:1.0:1789366642.381219:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96389077ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b9764435-e52f-45ac-a5f9-bab1231105ac+5:2355:x1876286751400192:12345-192.168.202.23@tcp:400:kworker.0 Request processed in 70us (2119us total) trans 0 rc 0/0 00000100:00100000:1.0:1789366642.381227:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 100 00000100:00080000:3.0:1789366642.381560:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789366642.381897:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 101 00000100:00100000:2.0:1789366642.381905:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96389077e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0ab23baa-a205-44ad-bf17-f7b47295d82b+5:2355:x1876286751400064:12345-192.168.202.23@tcp:400:kworker.0 00000100:00100000:2.0:1789366642.381953:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96389077e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0ab23baa-a205-44ad-bf17-f7b47295d82b+5:2355:x1876286751400064:12345-192.168.202.23@tcp:400:kworker.0 Request processed in 49us (2812us total) trans 0 rc 0/0 00000100:00100000:2.0:1789366642.381961:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 101 00000040:00080000:3.0:1789366642.424544:0:11650:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1789366642.615939:0:3284:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789366642.615962:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff963890777480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3284:1876286758768896:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789366642.616028:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789366642.616671:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96389077ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3285:1876286758769408:0@lo:400:kworker.0 00000100:00100000:0.0:1789366642.616704:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789366642.616743:0:3285:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789366642.616749:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96389077d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3285:1876286758769280:0@lo:400:kworker.0 00000100:00100000:0.0:1789366642.616774:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789366642.616797:0:7132:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286758769280 00000100:00100000:0.0:1789366642.616802:0:7132:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286758769280 00000100:00100000:0.0:1789366642.616848:0:7132:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1789366642.616857:0:7132:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96389077c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3285:x1876286758769280:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789366642.616897:0:7132:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96389077c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3285:x1876286758769280:12345-0@lo:400:kworker.0 Request processed in 42us (122us total) trans 0 rc 0/0 00000100:00100000:0.0:1789366642.616902:0:7132:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00080000:0.0:1789366642.616918:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789366642.616937:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96389077d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3285:1876286758769280:0@lo:400:kworker.0 00000100:00100000:1.0:1789366642.617297:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286758769408 00000100:00100000:1.0:1789366642.617302:0:6661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286758769408 00000100:00100000:1.0:1789366642.617353:0:6661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1789366642.617360:0:6661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96389077f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3285:x1876286758769408:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789366642.617523:0:6661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96389077f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3285:x1876286758769408:12345-0@lo:400:kworker.0 Request processed in 163us (818us total) trans 0 rc 0/0 00000100:00100000:1.0:1789366642.617530:0:6661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1789366642.617570:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96389077ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3285:1876286758769408:0@lo:400:kworker.0 00000100:00080000:0.0:1789366642.617626:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789366642.617848:0:6663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286758768896 00000100:00100000:2.0:1789366642.617854:0:6663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286758768896 00000100:00100000:2.0:1789366642.617900:0:6663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1789366642.617906:0:6663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963890774000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1876286758768896:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789366642.617933:0:6663:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789366642.617958:0:3286:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96389077dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8cde4528-5832-4854-a387-4adacc3dd0ab:3286:1876286758769024:0@lo:400:kworker.0 00000100:00100000:2.0:1789366642.617973:0:6663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963890774000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1876286758768896:12345-0@lo:13:osp-pre-1-0.0 Request processed in 67us (1944us total) trans 0 rc 0/0 00000100:00100000:2.0:1789366642.617978:0:6663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1789366642.617995:0:3287:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96389077d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3287:1876286758769152:0@lo:400:kworker.0 00000100:00100000:3.0:1789366642.618003:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1789366642.618057:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789366642.618195:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286758769024 00000100:00100000:1.0:1789366642.618199:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286758769024 00000100:00100000:1.0:1789366642.618234:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 270 00000100:00100000:1.0:1789366642.618241:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638b4e85050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8cde4528-5832-4854-a387-4adacc3dd0ab+19:3286:x1876286758769024:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789366642.618293:0:3287:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789366642.618362:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638b4e85050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8cde4528-5832-4854-a387-4adacc3dd0ab+19:3286:x1876286758769024:12345-0@lo:400:kworker.0 Request processed in 121us (362us total) trans 0 rc 0/0 00000100:00100000:1.0:1789366642.618369:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 270 00000100:00100000:3.0:1789366642.618464:0:3286:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96389077dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8cde4528-5832-4854-a387-4adacc3dd0ab:3286:1876286758769024:0@lo:400:kworker.0 00000100:00100000:3.0:1789366642.618472:0:3286:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96389077e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3286:1876286758769536:0@lo:400:kworker.0 00000100:00100000:2.0:1789366642.618491:0:7614:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286758769152 00000100:00100000:3.0:1789366642.618497:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789366642.618497:0:7614:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286758769152 00000100:00100000:2.0:1789366642.618532:0:7614:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286758769536 00000100:00100000:2.0:1789366642.618547:0:7614:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286758769536 00010000:00080000:1.0:1789366642.618628:0:3284:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff963890777480 x1876286758768896/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789366658 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789366642.618645:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff963890777480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3284:1876286758768896:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789366642.622426:0:7132:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1789366642.622446:0:7132:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638b702ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3287:x1876286758769152:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789366642.622508:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1789366642.622525:0:7132:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638b702ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3287:x1876286758769152:12345-0@lo:400:kworker.0 Request processed in 87us (4231us total) trans 0 rc 0/0 00000100:00100000:0.0:1789366642.622527:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638b6ea1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3286:x1876286758769536:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789366642.622536:0:7132:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1789366642.622598:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638b6ea1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3286:x1876286758769536:12345-0@lo:400:kworker.0 Request processed in 80us (4100us total) trans 0 rc 0/0 00000100:00100000:0.0:1789366642.622606:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1789366642.622689:0:3286:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96389077e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3286:1876286758769536:0@lo:400:kworker.0 00000100:00080000:3.0:1789366642.622778:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789366642.622845:0:3287:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96389077d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3287:1876286758769152:0@lo:400:kworker.0 00010000:00010000:3.0:1789366642.743864:0:6675:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1789366643.116292:0:11811:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1a: Test manual lfs pcc attach with manual HSM restore ========================================================== 02:17:22 (1789366642) 00010000:00010000:3.0:1789366643.769276:0:5805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789366644.263586:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:1.0:1789366644.265367:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751400320 00000100:00100000:1.0:1789366644.265392:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751400320 00000100:00080000:3.0:1789366644.265465:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789366644.265555:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 32 00000100:00100000:1.0:1789366644.265565:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96389077d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0ab23baa-a205-44ad-bf17-f7b47295d82b+5:10220:x1876286751400320:12345-192.168.202.23@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789366644.265583:0:5815:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789366644.265601:0:5815:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9638b6ce2200/0x8da3486b955f32de lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xda917a494d06bfa4 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366644.265652:0:5815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9638b6ce3a00/0x8da3486b955f32e5 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366644.265663:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9638b6ce3a00/0x8da3486b955f32e5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366644.265836:0:5815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9638b6ce3a00/0x8da3486b955f32e5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789366644.265869:0:5815:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:1.0:1789366644.265872:0:5815:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1789366644.265902:0:5815:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9638b6ce3a00/0x8da3486b955f32e5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366644.265919:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9638b6ce2200/0x8da3486b955f32de lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.23@tcp remote: 0xda917a494d06bfa4 expref: 7 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366644.265932:0:5815:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9638b6ce3a00/0x8da3486b955f32e5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.23@tcp remote: 0xda917a494d06bfa4 expref: 6 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366644.265939:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff963887f88400) 00010000:00010000:1.0:1789366644.265941:0:5815:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789366644.265944:0:5815:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9638b6ce3a00, rc 0) 00000100:00100000:1.0:1789366644.266074:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96389077d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0ab23baa-a205-44ad-bf17-f7b47295d82b+6:10220:x1876286751400320:12345-192.168.202.23@tcp:101:lhsmtool_posix.0 Request processed in 510us (2496us total) trans 0 rc 0/0 00000100:00100000:1.0:1789366644.266081:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 32 00000100:00100000:2.0:1789366644.276171:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:0.0:1789366644.285908:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751400448 00000100:00100000:0.0:1789366644.285924:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751400448 00000100:00100000:0.0:1789366644.286926:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 33 00000100:00100000:0.0:1789366644.286945:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638b702d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0ab23baa-a205-44ad-bf17-f7b47295d82b+6:10221:x1876286751400448:12345-192.168.202.23@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789366644.286970:0:5817:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789366644.286997:0:5817:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720d400/0x8da3486b955f32ec lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xda917a494d06bfab expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366644.287080:0:5817:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720de00/0x8da3486b955f32f3 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366644.287098:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720de00/0x8da3486b955f32f3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366644.287110:0:5817:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720de00/0x8da3486b955f32f3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366644.287126:0:5817:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720c000/0x8da3486b955f32fa lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366644.287133:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720c000/0x8da3486b955f32fa lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366644.287139:0:5817:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720c000/0x8da3486b955f32fa lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366644.287416:0:5817:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720d800/0x8da3486b955f3301 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366644.287426:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720d800/0x8da3486b955f3301 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366644.287433:0:5817:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720d800/0x8da3486b955f3301 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789366644.287465:0:5817:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1789366644.287470:0:5817:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1789366644.287495:0:5817:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720d800/0x8da3486b955f3301 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366644.287507:0:5817:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720de00/0x8da3486b955f32f3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366644.287514:0:5817:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720de00/0x8da3486b955f32f3 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366644.287521:0:5817:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720de00/0x8da3486b955f32f3 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366644.287527:0:5817:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9638b720de00 already unused, calling callback (ffffffffc20ee4f0) 00010000:00010000:0.0:1789366644.287532:0:5817:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720de00/0x8da3486b955f32f3 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366644.287541:0:5817:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720de00/0x8da3486b955f32f3 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366644.287554:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff963887f88400) 00010000:00010000:0.0:1789366644.287562:0:5817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789366644.287568:0:5817:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720de00/0x8da3486b955f32f3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366644.287575:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720de00/0x8da3486b955f32f3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366644.287588:0:5817:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720c000/0x8da3486b955f32fa lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366644.287594:0:5817:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720c000/0x8da3486b955f32fa lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366644.287599:0:5817:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720c000/0x8da3486b955f32fa lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366644.287604:0:5817:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9638b720c000 already unused, calling callback (ffffffffc20ee4f0) 00010000:00010000:0.0:1789366644.287606:0:5817:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720c000/0x8da3486b955f32fa lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366644.287611:0:5817:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720c000/0x8da3486b955f32fa lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366644.287618:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff963890797c00) 00010000:00010000:0.0:1789366644.287620:0:5817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789366644.287623:0:5817:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720c000/0x8da3486b955f32fa lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366644.287628:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720c000/0x8da3486b955f32fa lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366644.287657:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720d400/0x8da3486b955f32ec lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.23@tcp remote: 0xda917a494d06bfab expref: 8 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366644.287682:0:5817:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720d800/0x8da3486b955f3301 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.23@tcp remote: 0xda917a494d06bfab expref: 7 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366644.287690:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff963890797400) 00010000:00010000:0.0:1789366644.287692:0:5817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789366644.287694:0:5817:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9638b720d800, rc 0) 00000100:00100000:0.0:1789366644.287790:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638b702d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0ab23baa-a205-44ad-bf17-f7b47295d82b+7:10221:x1876286751400448:12345-192.168.202.23@tcp:101:lhsmtool_posix.0 Request processed in 851us (11629us total) trans 0 rc 0/0 00000100:00100000:0.0:1789366644.287798:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 33 00000100:00100000:3.0:1789366644.301278:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:2.0:1789366644.301430:0:7614:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751400704 00000100:00100000:2.0:1789366644.301442:0:7614:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751400704 00000100:00100000:2.0:1789366644.301573:0:7614:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 34 00000100:00100000:2.0:1789366644.301586:0:7614:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638b6ea0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0ab23baa-a205-44ad-bf17-f7b47295d82b+7:10221:x1876286751400704:12345-192.168.202.23@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789366644.301609:0:7614:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789366644.301633:0:7614:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9638a0740800/0x8da3486b955f3308 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xda917a494d06bfb2 expref: -99 pid: 7614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366644.301711:0:7614:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff963880030000/0x8da3486b955f330f lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7614 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366644.301785:0:7614:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff963880030000/0x8da3486b955f330f lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7614 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366644.301798:0:7614:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff963880030000/0x8da3486b955f330f lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7614 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366644.301863:0:7614:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff963880030600/0x8da3486b955f3316 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7614 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366644.301871:0:7614:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff963880030600/0x8da3486b955f3316 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7614 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366644.301878:0:7614:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff963880030600/0x8da3486b955f3316 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7614 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366644.302223:0:7614:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff963880031200/0x8da3486b955f331d lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7614 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366644.302238:0:7614:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff963880031200/0x8da3486b955f331d lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7614 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366644.302245:0:7614:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff963880031200/0x8da3486b955f331d lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7614 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789366644.302255:0:7614:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 16384 00010000:00010000:2.0:1789366644.302411:0:7614:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff963880030000/0x8da3486b955f330f lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7614 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366644.302418:0:7614:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff963880030000/0x8da3486b955f330f lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7614 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366644.302425:0:7614:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff963880030000/0x8da3486b955f330f lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7614 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366644.302430:0:7614:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff963880030000 already unused, calling callback (ffffffffc20ee4f0) 00010000:00010000:2.0:1789366644.302433:0:7614:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff963880030000/0x8da3486b955f330f lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7614 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366644.302440:0:7614:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff963880030000/0x8da3486b955f330f lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7614 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366644.302451:0:7614:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff963890797400) 00010000:00010000:2.0:1789366644.302454:0:7614:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789366644.302459:0:7614:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff963880030000/0x8da3486b955f330f lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7614 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366644.302465:0:7614:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff963880030000/0x8da3486b955f330f lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7614 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366644.302478:0:7614:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff963880030600/0x8da3486b955f3316 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7614 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366644.302489:0:7614:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff963880030600/0x8da3486b955f3316 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7614 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366644.302494:0:7614:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff963880030600/0x8da3486b955f3316 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7614 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366644.302498:0:7614:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff963880030600 already unused, calling callback (ffffffffc20ee4f0) 00010000:00010000:2.0:1789366644.302501:0:7614:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff963880030600/0x8da3486b955f3316 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7614 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366644.302506:0:7614:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff963880030600/0x8da3486b955f3316 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7614 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366644.302512:0:7614:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff9638a7404c00) 00010000:00010000:2.0:1789366644.302514:0:7614:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789366644.302516:0:7614:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff963880030600/0x8da3486b955f3316 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7614 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366644.302521:0:7614:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff963880030600/0x8da3486b955f3316 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7614 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366644.302996:0:7614:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9638a0740800/0x8da3486b955f3308 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.23@tcp remote: 0xda917a494d06bfb2 expref: 10 pid: 7614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366644.303011:0:7614:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff963880031200/0x8da3486b955f331d lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.23@tcp remote: 0xda917a494d06bfb2 expref: 9 pid: 7614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366644.303018:0:7614:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9638a7404100) 00010000:00010000:2.0:1789366644.303020:0:7614:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789366644.303028:0:7614:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff963880031200, rc 0) 00000100:00100000:2.0:1789366644.303102:0:7614:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638b6ea0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0ab23baa-a205-44ad-bf17-f7b47295d82b+9:10221:x1876286751400704:12345-192.168.202.23@tcp:101:lhsmtool_posix.0 Request processed in 1518us (1838us total) trans 4294967309 rc 0/0 00000100:00100000:2.0:1789366644.303115:0:7614:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 34 00000100:00100000:1.0:1789366644.307198:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:2.0:1789366644.307326:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751400832 00000100:00100000:2.0:1789366644.307337:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751400832 00000100:00100000:2.0:1789366644.307404:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 35 00000100:00100000:2.0:1789366644.307413:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963890777480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0ab23baa-a205-44ad-bf17-f7b47295d82b+9:10221:x1876286751400832:12345-192.168.202.23@tcp:59:lhsmtool_posix.0 00000100:00100000:2.0:1789366644.307527:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963890777480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0ab23baa-a205-44ad-bf17-f7b47295d82b+9:10221:x1876286751400832:12345-192.168.202.23@tcp:59:lhsmtool_posix.0 Request processed in 114us (336us total) trans 0 rc 0/0 00000100:00100000:2.0:1789366644.307534:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 35 00000040:00080000:2.0:1789366644.479860:0:11650:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1789366644.796222:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789366645.176638:0:3287:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff963890775f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3287:1876286758769664:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789366645.176764:0:3287:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789366645.176994:0:7134:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286758769664 00000100:00100000:1.0:1789366645.177002:0:7134:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286758769664 00000100:00100000:1.0:1789366645.177054:0:7134:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1789366645.177064:0:7134:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96389077d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3287:x1876286758769664:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789366645.177098:0:7134:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789366645.177145:0:7134:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96389077d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3287:x1876286758769664:12345-0@lo:13:osp-pre-0-0.0 Request processed in 82us (390us total) trans 0 rc 0/0 00000100:00100000:1.0:1789366645.177160:0:7134:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00080000:1.0:1789366645.177182:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789366645.177220:0:3287:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff963890775f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3287:1876286758769664:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1789366645.816874:0:6675:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789366645.873323:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:0.0:1789366645.873417:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751400960 00000100:00100000:0.0:1789366645.873428:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751400960 00000100:00100000:0.0:1789366645.873489:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 36 00000100:00100000:0.0:1789366645.873501:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638b6ea0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0ab23baa-a205-44ad-bf17-f7b47295d82b+9:10263:x1876286751400960:12345-192.168.202.23@tcp:101:lfs.0 00010000:00010000:0.0:1789366645.873521:0:5817:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789366645.873542:0:5817:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720de00/0x8da3486b955f332b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xda917a494d06bfb9 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366645.873606:0:5817:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720c200/0x8da3486b955f3332 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366645.873633:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720c200/0x8da3486b955f3332 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366645.873644:0:5817:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720c200/0x8da3486b955f3332 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366645.873667:0:5817:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720da00/0x8da3486b955f3339 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366645.873674:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720da00/0x8da3486b955f3339 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366645.873681:0:5817:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720da00/0x8da3486b955f3339 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366645.874003:0:5817:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720c200/0x8da3486b955f3332 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366645.874012:0:5817:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720c200/0x8da3486b955f3332 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366645.874019:0:5817:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720c200/0x8da3486b955f3332 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366645.874025:0:5817:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9638b720c200 already unused, calling callback (ffffffffc20ee4f0) 00010000:00010000:0.0:1789366645.874030:0:5817:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720c200/0x8da3486b955f3332 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366645.874037:0:5817:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720c200/0x8da3486b955f3332 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366645.874050:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff963887f88400) 00010000:00010000:0.0:1789366645.874053:0:5817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789366645.874058:0:5817:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720c200/0x8da3486b955f3332 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366645.874064:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720c200/0x8da3486b955f3332 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366645.874096:0:5817:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720da00/0x8da3486b955f3339 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366645.874103:0:5817:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720da00/0x8da3486b955f3339 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366645.874109:0:5817:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720da00/0x8da3486b955f3339 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366645.874114:0:5817:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9638b720da00 already unused, calling callback (ffffffffc20ee4f0) 00010000:00010000:0.0:1789366645.874117:0:5817:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720da00/0x8da3486b955f3339 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366645.874123:0:5817:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720da00/0x8da3486b955f3339 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366645.874131:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff963890797800) 00010000:00010000:0.0:1789366645.874133:0:5817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789366645.874136:0:5817:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720da00/0x8da3486b955f3339 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366645.874142:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720da00/0x8da3486b955f3339 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366645.874172:0:5817:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720de00/0x8da3486b955f332b lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.23@tcp remote: 0xda917a494d06bfb9 expref: 10 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366645.874182:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff963887f88400) 00010000:00010000:0.0:1789366645.874184:0:5817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789366645.874195:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720de00/0x8da3486b955f332b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.23@tcp remote: 0xda917a494d06bfb9 expref: 10 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366645.874204:0:5817:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9638b720de00, rc 0) 00000100:00100000:0.0:1789366645.874270:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638b6ea0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0ab23baa-a205-44ad-bf17-f7b47295d82b+9:10263:x1876286751400960:12345-192.168.202.23@tcp:101:lfs.0 Request processed in 771us (956us total) trans 0 rc 301/301 00000100:00100000:0.0:1789366645.874278:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 36 00000100:00100000:3.0:1789366645.877042:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:2.0:1789366645.877158:0:7614:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751401216 00000100:00100000:2.0:1789366645.877168:0:7614:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751401216 00000100:00100000:2.0:1789366645.877222:0:7614:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 37 00000100:00100000:2.0:1789366645.877232:0:7614:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638b6ea3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0ab23baa-a205-44ad-bf17-f7b47295d82b+9:10263:x1876286751401216:12345-192.168.202.23@tcp:36:lfs.0 00010000:00010000:2.0:1789366645.877302:0:7614:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789366645.877327:0:7614:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9638b6ce3a00/0x8da3486b955f32e5 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.23@tcp remote: 0xda917a494d06bfa4 expref: 9 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366645.877345:0:7614:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff963887f88400) 00010000:00010000:2.0:1789366645.877355:0:7614:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789366645.877552:0:7614:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff963880030600/0x8da3486b955f3340 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7614 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366645.877565:0:7614:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff963880030600/0x8da3486b955f3340 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7614 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366645.877584:0:7614:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff963880030600/0x8da3486b955f3340 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7614 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366645.877597:0:7614:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff963880030000/0x8da3486b955f3347 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7614 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366645.877603:0:7614:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff963880030000/0x8da3486b955f3347 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7614 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366645.877610:0:7614:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff963880030000/0x8da3486b955f3347 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7614 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789366645.881789:0:7614:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:3.0:1789366645.881807:0:7614:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff963880030600/0x8da3486b955f3340 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7614 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366645.881818:0:7614:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff963880030600/0x8da3486b955f3340 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7614 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366645.881827:0:7614:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff963880030600/0x8da3486b955f3340 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7614 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366645.881833:0:7614:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff963880030600 already unused, calling callback (ffffffffc20ee4f0) 00010000:00010000:3.0:1789366645.881838:0:7614:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff963880030600/0x8da3486b955f3340 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7614 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366645.881847:0:7614:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff963880030600/0x8da3486b955f3340 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7614 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366645.881862:0:7614:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9638a7404c00) 00010000:00010000:3.0:1789366645.881865:0:7614:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789366645.881870:0:7614:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff963880030600/0x8da3486b955f3340 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7614 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366645.881877:0:7614:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff963880030600/0x8da3486b955f3340 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7614 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789366645.881896:0:7614:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000f3b7e78f reply state 00000000c1ab8054 transno 4294967310 ns: mdt-lustre-MDT0000_UUID lock: ffff963880030000/0x8da3486b955f3347 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7614 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789366645.881916:0:7614:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789366645.882024:0:7614:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638b6ea3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0ab23baa-a205-44ad-bf17-f7b47295d82b+10:10263:x1876286751401216:12345-192.168.202.23@tcp:36:lfs.0 Request processed in 4790us (4984us total) trans 4294967310 rc 0/0 00000100:00100000:3.0:1789366645.882032:0:7614:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 37 00010000:00010000:1.0:1789366645.890956:0:3270:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff963880030000/0x8da3486b955f3347 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7614 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366645.890971:0:3270:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff963880030000/0x8da3486b955f3347 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7614 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366645.890979:0:3270:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff963880030000/0x8da3486b955f3347 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7614 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366645.890985:0:3270:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff963880030000 already unused, calling callback (ffffffffc20ee4f0) 00010000:00010000:1.0:1789366645.890990:0:3270:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff963880030000/0x8da3486b955f3347 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7614 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366645.890998:0:3270:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff963880030000/0x8da3486b955f3347 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7614 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366645.891015:0:3270:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff9638a7404400) 00010000:00010000:1.0:1789366645.891018:0:3270:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789366645.891023:0:3270:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff963880030000/0x8da3486b955f3347 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7614 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366645.891030:0:3270:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff963880030000/0x8da3486b955f3347 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7614 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789366645.939131:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:0.0:1789366645.939605:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751401344 00000100:00100000:0.0:1789366645.939617:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751401344 00000100:00100000:0.0:1789366645.939670:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 38 00000100:00100000:0.0:1789366645.939681:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638b6ea3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0ab23baa-a205-44ad-bf17-f7b47295d82b+9:10271:x1876286751401344:12345-192.168.202.23@tcp:101:lctl.0 00010000:00010000:0.0:1789366645.939708:0:5816:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789366645.939857:0:5816:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720de00/0x8da3486b955f334e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xda917a494d06bfc0 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366645.939923:0:5816:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720da00/0x8da3486b955f3355 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366645.939938:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720da00/0x8da3486b955f3355 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366645.939949:0:5816:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720da00/0x8da3486b955f3355 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789366645.939988:0:5816:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1789366645.939993:0:5816:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1789366645.940219:0:5816:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720da00/0x8da3486b955f3355 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366645.940246:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720de00/0x8da3486b955f334e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.23@tcp remote: 0xda917a494d06bfc0 expref: 11 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366645.940276:0:5816:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720da00/0x8da3486b955f3355 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.23@tcp remote: 0xda917a494d06bfc0 expref: 10 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366645.940297:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff963890797800) 00010000:00010000:0.0:1789366645.940300:0:5816:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789366645.940304:0:5816:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9638b720da00, rc 0) 00000100:00100000:0.0:1789366645.941161:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638b6ea3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0ab23baa-a205-44ad-bf17-f7b47295d82b+10:10271:x1876286751401344:12345-192.168.202.23@tcp:101:lctl.0 Request processed in 1479us (2038us total) trans 0 rc 0/0 00000100:00100000:0.0:1789366645.941170:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 38 00000100:00100000:1.0:1789366645.989955:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:0.0:1789366645.990029:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751401472 00000100:00100000:0.0:1789366645.990040:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751401472 00000100:00100000:0.0:1789366645.990108:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 39 00000100:00100000:0.0:1789366645.990119:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963890775f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0ab23baa-a205-44ad-bf17-f7b47295d82b+10:10277:x1876286751401472:12345-192.168.202.23@tcp:101:bash.0 00010000:00010000:0.0:1789366645.990278:0:5817:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789366645.990310:0:5817:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720de00/0x8da3486b955f335c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xda917a494d06bfc7 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366645.990377:0:5817:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720c200/0x8da3486b955f3363 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366645.990393:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720c200/0x8da3486b955f3363 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366645.990404:0:5817:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720c200/0x8da3486b955f3363 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366645.990420:0:5817:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720c000/0x8da3486b955f336a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366645.990436:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720c000/0x8da3486b955f336a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366645.990443:0:5817:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720c000/0x8da3486b955f336a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366645.990530:0:5817:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720d400/0x8da3486b955f3371 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366645.990538:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720d400/0x8da3486b955f3371 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366645.990544:0:5817:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720d400/0x8da3486b955f3371 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789366645.990567:0:5817:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00000004:00200000:0.0:1789366645.990571:0:5817:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1789366645.990609:0:5817:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720d400/0x8da3486b955f3371 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366645.990620:0:5817:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720c200/0x8da3486b955f3363 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366645.990627:0:5817:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720c200/0x8da3486b955f3363 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366645.990634:0:5817:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720c200/0x8da3486b955f3363 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366645.990639:0:5817:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9638b720c200 already unused, calling callback (ffffffffc20ee4f0) 00010000:00010000:0.0:1789366645.990644:0:5817:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720c200/0x8da3486b955f3363 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366645.990659:0:5817:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720c200/0x8da3486b955f3363 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366645.990671:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff963890797800) 00010000:00010000:0.0:1789366645.990674:0:5817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789366645.990679:0:5817:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720c200/0x8da3486b955f3363 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366645.990685:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720c200/0x8da3486b955f3363 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366645.990697:0:5817:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720c000/0x8da3486b955f336a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366645.990703:0:5817:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720c000/0x8da3486b955f336a lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366645.990709:0:5817:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720c000/0x8da3486b955f336a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366645.990714:0:5817:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9638b720c000 already unused, calling callback (ffffffffc20ee4f0) 00010000:00010000:0.0:1789366645.991101:0:5817:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720c000/0x8da3486b955f336a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366645.991109:0:5817:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720c000/0x8da3486b955f336a lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366645.991117:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff963890797a00) 00010000:00010000:0.0:1789366645.991120:0:5817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789366645.991123:0:5817:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720c000/0x8da3486b955f336a lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366645.991149:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720c000/0x8da3486b955f336a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366645.991181:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720de00/0x8da3486b955f335c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.23@tcp remote: 0xda917a494d06bfc7 expref: 12 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366645.991193:0:5817:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720d400/0x8da3486b955f3371 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.23@tcp remote: 0xda917a494d06bfc7 expref: 11 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366645.991200:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff963890797000) 00010000:00010000:0.0:1789366645.991202:0:5817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1789366645.991205:0:5817:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9638b720d400, rc 0) 00000100:00100000:0.0:1789366645.991262:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963890775f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0ab23baa-a205-44ad-bf17-f7b47295d82b+11:10277:x1876286751401472:12345-192.168.202.23@tcp:101:bash.0 Request processed in 1144us (1317us total) trans 0 rc 0/0 00000100:00100000:0.0:1789366645.991269:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 39 00000100:00100000:0.0:1789366646.002025:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:1.0:1789366646.002122:0:7614:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751401728 00000100:00100000:1.0:1789366646.002142:0:7614:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751401728 00000100:00100000:1.0:1789366646.002230:0:7614:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 40 00000100:00100000:1.0:1789366646.002241:0:7614:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96389077f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0ab23baa-a205-44ad-bf17-f7b47295d82b+11:10277:x1876286751401728:12345-192.168.202.23@tcp:101:bash.0 00010000:00010000:1.0:1789366646.002261:0:7614:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789366646.002293:0:7614:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9638b6ce2200/0x8da3486b955f3378 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xda917a494d06bfce expref: -99 pid: 7614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366646.002416:0:7614:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9638b6ce3800/0x8da3486b955f337f lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7614 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366646.002430:0:7614:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9638b6ce3800/0x8da3486b955f337f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7614 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366646.002441:0:7614:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9638b6ce3800/0x8da3486b955f337f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7614 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366646.002549:0:7614:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9638b6ce3000/0x8da3486b955f3386 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7614 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366646.002558:0:7614:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9638b6ce3000/0x8da3486b955f3386 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7614 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366646.002566:0:7614:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9638b6ce3000/0x8da3486b955f3386 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7614 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1789366646.003276:0:7614:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x2:0x0], index 1: 0 00010000:00010000:1.0:1789366646.003442:0:7614:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9638b6ce3c00/0x8da3486b955f338d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7614 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366646.003453:0:7614:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9638b6ce3c00/0x8da3486b955f338d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7614 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366646.003461:0:7614:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9638b6ce3c00/0x8da3486b955f338d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7614 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366646.003500:0:7614:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9638b6ce3800/0x8da3486b955f337f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7614 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366646.003508:0:7614:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9638b6ce3800/0x8da3486b955f337f lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7614 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366646.003515:0:7614:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9638b6ce3800/0x8da3486b955f337f lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7614 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366646.003521:0:7614:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9638b6ce3800 already unused, calling callback (ffffffffc20ee4f0) 00010000:00010000:1.0:1789366646.003525:0:7614:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9638b6ce3800/0x8da3486b955f337f lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7614 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366646.003532:0:7614:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9638b6ce3800/0x8da3486b955f337f lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7614 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366646.003544:0:7614:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff963890797000) 00010000:00010000:1.0:1789366646.003548:0:7614:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789366646.003553:0:7614:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9638b6ce3800/0x8da3486b955f337f lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7614 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366646.003559:0:7614:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9638b6ce3800/0x8da3486b955f337f lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7614 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789366646.003572:0:7614:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000001ca5be15 reply state 000000004af78515 transno 4294967311 ns: mdt-lustre-MDT0000_UUID lock: ffff9638b6ce3000/0x8da3486b955f3386 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7614 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789366646.003581:0:7614:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1789366646.003609:0:7614:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9638b6ce2200/0x8da3486b955f3378 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.23@tcp remote: 0xda917a494d06bfce expref: 14 pid: 7614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366646.003636:0:7614:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9638b6ce3c00/0x8da3486b955f338d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.23@tcp remote: 0xda917a494d06bfce expref: 13 pid: 7614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366646.003643:0:7614:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff963887f88600) 00010000:00010000:1.0:1789366646.003646:0:7614:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789366646.003648:0:7614:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9638b6ce3c00, rc 0) 00000100:00100000:1.0:1789366646.003711:0:7614:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96389077f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0ab23baa-a205-44ad-bf17-f7b47295d82b+14:10277:x1876286751401728:12345-192.168.202.23@tcp:101:bash.0 Request processed in 1473us (1695us total) trans 4294967311 rc 0/0 00000100:00080000:0.0:1789366646.003824:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789366646.005442:0:7614:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 40 00000100:00100000:1.0:1789366646.016037:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00010000:00010000:0.0:1789366646.016119:0:3271:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9638b6ce3000/0x8da3486b955f3386 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7614 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366646.016132:0:3271:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9638b6ce3000/0x8da3486b955f3386 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7614 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366646.016141:0:3271:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9638b6ce3000/0x8da3486b955f3386 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7614 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366646.016147:0:3271:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9638b6ce3000 already unused, calling callback (ffffffffc20ee4f0) 00010000:00010000:0.0:1789366646.016152:0:3271:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9638b6ce3000/0x8da3486b955f3386 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7614 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366646.016173:0:3271:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9638b6ce3000/0x8da3486b955f3386 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7614 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366646.016189:0:3271:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff963887f88f00) 00010000:00010000:0.0:1789366646.016192:0:3271:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789366646.016196:0:3271:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9638b6ce3000/0x8da3486b955f3386 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7614 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366646.016203:0:3271:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9638b6ce3000/0x8da3486b955f3386 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7614 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789366646.016305:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751401856 00000100:00100000:2.0:1789366646.016315:0:6660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751401856 00000100:00100000:2.0:1789366646.016360:0:6660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 20 00000100:00100000:2.0:1789366646.016368:0:6660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963890777b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2353:x1876286751401856:12345-192.168.202.23@tcp:8:bash.0 00010000:00080000:2.0:1789366646.016401:0:6660:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 0ab23baa-a205-44ad-bf17-f7b47295d82b@192.168.202.23@tcp t0 exp 0000000000000000 cur 221 last 0 00000020:00000080:2.0:1789366646.016432:0:6660:0:(genops.c:1385:class_connect()) connect: client 0ab23baa-a205-44ad-bf17-f7b47295d82b, cookie 0x8da3486b955f339b 00002000:00100000:2.0:1789366646.016444:0:6660:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 0ab23baa-a205-44ad-bf17-f7b47295d82b/ffff963888974800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a06 ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1789366646.016467:0:6660:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:2.0:1789366646.016694:0:6660:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1789366646.016973:0:6660:0:(import.c:65:import_set_state_nolock()) ffff963888970800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789366646.017075:0:6660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963890777b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0ab23baa-a205-44ad-bf17-f7b47295d82b+6:2353:x1876286751401856:12345-192.168.202.23@tcp:8:bash.0 Request processed in 705us (1045us total) trans 0 rc 0/0 00000100:00100000:2.0:1789366646.017084:0:6660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 20 00000100:00100000:3.0:1789366646.028040:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:3.0:1789366646.028224:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751401984 00000100:00100000:3.0:1789366646.028235:0:6661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751401984 00000100:00080000:0.0:1789366646.028300:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789366646.028570:0:6661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 21 00000100:00100000:3.0:1789366646.028583:0:6661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963785f2b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0ab23baa-a205-44ad-bf17-f7b47295d82b+6:0:x1876286751401984:12345-192.168.202.23@tcp:101:bash.0 00010000:00010000:3.0:1789366646.028603:0:6661:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789366646.028624:0:6661:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009dd57752/0x8da3486b955f33a2 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda917a494d06bfd5 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789366646.028653:0:6661:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789366646.028671:0:6661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=221s v=(0 0) 00010000:00010000:3.0:1789366646.028675:0:6661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789366646.028683:0:6661:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009dd57752/0x8da3486b955f33a2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.23@tcp remote: 0xda917a494d06bfd5 expref: 7 pid: 6661 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366646.028704:0:6661:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000009dd57752/0x8da3486b955f33a2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.23@tcp remote: 0xda917a494d06bfd5 expref: 7 pid: 6661 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366646.028745:0:6661:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9638832d3a00, rc 0) 00000100:00100000:3.0:1789366646.028798:0:6661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963785f2b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0ab23baa-a205-44ad-bf17-f7b47295d82b+7:0:x1876286751401984:12345-192.168.202.23@tcp:101:bash.0 Request processed in 219us (767us total) trans 0 rc 0/0 00000100:00100000:3.0:1789366646.028812:0:6661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 21 00000100:00100000:1.0:1789366646.040682:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:2.0:1789366646.040869:0:8065:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751402112 00000100:00100000:2.0:1789366646.040880:0:8065:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751402112 00000100:00100000:2.0:1789366646.040945:0:8065:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 22 00000100:00100000:2.0:1789366646.040955:0:8065:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963890775880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0ab23baa-a205-44ad-bf17-f7b47295d82b+7:10277:x1876286751402112:12345-192.168.202.23@tcp:101:bash.0 00010000:00010000:2.0:1789366646.040975:0:8065:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789366646.040996:0:8065:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000525fbea8/0x8da3486b955f33a9 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda917a494d06bfdc expref: -99 pid: 8065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366646.041027:0:8065:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000009dd57752/0x8da3486b955f33a2 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.23@tcp remote: 0xda917a494d06bfd5 expref: 8 pid: 6661 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366646.041037:0:8065:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789366646.041041:0:8065:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789366646.041046:0:8065:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000525fbea8/0x8da3486b955f33a9 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.23@tcp remote: 0xda917a494d06bfdc expref: 8 pid: 8065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366646.041090:0:8065:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000009dd57752/0x8da3486b955f33a2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.23@tcp remote: 0xda917a494d06bfd5 expref: 8 pid: 6661 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366646.041104:0:8065:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000009dd57752/0x8da3486b955f33a2 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.23@tcp remote: 0xda917a494d06bfd5 expref: 8 pid: 6661 timeout: 321 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789366646.041117:0:8065:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9638b702ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8065:1876286758769792:192.168.202.23@tcp:104: 00000100:00100000:2.0:1789366646.041204:0:8065:0:(client.c:2716:ptlrpc_set_wait()) set ffff963882ec9480 going to sleep for 11 seconds 00000100:00100000:2.0:1789366646.052337:0:8065:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9638b702ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8065:1876286758769792:192.168.202.23@tcp:104: 00010000:00010000:2.0:1789366646.052374:0:8065:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000525fbea8/0x8da3486b955f33a9 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.23@tcp remote: 0xda917a494d06bfdc expref: 8 pid: 8065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366646.052418:0:8065:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff963880031400, rc 0) 00000100:00100000:2.0:1789366646.052484:0:8065:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963890775880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0ab23baa-a205-44ad-bf17-f7b47295d82b+8:10277:x1876286751402112:12345-192.168.202.23@tcp:101:bash.0 Request processed in 11529us (11810us total) trans 0 rc 0/0 00000100:00100000:2.0:1789366646.052494:0:8065:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 22 00000100:00100000:3.0:1789366646.053293:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:0.0:1789366646.053360:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751402240 00000100:00100000:0.0:1789366646.053368:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751402240 00010000:00010000:0.0:1789366646.053404:0:5801:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000009dd57752/0x8da3486b955f33a2 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.23@tcp remote: 0xda917a494d06bfd5 expref: 8 pid: 6661 timeout: 321 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789366646.053774:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 34 00000100:00100000:0.0:1789366646.053784:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963785f28380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0ab23baa-a205-44ad-bf17-f7b47295d82b+8:2355:x1876286751402240:12345-192.168.202.23@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789366646.053800:0:5801:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789366646.053822:0:5801:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000009dd57752/0x8da3486b955f33a2 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.23@tcp remote: 0xda917a494d06bfd5 expref: 8 pid: 6661 timeout: 321 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366646.053837:0:5801:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000009dd57752/0x8da3486b955f33a2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.23@tcp remote: 0xda917a494d06bfd5 expref: 8 pid: 6661 timeout: 321 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366646.053860:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009dd57752/0x8da3486b955f33a2 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.23@tcp remote: 0xda917a494d06bfd5 expref: 8 pid: 6661 timeout: 321 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366646.053883:0:5801:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789366646.053888:0:5801:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789366646.053896:0:5801:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000525fbea8/0x8da3486b955f33a9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.23@tcp remote: 0xda917a494d06bfdc expref: 7 pid: 8065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366646.053906:0:5801:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000525fbea8/0x8da3486b955f33a9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.23@tcp remote: 0xda917a494d06bfdc expref: 7 pid: 8065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366646.053938:0:5801:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000525fbea8/0x8da3486b955f33a9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.23@tcp remote: 0xda917a494d06bfdc expref: 7 pid: 8065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789366646.053951:0:5801:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96389077ea00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5801:1876286758769920:192.168.202.23@tcp:105: 00000100:00100000:0.0:1789366646.054037:0:5801:0:(client.c:2716:ptlrpc_set_wait()) set ffff963885259240 going to sleep for 11 seconds 00000100:00100000:0.0:1789366646.058074:0:5801:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96389077ea00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5801:1876286758769920:192.168.202.23@tcp:105: 00010000:00010000:0.0:1789366646.058103:0:5801:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789366646.058431:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963785f28380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0ab23baa-a205-44ad-bf17-f7b47295d82b+7:2355:x1876286751402240:12345-192.168.202.23@tcp:103:ldlm_bl.0 Request processed in 4646us (5146us total) trans 0 rc 0/0 00000100:00100000:0.0:1789366646.058443:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 34 00000100:00100000:1.0:1789366646.060846:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:2.0:1789366646.060996:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751402496 00000100:00100000:2.0:1789366646.061007:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751402496 00000100:00100000:2.0:1789366646.061061:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 6 00000100:00100000:2.0:1789366646.061072:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963890774700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0ab23baa-a205-44ad-bf17-f7b47295d82b+13:10277:x1876286751402496:12345-192.168.202.23@tcp:35:bash.0 00000100:00100000:2.0:1789366646.061451:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963890774700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0ab23baa-a205-44ad-bf17-f7b47295d82b+14:10277:x1876286751402496:12345-192.168.202.23@tcp:35:bash.0 Request processed in 380us (612us total) trans 4294967312 rc 0/0 00000100:00100000:2.0:1789366646.061459:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 6 00000100:00100000:3.0:1789366646.119374:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:0.0:1789366646.120689:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751402752 00000100:00100000:0.0:1789366646.120702:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751402752 00000100:00100000:0.0:1789366646.120811:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 41 00000100:00100000:0.0:1789366646.120822:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963785f29c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0ab23baa-a205-44ad-bf17-f7b47295d82b+14:10287:x1876286751402752:12345-192.168.202.23@tcp:101:lfs.0 00010000:00010000:0.0:1789366646.120846:0:5816:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789366646.120867:0:5816:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720c000/0x8da3486b955f33b0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xda917a494d06bfe3 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789366646.120972:0:5816:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:0.0:1789366646.121068:0:5816:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720c000/0x8da3486b955f33b0 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.23@tcp remote: 0xda917a494d06bfe3 expref: 16 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366646.121087:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff963890797800) 00010000:00010000:0.0:1789366646.121091:0:5816:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1789366646.121097:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720c000/0x8da3486b955f33b0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.23@tcp remote: 0xda917a494d06bfe3 expref: 16 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366646.121111:0:5816:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9638b720c000, rc 0) 00000100:00100000:0.0:1789366646.121159:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963785f29c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0ab23baa-a205-44ad-bf17-f7b47295d82b+15:10287:x1876286751402752:12345-192.168.202.23@tcp:101:lfs.0 Request processed in 340us (1797us total) trans 4294967313 rc 301/301 00000100:00100000:0.0:1789366646.121164:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 41 00000100:00100000:1.0:1789366646.129997:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:2.0:1789366646.130104:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751403008 00000100:00100000:2.0:1789366646.130115:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751403008 00000100:00100000:2.0:1789366646.130174:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 7 00000100:00100000:2.0:1789366646.130185:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963890776d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0ab23baa-a205-44ad-bf17-f7b47295d82b+15:10287:x1876286751403008:12345-192.168.202.23@tcp:35:lfs.0 00000100:00100000:2.0:1789366646.130429:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963890776d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0ab23baa-a205-44ad-bf17-f7b47295d82b+16:10287:x1876286751403008:12345-192.168.202.23@tcp:35:lfs.0 Request processed in 246us (440us total) trans 4294967314 rc 0/0 00000100:00100000:2.0:1789366646.130437:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 7 00000100:00100000:1.0:1789366646.191667:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:0.0:1789366646.191849:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751403136 00000100:00100000:0.0:1789366646.191859:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751403136 00000100:00100000:0.0:1789366646.191923:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 42 00000100:00100000:0.0:1789366646.191933:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963890774a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0ab23baa-a205-44ad-bf17-f7b47295d82b+16:10293:x1876286751403136:12345-192.168.202.23@tcp:101:lfs.0 00010000:00010000:0.0:1789366646.191956:0:5817:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789366646.191977:0:5817:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720c200/0x8da3486b955f33be lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xda917a494d06bfea expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366646.192051:0:5817:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720c800/0x8da3486b955f33c5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366646.192066:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720c800/0x8da3486b955f33c5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366646.192094:0:5817:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720c800/0x8da3486b955f33c5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789366646.192129:0:5817:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00000004:00200000:0.0:1789366646.192134:0:5817:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1789366646.192151:0:5817:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720c800/0x8da3486b955f33c5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366646.192178:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720c200/0x8da3486b955f33be lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.23@tcp remote: 0xda917a494d06bfea expref: 18 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366646.192197:0:5817:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720c800/0x8da3486b955f33c5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.23@tcp remote: 0xda917a494d06bfea expref: 17 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366646.192206:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff963890797000) 00010000:00010000:0.0:1789366646.192209:0:5817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789366646.192213:0:5817:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9638b720c800, rc 0) 00000100:00100000:0.0:1789366646.192289:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963890774a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0ab23baa-a205-44ad-bf17-f7b47295d82b+17:10293:x1876286751403136:12345-192.168.202.23@tcp:101:lfs.0 Request processed in 347us (630us total) trans 0 rc 0/0 00000100:00100000:0.0:1789366646.192297:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 42 00000100:00100000:0.0:1789366646.196931:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:1.0:1789366646.197029:0:7614:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751403392 00000100:00100000:1.0:1789366646.197038:0:7614:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751403392 00000100:00100000:1.0:1789366646.197096:0:7614:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 43 00000100:00100000:1.0:1789366646.197107:0:7614:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96389077ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0ab23baa-a205-44ad-bf17-f7b47295d82b+17:10293:x1876286751403392:12345-192.168.202.23@tcp:101:lfs.0 00010000:00010000:1.0:1789366646.197126:0:7614:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789366646.197145:0:7614:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9638b6ce2600/0x8da3486b955f33cc lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xda917a494d06bff1 expref: -99 pid: 7614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366646.197243:0:7614:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9638b6ce2400/0x8da3486b955f33d3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7614 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366646.197258:0:7614:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9638b6ce2400/0x8da3486b955f33d3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7614 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366646.197295:0:7614:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9638b6ce2400/0x8da3486b955f33d3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7614 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789366646.197309:0:7614:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:1.0:1789366646.197435:0:7614:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9638b6ce2600/0x8da3486b955f33cc lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.23@tcp remote: 0xda917a494d06bff1 expref: 20 pid: 7614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366646.197454:0:7614:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9638b6ce2400/0x8da3486b955f33d3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.23@tcp remote: 0xda917a494d06bff1 expref: 19 pid: 7614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366646.197463:0:7614:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff963887f88600) 00010000:00010000:1.0:1789366646.197466:0:7614:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789366646.197470:0:7614:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9638b6ce2400, rc 0) 00000100:00100000:1.0:1789366646.197533:0:7614:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96389077ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0ab23baa-a205-44ad-bf17-f7b47295d82b+19:10293:x1876286751403392:12345-192.168.202.23@tcp:101:lfs.0 Request processed in 428us (613us total) trans 4294967315 rc 0/0 00000100:00100000:1.0:1789366646.197540:0:7614:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 43 00000100:00100000:1.0:1789366646.201530:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:3.0:1789366646.201610:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751403648 00000100:00100000:3.0:1789366646.201626:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751403648 00000100:00100000:3.0:1789366646.201686:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 44 00000100:00100000:3.0:1789366646.201696:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963890776680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0ab23baa-a205-44ad-bf17-f7b47295d82b+19:10293:x1876286751403648:12345-192.168.202.23@tcp:101:lfs.0 00010000:00010000:3.0:1789366646.201752:0:5815:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789366646.201772:0:5815:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9638832d3600/0x8da3486b955f33e1 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xda917a494d06bff8 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366646.201860:0:5815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9638832d3c00/0x8da3486b955f33e8 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366646.201874:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9638832d3c00/0x8da3486b955f33e8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366646.201886:0:5815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9638832d3c00/0x8da3486b955f33e8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789366646.201898:0:5815:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:3.0:1789366646.202179:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9638832d3600/0x8da3486b955f33e1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.23@tcp remote: 0xda917a494d06bff8 expref: 22 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366646.202198:0:5815:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9638832d3c00/0x8da3486b955f33e8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.23@tcp remote: 0xda917a494d06bff8 expref: 21 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366646.202207:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff963887f88600) 00010000:00010000:3.0:1789366646.202220:0:5815:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1789366646.202224:0:5815:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9638832d3c00, rc 0) 00000100:00100000:2.0:1789366646.202358:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963890776680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0ab23baa-a205-44ad-bf17-f7b47295d82b+21:10293:x1876286751403648:12345-192.168.202.23@tcp:101:lfs.0 Request processed in 663us (837us total) trans 4294967316 rc 0/0 00000100:00100000:2.0:1789366646.202366:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 44 00000100:00100000:2.0:1789366646.205024:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:1.0:1789366646.205101:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751403776 00000100:00100000:1.0:1789366646.205110:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751403776 00000100:00100000:1.0:1789366646.205172:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 2 00000100:00100000:1.0:1789366646.205182:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638b702ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0ab23baa-a205-44ad-bf17-f7b47295d82b+21:2354:x1876286751403776:12345-192.168.202.23@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789366646.205197:0:5803:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789366646.205219:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9638b6ce2400/0x8da3486b955f33d3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.23@tcp remote: 0xda917a494d06bff1 expref: 21 pid: 7614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366646.205237:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff963887f88600) 00010000:00010000:1.0:1789366646.205253:0:5803:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789366646.205320:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638b702ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0ab23baa-a205-44ad-bf17-f7b47295d82b+20:2354:x1876286751403776:12345-192.168.202.23@tcp:103:ldlm_bl.0 Request processed in 139us (316us total) trans 0 rc 0/0 00000100:00100000:1.0:1789366646.205328:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 2 00000100:00100000:0.0:1789366646.210355:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:3.0:1789366646.210441:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751403904 00000100:00100000:3.0:1789366646.210451:0:6661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751403904 00000100:00100000:3.0:1789366646.210508:0:6661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 23 00000100:00100000:3.0:1789366646.210521:0:6661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96389077f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0ab23baa-a205-44ad-bf17-f7b47295d82b+7:2357:x1876286751403904:12345-192.168.202.23@tcp:1:lfs.0 00010000:00010000:3.0:1789366646.210570:0:6661:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000082beeec3/0x8da3486b955f33f6 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366646.210591:0:6661:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000525fbea8/0x8da3486b955f33a9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.23@tcp remote: 0xda917a494d06bfdc expref: 7 pid: 8065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366646.210600:0:6661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789366646.210605:0:6661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789366646.210609:0:6661:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000082beeec3/0x8da3486b955f33f6 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366646.210645:0:6661:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000525fbea8/0x8da3486b955f33a9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.23@tcp remote: 0xda917a494d06bfdc expref: 7 pid: 8065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366646.210875:0:6661:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000525fbea8/0x8da3486b955f33a9 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.23@tcp remote: 0xda917a494d06bfdc expref: 7 pid: 8065 timeout: 321 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789366646.210892:0:6661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff963785f2a300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6661:1876286758770048:192.168.202.23@tcp:104: 00000100:00100000:3.0:1789366646.210994:0:6661:0:(client.c:2716:ptlrpc_set_wait()) set ffff9638b729e540 going to sleep for 11 seconds 00000100:00100000:0.0:1789366646.214152:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:1.0:1789366646.214239:0:6664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751404032 00000100:00100000:1.0:1789366646.214247:0:6664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751404032 00002000:00100000:1.0:1789366646.214298:0:6664:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x2:0x0] (0->12) req@ffff96389077c000 x1876286751404032/t0(0) o4->0ab23baa-a205-44ad-bf17-f7b47295d82b@192.168.202.23@tcp:47/0 lens 504/0 e 0 to 0 dl 1789366657 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789366646.214310:0:6664:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff96389077c000 with x1876286751404032 ext(0->12) 00010000:00010000:1.0:1789366646.214319:0:6664:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000525fbea8/0x8da3486b955f33a9 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.23@tcp remote: 0xda917a494d06bfdc expref: 8 pid: 8065 timeout: 321 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366646.214334:0:6664:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000525fbea8/0x8da3486b955f33a9 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.23@tcp remote: 0xda917a494d06bfdc expref: 8 pid: 8065 timeout: 321 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789366646.214342:0:6664:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff96389077c000 00000100:00100000:1.0:1789366646.214373:0:6664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 0 00000100:00100000:1.0:1789366646.214382:0:6664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96389077c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0ab23baa-a205-44ad-bf17-f7b47295d82b+8:2355:x1876286751404032:12345-192.168.202.23@tcp:4:lfs.0 00000100:00100000:3.0:1789366646.214776:0:6661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff963785f2a300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6661:1876286758770048:192.168.202.23@tcp:104: 00010000:00010000:3.0:1789366646.214810:0:6661:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000082beeec3/0x8da3486b955f33f6 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00100000:1.0:1789366646.248194:0:7617:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 0ab23baa-a205-44ad-bf17-f7b47295d82b 00000100:00100000:0.0:1789366646.249472:0:6664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96389077c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0ab23baa-a205-44ad-bf17-f7b47295d82b+9:2355:x1876286751404032:12345-192.168.202.23@tcp:4:lfs.0 Request processed in 35085us (35321us total) trans 4294967299 rc 0/0 00000100:00100000:0.0:1789366646.249488:0:6664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 0 00002000:00100000:0.0:1789366646.249502:0:6664:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x2:0x0] (0->12) req@ffff96389077c000 x1876286751404032/t4294967299(0) o4->0ab23baa-a205-44ad-bf17-f7b47295d82b@192.168.202.23@tcp:47/0 lens 504/448 e 0 to 0 dl 1789366657 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789366646.249522:0:6664:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff96389077c000 with x1876286751404032 ext(0->12) 00010000:00010000:0.0:1789366646.249534:0:6664:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000525fbea8/0x8da3486b955f33a9 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.23@tcp remote: 0xda917a494d06bfdc expref: 9 pid: 8065 timeout: 321 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366646.249555:0:6664:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000525fbea8/0x8da3486b955f33a9 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.23@tcp remote: 0xda917a494d06bfdc expref: 9 pid: 8065 timeout: 321 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789366646.249564:0:6664:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff96389077c000 00000100:00100000:1.0:1789366646.251947:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:3.0:1789366646.252094:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751404160 00000100:00100000:3.0:1789366646.252104:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751404160 00010000:00010000:3.0:1789366646.252141:0:5802:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000525fbea8/0x8da3486b955f33a9 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.23@tcp remote: 0xda917a494d06bfdc expref: 9 pid: 8065 timeout: 321 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789366646.252183:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 35 00000100:00100000:3.0:1789366646.252193:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963890775c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0ab23baa-a205-44ad-bf17-f7b47295d82b+9:2355:x1876286751404160:12345-192.168.202.23@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789366646.252206:0:5802:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:3.0:1789366646.252226:0:5802:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x2:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:3.0:1789366646.252229:0:5802:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x2:0x0] updating lvb mtime from disk: 0 -> 1789366646 00002000:00010000:3.0:1789366646.252231:0:5802:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x2:0x0] updating lvb atime from disk: 0 -> 1789366646 00002000:00010000:3.0:1789366646.252233:0:5802:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x2:0x0] updating lvb ctime from disk: 0 -> 1789366646 00010000:00010000:3.0:1789366646.252239:0:5802:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000525fbea8/0x8da3486b955f33a9 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.23@tcp remote: 0xda917a494d06bfdc expref: 9 pid: 8065 timeout: 321 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366646.252252:0:5802:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000525fbea8/0x8da3486b955f33a9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.23@tcp remote: 0xda917a494d06bfdc expref: 9 pid: 8065 timeout: 321 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366646.252273:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000525fbea8/0x8da3486b955f33a9 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.23@tcp remote: 0xda917a494d06bfdc expref: 9 pid: 8065 timeout: 321 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366646.252299:0:5802:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789366646.252303:0:5802:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789366646.252322:0:5802:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000082beeec3/0x8da3486b955f33f6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366646.252331:0:5802:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000082beeec3/0x8da3486b955f33f6 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366646.252401:0:5802:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789366646.252451:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963890775c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0ab23baa-a205-44ad-bf17-f7b47295d82b+8:2355:x1876286751404160:12345-192.168.202.23@tcp:103:ldlm_bl.0 Request processed in 259us (511us total) trans 0 rc 0/0 00000100:00100000:3.0:1789366646.252459:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 35 00010000:00010000:1.0:1789366646.253545:0:6661:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000082beeec3/0x8da3486b955f33f6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366646.253562:0:6661:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000082beeec3/0x8da3486b955f33f6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366646.253609:0:6661:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000082beeec3/0x8da3486b955f33f6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366646.253626:0:6661:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000082beeec3/0x8da3486b955f33f6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366646.253633:0:6661:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000082beeec3/0x8da3486b955f33f6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366646.253641:0:6661:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9638832d3600 already unused, calling callback (ffffffffc16df520) 00010000:00010000:1.0:1789366646.253645:0:6661:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000082beeec3/0x8da3486b955f33f6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366646.253660:0:6661:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000082beeec3/0x8da3486b955f33f6 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366646.253677:0:6661:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000082beeec3/0x8da3486b955f33f6 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366646.253685:0:6661:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000082beeec3/0x8da3486b955f33f6 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789366646.253775:0:6661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96389077f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0ab23baa-a205-44ad-bf17-f7b47295d82b+7:2357:x1876286751403904:12345-192.168.202.23@tcp:1:lfs.0 Request processed in 43254us (43427us total) trans 0 rc 0/0 00000100:00100000:1.0:1789366646.253784:0:6661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 23 00000100:00100000:1.0:1789366646.256416:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:2.0:1789366646.256488:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751404416 00000100:00100000:2.0:1789366646.256497:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751404416 00000100:00100000:2.0:1789366646.256584:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 8 00000100:00100000:2.0:1789366646.256594:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963890775180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0ab23baa-a205-44ad-bf17-f7b47295d82b+20:10293:x1876286751404416:12345-192.168.202.23@tcp:35:lfs.0 00000004:00010000:2.0:1789366646.256669:0:5818:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0x4:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9638832d3c00/0x8da3486b955f33e8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.23@tcp remote: 0xda917a494d06bff8 expref: 20 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789366646.256943:0:5818:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967317 00000001:00080000:2.0:1789366646.256993:0:5818:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967318 00000001:00080000:2.0:1789366646.258479:0:5818:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967319 00010000:00010000:2.0:1789366646.258547:0:5818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff963880030000/0x8da3486b955f33fd lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366646.258566:0:5818:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9638b6ce3c00/0x8da3486b955f338d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.23@tcp remote: 0xda917a494d06bfce expref: 24 pid: 7614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366646.258576:0:5818:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff963880030000/0x8da3486b955f33fd lrc: 4/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366646.258611:0:5818:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9638b6ce3c00/0x8da3486b955f338d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.23@tcp remote: 0xda917a494d06bfce expref: 24 pid: 7614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366646.259421:0:5818:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9638b6ce3c00/0x8da3486b955f338d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.23@tcp remote: 0xda917a494d06bfce expref: 24 pid: 7614 timeout: 321 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789366646.259437:0:5818:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9638b702e680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5818:1876286758770176:192.168.202.23@tcp:104: 00000100:00100000:2.0:1789366646.259575:0:5818:0:(client.c:2716:ptlrpc_set_wait()) set ffff9638bf0cb900 going to sleep for 11 seconds 00000100:00100000:2.0:1789366646.263369:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:0.0:1789366646.263985:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751404544 00000100:00100000:0.0:1789366646.263996:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751404544 00010000:00010000:0.0:1789366646.264046:0:5803:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9638b6ce3c00/0x8da3486b955f338d lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.23@tcp remote: 0xda917a494d06bfce expref: 25 pid: 7614 timeout: 321 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789366646.264178:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 36 00000100:00100000:0.0:1789366646.264189:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638b702c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0ab23baa-a205-44ad-bf17-f7b47295d82b+25:2354:x1876286751404544:12345-192.168.202.23@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789366646.264204:0:5803:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789366646.264211:0:5803:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9638b6ce3c00/0x8da3486b955f338d lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.23@tcp remote: 0xda917a494d06bfce expref: 25 pid: 7614 timeout: 321 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366646.264225:0:5803:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9638b6ce3c00/0x8da3486b955f338d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.23@tcp remote: 0xda917a494d06bfce expref: 25 pid: 7614 timeout: 321 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366646.264248:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff963887f88600) 00010000:00010000:0.0:1789366646.264255:0:5803:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff963880030000/0x8da3486b955f33fd lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366646.264290:0:5803:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff963880030000/0x8da3486b955f33fd lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366646.264298:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff963880030000/0x8da3486b955f33fd lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366646.264318:0:5803:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789366646.264374:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638b702c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0ab23baa-a205-44ad-bf17-f7b47295d82b+25:2354:x1876286751404544:12345-192.168.202.23@tcp:103:ldlm_bl.0 Request processed in 187us (1017us total) trans 0 rc 0/0 00000100:00100000:0.0:1789366646.264382:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 36 00010000:00010000:1.0:1789366646.265311:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9638b6ce3c00/0x8da3486b955f338d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.23@tcp remote: 0xda917a494d06bfce expref: 24 pid: 7614 timeout: 321 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789366646.265331:0:5818:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9638b702e680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5818:1876286758770176:192.168.202.23@tcp:104: 00010000:00010000:1.0:1789366646.265355:0:5818:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff963880030000/0x8da3486b955f33fd lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366646.265365:0:5818:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff963880030000/0x8da3486b955f33fd lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366646.265370:0:5818:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff963880030000/0x8da3486b955f33fd lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789366646.265498:0:5818:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967320 00000001:00080000:1.0:1789366646.265708:0:5818:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967321 00000100:00100000:1.0:1789366646.265842:0:5818:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff963890775500 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5818:1876286758770304:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1789366646.265940:0:5818:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789366646.265992:0:5818:0:(client.c:2716:ptlrpc_set_wait()) set ffff9638bfe9c6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789366646.266385:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286758770304 00000100:00100000:1.0:1789366646.266392:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286758770304 00000100:00100000:1.0:1789366646.266489:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789366646.266499:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963890774e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5818:x1876286758770304:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1789366646.266590:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963890774e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5818:x1876286758770304:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 93us (649us total) trans 0 rc 0/0 00000100:00100000:1.0:1789366646.266597:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789366646.266634:0:5818:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff963890775500 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5818:1876286758770304:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:1.0:1789366646.267593:0:5818:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967322 00000100:00100000:1.0:1789366646.267680:0:5818:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff963890775500 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5818:1876286758770432:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1789366646.267714:0:5818:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789366646.267766:0:5818:0:(client.c:2716:ptlrpc_set_wait()) set ffff9638bfe9c3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789366646.267783:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286758770432 00000100:00100000:1.0:1789366646.267788:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286758770432 00000100:00100000:1.0:1789366646.267817:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789366646.267823:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963890776300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5818:x1876286758770432:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1789366646.267958:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963890776300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5818:x1876286758770432:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 135us (243us total) trans 4294967300 rc 0/0 00000100:00100000:1.0:1789366646.267965:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789366646.267999:0:5818:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff963890775500 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5818:1876286758770432:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:1.0:1789366646.268463:0:5818:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967323 00010000:00010000:1.0:1789366646.268497:0:5818:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff963880030000/0x8da3486b955f33fd lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366646.268507:0:5818:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff963880030000/0x8da3486b955f33fd lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366646.268514:0:5818:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff963880030000/0x8da3486b955f33fd lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366646.268519:0:5818:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff963880030000 already unused, calling callback (ffffffffc20ee4f0) 00010000:00010000:1.0:1789366646.268523:0:5818:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff963880030000/0x8da3486b955f33fd lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366646.268530:0:5818:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff963880030000/0x8da3486b955f33fd lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366646.268544:0:5818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff963887f88600) 00010000:00010000:1.0:1789366646.268552:0:5818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:1.0:1789366646.268557:0:5818:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff963880030000/0x8da3486b955f33fd lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366646.268563:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff963880030000/0x8da3486b955f33fd lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1789366646.268861:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000004:00080000:1.0:1789366646.269040:0:5818:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x5:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:1.0:1789366646.269335:0:5818:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].2, 64 off8320 00000004:00080000:1.0:1789366646.269347:0:5818:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 221733628338ns, next at 222733626088ns, rc = 0 00000001:00080000:1.0:1789366646.269354:0:5818:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967324 00010000:00010000:1.0:1789366646.269387:0:5818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff963887f88600) 00010000:00010000:1.0:1789366646.269390:0:5818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1789366646.269398:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9638832d3c00/0x8da3486b955f33e8 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.23@tcp remote: 0xda917a494d06bff8 expref: 28 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789366646.269493:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963890775180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0ab23baa-a205-44ad-bf17-f7b47295d82b+27:10293:x1876286751404416:12345-192.168.202.23@tcp:35:lfs.0 Request processed in 12900us (13084us total) trans 4294967325 rc 0/0 00000100:00100000:1.0:1789366646.269502:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 8 00000020:00080000:1.0:1789366646.269507:0:5818:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:2.0:1789366646.272338:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:3.0:1789366646.272417:0:7132:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751404672 00000100:00100000:3.0:1789366646.272428:0:7132:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751404672 00000100:00100000:3.0:1789366646.272517:0:7132:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 45 00000100:00100000:3.0:1789366646.272528:0:7132:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638b702e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0ab23baa-a205-44ad-bf17-f7b47295d82b+27:10293:x1876286751404672:12345-192.168.202.23@tcp:101:lfs.0 00010000:00010000:3.0:1789366646.272549:0:7132:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789366646.272571:0:7132:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9638832d2000/0x8da3486b955f3404 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xda917a494d06bfff expref: -99 pid: 7132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366646.272638:0:7132:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9638832d2000/0x8da3486b955f3404 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.23@tcp remote: 0xda917a494d06bfff expref: 28 pid: 7132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366646.272652:0:7132:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9638832d2000/0x8da3486b955f3404 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.23@tcp remote: 0xda917a494d06bfff expref: 28 pid: 7132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366646.272670:0:7132:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff96388c43f000) 00010000:00010000:3.0:1789366646.272673:0:7132:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1789366646.272690:0:7132:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9638832d2000, rc 0) 00000100:00100000:3.0:1789366646.272947:0:7132:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638b702e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0ab23baa-a205-44ad-bf17-f7b47295d82b+28:10293:x1876286751404672:12345-192.168.202.23@tcp:101:lfs.0 Request processed in 421us (616us total) trans 0 rc 0/0 00000100:00100000:3.0:1789366646.272954:0:7132:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 45 00000100:00100000:0.0:1789366646.280858:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:3.0:1789366646.280928:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751404928 00000100:00100000:3.0:1789366646.280937:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751404928 00000100:00100000:3.0:1789366646.281406:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 9 00000100:00100000:3.0:1789366646.281418:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963888cb9c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0ab23baa-a205-44ad-bf17-f7b47295d82b+28:10293:x1876286751404928:12345-192.168.202.23@tcp:35:lfs.0 00000100:00100000:3.0:1789366646.281660:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963888cb9c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0ab23baa-a205-44ad-bf17-f7b47295d82b+29:10293:x1876286751404928:12345-192.168.202.23@tcp:35:lfs.0 Request processed in 244us (811us total) trans 4294967326 rc 0/0 00000100:00100000:3.0:1789366646.281668:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 9 00000100:00100000:0.0:1789366646.350194:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:3.0:1789366646.350296:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751405184 00000100:00100000:3.0:1789366646.350306:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751405184 00000100:00100000:3.0:1789366646.350369:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 46 00000100:00100000:3.0:1789366646.350379:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96389077df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0ab23baa-a205-44ad-bf17-f7b47295d82b+29:10303:x1876286751405184:12345-192.168.202.23@tcp:101:lfs.0 00010000:00010000:3.0:1789366646.350404:0:5816:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789366646.350428:0:5816:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9638832d3400/0x8da3486b955f340b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xda917a494d06c006 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789366646.350514:0:5816:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:3.0:1789366646.350636:0:5816:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9638832d3400/0x8da3486b955f340b lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.23@tcp remote: 0xda917a494d06c006 expref: 31 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366646.350651:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff963890797800) 00010000:00010000:3.0:1789366646.350843:0:5816:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789366646.350849:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9638832d3400/0x8da3486b955f340b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.23@tcp remote: 0xda917a494d06c006 expref: 31 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366646.350884:0:5816:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9638832d3400, rc 0) 00000100:00100000:3.0:1789366646.351149:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96389077df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0ab23baa-a205-44ad-bf17-f7b47295d82b+30:10303:x1876286751405184:12345-192.168.202.23@tcp:101:lfs.0 Request processed in 770us (964us total) trans 4294967327 rc 301/301 00000100:00100000:3.0:1789366646.351157:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 46 00000100:00100000:2.0:1789366646.353356:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:0.0:1789366646.353450:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751405312 00000100:00100000:0.0:1789366646.353459:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751405312 00000100:00100000:0.0:1789366646.353554:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 47 00000100:00100000:0.0:1789366646.353563:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638b7350000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0ab23baa-a205-44ad-bf17-f7b47295d82b+30:10303:x1876286751405312:12345-192.168.202.23@tcp:34:lfs.0 00010000:00010000:0.0:1789366646.353633:0:5815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720c400/0x8da3486b955f3419 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366646.353649:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720c400/0x8da3486b955f3419 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366646.353711:0:5815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720c400/0x8da3486b955f3419 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366646.353753:0:5815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720d600/0x8da3486b955f3420 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366646.353758:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720d600/0x8da3486b955f3420 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366646.353768:0:5815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720d600/0x8da3486b955f3420 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366646.353850:0:5815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720ca00/0x8da3486b955f3427 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366646.353856:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720ca00/0x8da3486b955f3427 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366646.353861:0:5815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720ca00/0x8da3486b955f3427 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789366646.353893:0:5815:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720ca00/0x8da3486b955f3427 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366646.353902:0:5815:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720c400/0x8da3486b955f3419 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366646.353906:0:5815:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720c400/0x8da3486b955f3419 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366646.353910:0:5815:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720c400/0x8da3486b955f3419 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366646.353914:0:5815:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9638b720c400 already unused, calling callback (ffffffffc20ee4f0) 00010000:00010000:0.0:1789366646.353917:0:5815:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720c400/0x8da3486b955f3419 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366646.353921:0:5815:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720c400/0x8da3486b955f3419 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366646.353928:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff963890797000) 00010000:00010000:0.0:1789366646.353934:0:5815:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789366646.353938:0:5815:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720c400/0x8da3486b955f3419 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366646.353942:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720c400/0x8da3486b955f3419 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366646.353951:0:5815:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720d600/0x8da3486b955f3420 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366646.353954:0:5815:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720d600/0x8da3486b955f3420 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366646.353958:0:5815:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720d600/0x8da3486b955f3420 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366646.353961:0:5815:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9638b720d600 already unused, calling callback (ffffffffc20ee4f0) 00010000:00010000:0.0:1789366646.353962:0:5815:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720d600/0x8da3486b955f3420 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366646.353966:0:5815:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720d600/0x8da3486b955f3420 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366646.353969:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff963890797a00) 00010000:00010000:0.0:1789366646.353971:0:5815:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789366646.353972:0:5815:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720d600/0x8da3486b955f3420 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366646.353975:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720d600/0x8da3486b955f3420 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366646.353984:0:5815:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720ca00/0x8da3486b955f3427 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366646.353991:0:5815:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720ca00/0x8da3486b955f3427 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366646.353994:0:5815:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720ca00/0x8da3486b955f3427 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366646.353997:0:5815:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9638b720ca00 already unused, calling callback (ffffffffc20ee4f0) 00010000:00010000:0.0:1789366646.353999:0:5815:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720ca00/0x8da3486b955f3427 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366646.354002:0:5815:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720ca00/0x8da3486b955f3427 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366646.354007:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff96388c43f000) 00010000:00010000:0.0:1789366646.354009:0:5815:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789366646.354011:0:5815:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720ca00/0x8da3486b955f3427 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366646.354016:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720ca00/0x8da3486b955f3427 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789366646.354076:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638b7350000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0ab23baa-a205-44ad-bf17-f7b47295d82b+30:10303:x1876286751405312:12345-192.168.202.23@tcp:34:lfs.0 Request processed in 514us (728us total) trans 0 rc 0/0 00000100:00100000:0.0:1789366646.354081:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 47 00000100:00100000:0.0:1789366646.357547:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:2.0:1789366646.358436:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751405568 00000100:00100000:2.0:1789366646.358461:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751405568 00000100:00100000:2.0:1789366646.358531:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 10 00000100:00100000:2.0:1789366646.358541:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96389077fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0ab23baa-a205-44ad-bf17-f7b47295d82b+30:10303:x1876286751405568:12345-192.168.202.23@tcp:35:lfs.0 00000100:00100000:2.0:1789366646.359049:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96389077fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0ab23baa-a205-44ad-bf17-f7b47295d82b+31:10303:x1876286751405568:12345-192.168.202.23@tcp:35:lfs.0 Request processed in 508us (1520us total) trans 4294967328 rc 0/0 00000100:00100000:2.0:1789366646.359057:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 10 00000100:00100000:3.0:1789366646.395375:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:2.0:1789366646.395857:0:7132:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751405824 00000100:00100000:2.0:1789366646.395867:0:7132:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751405824 00000100:00100000:2.0:1789366646.395952:0:7132:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 48 00000100:00100000:2.0:1789366646.395963:0:7132:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963785f2a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0ab23baa-a205-44ad-bf17-f7b47295d82b+31:10306:x1876286751405824:12345-192.168.202.23@tcp:101:lfs.0 00010000:00010000:2.0:1789366646.395984:0:7132:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789366646.396058:0:7132:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff963880030000/0x8da3486b955f342e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xda917a494d06c00d expref: -99 pid: 7132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366646.396121:0:7132:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff963880031400/0x8da3486b955f3435 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366646.396134:0:7132:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff963880031400/0x8da3486b955f3435 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366646.396151:0:7132:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff963880031400/0x8da3486b955f3435 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366646.396168:0:7132:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff963880030600/0x8da3486b955f343c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366646.396176:0:7132:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff963880030600/0x8da3486b955f343c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366646.396183:0:7132:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff963880030600/0x8da3486b955f343c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366646.396346:0:7132:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff963880030e00/0x8da3486b955f3443 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366646.396545:0:7132:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff963880030e00/0x8da3486b955f3443 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366646.396551:0:7132:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff963880030e00/0x8da3486b955f3443 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789366646.396560:0:7132:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:2.0:1789366646.396836:0:7132:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff963880031400/0x8da3486b955f3435 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366646.396843:0:7132:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff963880031400/0x8da3486b955f3435 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366646.396848:0:7132:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff963880031400/0x8da3486b955f3435 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366646.396851:0:7132:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff963880031400 already unused, calling callback (ffffffffc20ee4f0) 00010000:00010000:2.0:1789366646.396854:0:7132:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff963880031400/0x8da3486b955f3435 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366646.396861:0:7132:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff963880031400/0x8da3486b955f3435 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366646.396871:0:7132:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff963890797000) 00010000:00010000:2.0:1789366646.396873:0:7132:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789366646.396877:0:7132:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff963880031400/0x8da3486b955f3435 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366646.396889:0:7132:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff963880031400/0x8da3486b955f3435 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366646.396908:0:7132:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff963880030600/0x8da3486b955f343c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366646.396911:0:7132:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff963880030600/0x8da3486b955f343c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366646.396915:0:7132:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff963880030600/0x8da3486b955f343c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366646.396918:0:7132:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff963880030600 already unused, calling callback (ffffffffc20ee4f0) 00010000:00010000:2.0:1789366646.396920:0:7132:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff963880030600/0x8da3486b955f343c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366646.396923:0:7132:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff963880030600/0x8da3486b955f343c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366646.396927:0:7132:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9638a7404600) 00010000:00010000:2.0:1789366646.396929:0:7132:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789366646.396930:0:7132:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff963880030600/0x8da3486b955f343c lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366646.396933:0:7132:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff963880030600/0x8da3486b955f343c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366646.396971:0:7132:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff963880030000/0x8da3486b955f342e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.23@tcp remote: 0xda917a494d06c00d expref: 34 pid: 7132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366646.396980:0:7132:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff963880030e00/0x8da3486b955f3443 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.23@tcp remote: 0xda917a494d06c00d expref: 33 pid: 7132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366646.396989:0:7132:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff96388c43f000) 00010000:00010000:2.0:1789366646.396991:0:7132:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789366646.396992:0:7132:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff963880030e00, rc 0) 00000100:00100000:2.0:1789366646.397198:0:7132:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963785f2a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0ab23baa-a205-44ad-bf17-f7b47295d82b+33:10306:x1876286751405824:12345-192.168.202.23@tcp:101:lfs.0 Request processed in 1235us (1832us total) trans 4294967329 rc 0/0 00000100:00100000:2.0:1789366646.397206:0:7132:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 48 00000100:00100000:0.0:1789366646.399231:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:3.0:1789366646.399469:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751405952 00000100:00100000:3.0:1789366646.399478:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751405952 00000100:00100000:3.0:1789366646.399529:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 49 00000100:00100000:3.0:1789366646.399539:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96389077d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0ab23baa-a205-44ad-bf17-f7b47295d82b+33:10306:x1876286751405952:12345-192.168.202.23@tcp:54:lfs.0 00010000:00010000:3.0:1789366646.399606:0:5816:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9638832d3400/0x8da3486b955f3451 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366646.399619:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9638832d3400/0x8da3486b955f3451 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366646.399627:0:5816:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9638832d3400/0x8da3486b955f3451 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366646.399651:0:5816:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9638832d3400/0x8da3486b955f3451 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366646.399659:0:5816:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9638832d3400/0x8da3486b955f3451 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366646.399665:0:5816:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9638832d3400/0x8da3486b955f3451 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366646.399672:0:5816:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9638832d3400 already unused, calling callback (ffffffffc20ee4f0) 00010000:00010000:3.0:1789366646.399688:0:5816:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9638832d3400/0x8da3486b955f3451 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366646.399697:0:5816:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9638832d3400/0x8da3486b955f3451 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366646.399708:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff96388c43f000) 00010000:00010000:3.0:1789366646.399711:0:5816:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789366646.399747:0:5816:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9638832d3400/0x8da3486b955f3451 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366646.399753:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9638832d3400/0x8da3486b955f3451 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789366646.399798:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96389077d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0ab23baa-a205-44ad-bf17-f7b47295d82b+33:10306:x1876286751405952:12345-192.168.202.23@tcp:54:lfs.0 Request processed in 261us (574us total) trans 0 rc 0/0 00000100:00100000:3.0:1789366646.399802:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 49 00000100:00100000:1.0:1789366646.401886:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:2.0:1789366646.403193:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751406208 00000100:00100000:2.0:1789366646.403207:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751406208 00000100:00100000:2.0:1789366646.403331:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 11 00000100:00100000:2.0:1789366646.403342:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963890774700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0ab23baa-a205-44ad-bf17-f7b47295d82b+33:10306:x1876286751406208:12345-192.168.202.23@tcp:35:lfs.0 00000100:00100000:2.0:1789366646.404841:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963890774700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0ab23baa-a205-44ad-bf17-f7b47295d82b+34:10306:x1876286751406208:12345-192.168.202.23@tcp:35:lfs.0 Request processed in 1495us (3194us total) trans 4294967330 rc 0/0 00000100:00100000:2.0:1789366646.404851:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 11 00000100:00100000:0.0:1789366646.605552:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:2.0:1789366646.605649:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751406464 00000100:00100000:2.0:1789366646.605659:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751406464 00000100:00100000:2.0:1789366646.605742:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 50 00000100:00100000:2.0:1789366646.605751:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96389077c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0ab23baa-a205-44ad-bf17-f7b47295d82b+34:10337:x1876286751406464:12345-192.168.202.23@tcp:101:cat.0 00010000:00010000:2.0:1789366646.605776:0:5815:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789366646.605793:0:5815:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff963880030000/0x8da3486b955f3458 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xda917a494d06c014 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366646.605879:0:5815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff963880030600/0x8da3486b955f345f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366646.605891:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff963880030600/0x8da3486b955f345f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366646.605909:0:5815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff963880030600/0x8da3486b955f345f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789366646.605918:0:5815:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:2.0:1789366646.606037:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff963880030000/0x8da3486b955f3458 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.23@tcp remote: 0xda917a494d06c014 expref: 37 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366646.606056:0:5815:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff963880030600/0x8da3486b955f345f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.23@tcp remote: 0xda917a494d06c014 expref: 36 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366646.606063:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff96388c43f000) 00010000:00010000:2.0:1789366646.606065:0:5815:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789366646.606067:0:5815:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff963880030600, rc 0) 00000100:00100000:2.0:1789366646.606130:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96389077c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0ab23baa-a205-44ad-bf17-f7b47295d82b+36:10337:x1876286751406464:12345-192.168.202.23@tcp:101:cat.0 Request processed in 367us (573us total) trans 4294967331 rc 0/0 00000100:00100000:2.0:1789366646.606135:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 50 00000100:00100000:0.0:1789366646.610839:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:0.0:1789366646.610866:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:2.0:1789366646.610968:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751406720 00000100:00100000:2.0:1789366646.610977:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751406720 00000100:00100000:2.0:1789366646.611029:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 12 00000100:00100000:2.0:1789366646.611036:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96389077e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0ab23baa-a205-44ad-bf17-f7b47295d82b+36:10337:x1876286751406720:12345-192.168.202.23@tcp:35:cat.0 00000100:00100000:2.0:1789366646.611255:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96389077e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0ab23baa-a205-44ad-bf17-f7b47295d82b+37:10337:x1876286751406720:12345-192.168.202.23@tcp:35:cat.0 Request processed in 218us (424us total) trans 4294967332 rc 0/0 00000100:00100000:2.0:1789366646.611261:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 12 00000100:00100000:3.0:1789366646.611930:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751406848 00000100:00100000:3.0:1789366646.611936:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751406848 00000100:00100000:3.0:1789366646.611976:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 3 00000100:00100000:3.0:1789366646.611981:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96389077dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0ab23baa-a205-44ad-bf17-f7b47295d82b+37:2354:x1876286751406848:12345-192.168.202.23@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789366646.611990:0:5802:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789366646.612018:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff963880030600/0x8da3486b955f345f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.23@tcp remote: 0xda917a494d06c014 expref: 37 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366646.612034:0:5802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff96388c43f000) 00010000:00010000:3.0:1789366646.612037:0:5802:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789366646.612065:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96389077dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0ab23baa-a205-44ad-bf17-f7b47295d82b+36:2354:x1876286751406848:12345-192.168.202.23@tcp:103:ldlm_bl.0 Request processed in 84us (1198us total) trans 0 rc 0/0 00000100:00100000:3.0:1789366646.612084:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 3 00000100:00100000:0.0:1789366646.671333:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:2.0:1789366646.671463:0:7132:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751407104 00000100:00100000:2.0:1789366646.671475:0:7132:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751407104 00000100:00100000:2.0:1789366646.671546:0:7132:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 51 00000100:00100000:2.0:1789366646.671556:0:7132:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96389077ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0ab23baa-a205-44ad-bf17-f7b47295d82b+36:10343:x1876286751407104:12345-192.168.202.23@tcp:101:dd.0 00010000:00010000:2.0:1789366646.671588:0:7132:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789366646.671591:0:7132:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1789366646.671617:0:7132:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720c800/0x8da3486b955f33c5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.23@tcp remote: 0xda917a494d06bfea expref: 36 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366646.671639:0:7132:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff963890797000) 00010000:00010000:2.0:1789366646.671644:0:7132:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789366646.671662:0:7132:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff963880030000/0x8da3486b955f346d lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xda917a494d06c01b expref: -99 pid: 7132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366646.671852:0:7132:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff963880031400/0x8da3486b955f3474 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366646.671865:0:7132:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff963880030e00/0x8da3486b955f3443 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.23@tcp remote: 0xda917a494d06c00d expref: 36 pid: 7132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366646.671873:0:7132:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff963880031400/0x8da3486b955f3474 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366646.671905:0:7132:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff963880030e00/0x8da3486b955f3443 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.23@tcp remote: 0xda917a494d06c00d expref: 36 pid: 7132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366646.671919:0:7132:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff963880030e00/0x8da3486b955f3443 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.23@tcp remote: 0xda917a494d06c00d expref: 36 pid: 7132 timeout: 322 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789366646.671934:0:7132:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9638b7351f80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7132:1876286758770560:192.168.202.23@tcp:104: 00000100:00100000:2.0:1789366646.672032:0:7132:0:(client.c:2716:ptlrpc_set_wait()) set ffff9638bf0cb600 going to sleep for 11 seconds 00000100:00100000:2.0:1789366646.674491:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:0.0:1789366646.674578:0:8419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751407232 00000100:00100000:0.0:1789366646.674587:0:8419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751407232 00010000:00010000:0.0:1789366646.674626:0:8419:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff963880030e00/0x8da3486b955f3443 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.23@tcp remote: 0xda917a494d06c00d expref: 37 pid: 7132 timeout: 322 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789366646.674670:0:8419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 37 00000100:00100000:0.0:1789366646.674680:0:8419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96389861fc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0ab23baa-a205-44ad-bf17-f7b47295d82b+37:2355:x1876286751407232:12345-192.168.202.23@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789366646.674693:0:8419:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789366646.674700:0:8419:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff963880030e00/0x8da3486b955f3443 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.23@tcp remote: 0xda917a494d06c00d expref: 37 pid: 7132 timeout: 322 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366646.674757:0:8419:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff963880030e00/0x8da3486b955f3443 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.23@tcp remote: 0xda917a494d06c00d expref: 37 pid: 7132 timeout: 322 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366646.674780:0:8419:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff96388c43f000) 00010000:00010000:0.0:1789366646.674785:0:8419:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff963880031400/0x8da3486b955f3474 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366646.674795:0:8419:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff963880031400/0x8da3486b955f3474 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366646.674804:0:8419:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff963880031400/0x8da3486b955f3474 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366646.674822:0:8419:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789366646.674879:0:8419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96389861fc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0ab23baa-a205-44ad-bf17-f7b47295d82b+37:2355:x1876286751407232:12345-192.168.202.23@tcp:103:ldlm_bl.0 Request processed in 200us (395us total) trans 0 rc 0/0 00000100:00100000:0.0:1789366646.674886:0:8419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 37 00010000:00010000:3.0:1789366646.675103:0:7132:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff963880030e00/0x8da3486b955f3443 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.23@tcp remote: 0xda917a494d06c00d expref: 36 pid: 7132 timeout: 322 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789366646.675121:0:7132:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9638b7351f80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7132:1876286758770560:192.168.202.23@tcp:104: 00010000:00010000:3.0:1789366646.675142:0:7132:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff963880031400/0x8da3486b955f3474 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366646.675151:0:7132:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff963880031400/0x8da3486b955f3474 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366646.675156:0:7132:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff963880031400/0x8da3486b955f3474 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789366646.675174:0:7132:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:3.0:1789366646.675416:0:7132:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff963880030000/0x8da3486b955f346d lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.23@tcp remote: 0xda917a494d06c01b expref: 37 pid: 7132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366646.675433:0:7132:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff963880031400/0x8da3486b955f3474 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.23@tcp remote: 0xda917a494d06c01b expref: 36 pid: 7132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366646.675441:0:7132:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff96388c43f000) 00010000:00010000:3.0:1789366646.675444:0:7132:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1789366646.675447:0:7132:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff963880031400, rc 0) 00000100:00100000:3.0:1789366646.675495:0:7132:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96389077ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0ab23baa-a205-44ad-bf17-f7b47295d82b+36:10343:x1876286751407104:12345-192.168.202.23@tcp:101:dd.0 Request processed in 3940us (4173us total) trans 4294967333 rc 0/0 00000100:00100000:3.0:1789366646.675502:0:7132:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 51 00000100:00100000:2.0:1789366646.679257:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:1.0:1789366646.679412:0:7614:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751407488 00000100:00100000:1.0:1789366646.679421:0:7614:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751407488 00000100:00100000:1.0:1789366646.679470:0:7614:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 52 00000100:00100000:1.0:1789366646.679478:0:7614:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638b7353b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0ab23baa-a205-44ad-bf17-f7b47295d82b+36:10343:x1876286751407488:12345-192.168.202.23@tcp:36:dd.0 00010000:00010000:1.0:1789366646.679764:0:7614:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9638b6ce3800/0x8da3486b955f3482 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7614 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366646.679785:0:7614:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9638b6ce3800/0x8da3486b955f3482 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7614 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366646.679811:0:7614:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9638b6ce3800/0x8da3486b955f3482 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7614 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789366646.679867:0:7614:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967334 00000004:00010000:1.0:1789366646.679892:0:7614:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000c9131212 reply state 000000002ed1dfb6 transno 4294967335 ns: mdt-lustre-MDT0000_UUID lock: ffff9638b6ce3800/0x8da3486b955f3482 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7614 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789366646.679899:0:7614:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1789366646.680003:0:7614:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638b7353b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0ab23baa-a205-44ad-bf17-f7b47295d82b+39:10343:x1876286751407488:12345-192.168.202.23@tcp:36:dd.0 Request processed in 524us (754us total) trans 4294967335 rc 0/0 00000100:00100000:1.0:1789366646.680011:0:7614:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 52 00000020:00080000:1.0:1789366646.680018:0:7614:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1789366646.683556:0:3270:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9638b6ce3800/0x8da3486b955f3482 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7614 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366646.683571:0:3270:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9638b6ce3800/0x8da3486b955f3482 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7614 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366646.683576:0:3270:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9638b6ce3800/0x8da3486b955f3482 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7614 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366646.683579:0:3270:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9638b6ce3800 already unused, calling callback (ffffffffc20ee4f0) 00010000:00010000:1.0:1789366646.683583:0:3270:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9638b6ce3800/0x8da3486b955f3482 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7614 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366646.683588:0:3270:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9638b6ce3800/0x8da3486b955f3482 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7614 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366646.683601:0:3270:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff96388c43f000) 00010000:00010000:1.0:1789366646.683603:0:3270:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789366646.683619:0:3270:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9638b6ce3800/0x8da3486b955f3482 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7614 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366646.683626:0:3270:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9638b6ce3800/0x8da3486b955f3482 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7614 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366646.841547:0:5805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789366646.901120:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:0.0:1789366646.901480:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751407616 00000100:00100000:0.0:1789366646.901512:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751407616 00000100:00100000:0.0:1789366646.901586:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 53 00000100:00100000:0.0:1789366646.901594:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638b7351880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0ab23baa-a205-44ad-bf17-f7b47295d82b+38:10357:x1876286751407616:12345-192.168.202.23@tcp:101:stat.0 00010000:00010000:0.0:1789366646.901618:0:5817:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789366646.901642:0:5817:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720d600/0x8da3486b955f3489 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xda917a494d06c022 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366646.901714:0:5817:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720ca00/0x8da3486b955f3490 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366646.901764:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720ca00/0x8da3486b955f3490 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366646.901776:0:5817:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720ca00/0x8da3486b955f3490 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366646.901792:0:5817:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720dc00/0x8da3486b955f3497 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366646.901798:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720dc00/0x8da3486b955f3497 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366646.901803:0:5817:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720dc00/0x8da3486b955f3497 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366646.901893:0:5817:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720d000/0x8da3486b955f349e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366646.901904:0:5817:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff963880031400/0x8da3486b955f3474 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.23@tcp remote: 0xda917a494d06c01b expref: 39 pid: 7132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366646.901910:0:5817:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720d000/0x8da3486b955f349e lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366646.901946:0:5817:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff963880031400/0x8da3486b955f3474 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.23@tcp remote: 0xda917a494d06c01b expref: 39 pid: 7132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366646.901956:0:5817:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff963880031400/0x8da3486b955f3474 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.23@tcp remote: 0xda917a494d06c01b expref: 39 pid: 7132 timeout: 322 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789366646.901965:0:5817:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96389077dc00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5817:1876286758770688:192.168.202.23@tcp:104: 00000100:00100000:0.0:1789366646.902254:0:5817:0:(client.c:2716:ptlrpc_set_wait()) set ffff9638bf08bc00 going to sleep for 11 seconds 00000100:00100000:0.0:1789366646.910547:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:1.0:1789366646.910663:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751407872 00000100:00100000:1.0:1789366646.910672:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751407872 00000100:00100000:1.0:1789366646.910758:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 13 00000100:00100000:1.0:1789366646.910769:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638b702ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0ab23baa-a205-44ad-bf17-f7b47295d82b+40:5580:x1876286751407872:12345-192.168.202.23@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1789366646.911115:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638b702ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0ab23baa-a205-44ad-bf17-f7b47295d82b+41:5580:x1876286751407872:12345-192.168.202.23@tcp:35:ldlm_bl.0 Request processed in 346us (577us total) trans 4294967336 rc 0/0 00000100:00100000:1.0:1789366646.911123:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 13 00000100:00100000:1.0:1789366646.914588:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:3.0:1789366646.914673:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751408000 00000100:00100000:3.0:1789366646.914683:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751408000 00010000:00010000:3.0:1789366646.914744:0:5802:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff963880031400/0x8da3486b955f3474 lrc: 5/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.23@tcp remote: 0xda917a494d06c01b expref: 41 pid: 7132 timeout: 322 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789366646.914790:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 38 00000100:00100000:3.0:1789366646.914800:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963890776d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0ab23baa-a205-44ad-bf17-f7b47295d82b+41:2355:x1876286751408000:12345-192.168.202.23@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789366646.914816:0:5802:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789366646.914822:0:5802:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff963880031400/0x8da3486b955f3474 lrc: 5/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.23@tcp remote: 0xda917a494d06c01b expref: 41 pid: 7132 timeout: 322 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366646.914834:0:5802:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff963880031400/0x8da3486b955f3474 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.23@tcp remote: 0xda917a494d06c01b expref: 41 pid: 7132 timeout: 322 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366646.914856:0:5802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff96388c43f000) 00010000:00010000:3.0:1789366646.914862:0:5802:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720d000/0x8da3486b955f349e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366646.914871:0:5802:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720d000/0x8da3486b955f349e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366646.914879:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720d000/0x8da3486b955f349e lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366646.914898:0:5802:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789366646.914951:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963890776d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0ab23baa-a205-44ad-bf17-f7b47295d82b+41:2355:x1876286751408000:12345-192.168.202.23@tcp:103:ldlm_bl.0 Request processed in 153us (374us total) trans 0 rc 0/0 00000100:00100000:3.0:1789366646.914959:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 38 00010000:00010000:2.0:1789366646.918341:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff963880031400/0x8da3486b955f3474 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.23@tcp remote: 0xda917a494d06c01b expref: 40 pid: 7132 timeout: 322 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789366646.918374:0:5817:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96389077dc00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5817:1876286758770688:192.168.202.23@tcp:104: 00010000:00010000:2.0:1789366646.918406:0:5817:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720d000/0x8da3486b955f349e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366646.918417:0:5817:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720d000/0x8da3486b955f349e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366646.918425:0:5817:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720d000/0x8da3486b955f349e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789366646.918492:0:5817:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:2.0:1789366646.918497:0:5817:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1789366646.918596:0:5817:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720d000/0x8da3486b955f349e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366646.918628:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720d000/0x8da3486b955f349e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366646.918648:0:5817:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720ca00/0x8da3486b955f3490 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366646.918662:0:5817:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720ca00/0x8da3486b955f3490 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366646.918671:0:5817:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720ca00/0x8da3486b955f3490 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366646.918689:0:5817:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9638b720ca00 already unused, calling callback (ffffffffc20ee4f0) 00010000:00010000:2.0:1789366646.918695:0:5817:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720ca00/0x8da3486b955f3490 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366646.918705:0:5817:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720ca00/0x8da3486b955f3490 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366646.918764:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff963890797000) 00010000:00010000:2.0:1789366646.918768:0:5817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789366646.918773:0:5817:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720ca00/0x8da3486b955f3490 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366646.918789:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720ca00/0x8da3486b955f3490 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366646.918800:0:5817:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720dc00/0x8da3486b955f3497 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366646.918807:0:5817:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720dc00/0x8da3486b955f3497 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366646.918814:0:5817:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720dc00/0x8da3486b955f3497 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366646.918818:0:5817:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9638b720dc00 already unused, calling callback (ffffffffc20ee4f0) 00010000:00010000:2.0:1789366646.918821:0:5817:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720dc00/0x8da3486b955f3497 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366646.918826:0:5817:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720dc00/0x8da3486b955f3497 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366646.918845:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff963890797a00) 00010000:00010000:2.0:1789366646.918847:0:5817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789366646.918850:0:5817:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720dc00/0x8da3486b955f3497 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366646.918856:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720dc00/0x8da3486b955f3497 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366646.918907:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720d600/0x8da3486b955f3489 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.23@tcp remote: 0xda917a494d06c022 expref: 40 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366646.918923:0:5817:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720d000/0x8da3486b955f349e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.23@tcp remote: 0xda917a494d06c022 expref: 39 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366646.918932:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff96388c43f000) 00010000:00010000:2.0:1789366646.918934:0:5817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789366646.918937:0:5817:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9638b720d000, rc 0) 00000100:00100000:2.0:1789366646.919024:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638b7351880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0ab23baa-a205-44ad-bf17-f7b47295d82b+39:10357:x1876286751407616:12345-192.168.202.23@tcp:101:stat.0 Request processed in 17429us (17917us total) trans 0 rc 0/0 00000100:00100000:2.0:1789366646.919033:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 53 00000100:00100000:1.0:1789366646.986368:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:3.0:1789366646.986664:0:7132:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751408256 00000100:00100000:3.0:1789366646.986677:0:7132:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751408256 00000100:00100000:3.0:1789366646.986779:0:7132:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 54 00000100:00100000:3.0:1789366646.986791:0:7132:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963890775180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0ab23baa-a205-44ad-bf17-f7b47295d82b+39:10363:x1876286751408256:12345-192.168.202.23@tcp:36:truncate.0 00010000:00010000:3.0:1789366646.986854:0:7132:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789366646.986883:0:7132:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720d000/0x8da3486b955f349e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.23@tcp remote: 0xda917a494d06c022 expref: 39 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366646.986904:0:7132:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff96388c43f000) 00010000:00010000:3.0:1789366646.986910:0:7132:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789366646.987138:0:7132:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9638832d3400/0x8da3486b955f34a5 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366646.987151:0:7132:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9638832d3400/0x8da3486b955f34a5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366646.987161:0:7132:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9638832d3400/0x8da3486b955f34a5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789366646.987207:0:7132:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967337 00000004:00010000:3.0:1789366646.987239:0:7132:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000068eeb212 reply state 000000001fa96eb5 transno 4294967338 ns: mdt-lustre-MDT0000_UUID lock: ffff9638832d3400/0x8da3486b955f34a5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789366646.987248:0:7132:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789366646.987580:0:7132:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963890775180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0ab23baa-a205-44ad-bf17-f7b47295d82b+41:10363:x1876286751408256:12345-192.168.202.23@tcp:36:truncate.0 Request processed in 569us (1013us total) trans 4294967338 rc 0/0 00000100:00100000:3.0:1789366646.987589:0:7132:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 54 00000020:00080000:3.0:1789366646.987594:0:7132:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1789366646.991649:0:3271:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9638832d3400/0x8da3486b955f34a5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366646.991665:0:3271:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9638832d3400/0x8da3486b955f34a5 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366646.991673:0:3271:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9638832d3400/0x8da3486b955f34a5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366646.991679:0:3271:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9638832d3400 already unused, calling callback (ffffffffc20ee4f0) 00010000:00010000:0.0:1789366646.991684:0:3271:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9638832d3400/0x8da3486b955f34a5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366646.991692:0:3271:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9638832d3400/0x8da3486b955f34a5 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366646.991709:0:3271:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff96388c43f000) 00010000:00010000:0.0:1789366646.991712:0:3271:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789366646.991755:0:3271:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9638832d3400/0x8da3486b955f34a5 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366646.991781:0:3271:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9638832d3400/0x8da3486b955f34a5 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789366647.136380:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:2.0:1789366647.136756:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751408384 00000100:00100000:2.0:1789366647.136768:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751408384 00000100:00100000:2.0:1789366647.136829:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 55 00000100:00100000:2.0:1789366647.136840:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963890776a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0ab23baa-a205-44ad-bf17-f7b47295d82b+40:10377:x1876286751408384:12345-192.168.202.23@tcp:101:stat.0 00010000:00010000:2.0:1789366647.136866:0:5815:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789366647.136890:0:5815:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff963880031400/0x8da3486b955f34ac lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xda917a494d06c029 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366647.136990:0:5815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff963880030000/0x8da3486b955f34b3 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366647.137015:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff963880030000/0x8da3486b955f34b3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366647.137026:0:5815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff963880030000/0x8da3486b955f34b3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366647.137041:0:5815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff963880030e00/0x8da3486b955f34ba lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366647.137047:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff963880030e00/0x8da3486b955f34ba lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366647.137054:0:5815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff963880030e00/0x8da3486b955f34ba lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366647.137279:0:5815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff963880030600/0x8da3486b955f34c1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366647.137290:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff963880030600/0x8da3486b955f34c1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366647.137298:0:5815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff963880030600/0x8da3486b955f34c1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789366647.137337:0:5815:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 1234567 00000004:00200000:2.0:1789366647.137343:0:5815:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1789366647.137363:0:5815:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff963880030600/0x8da3486b955f34c1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366647.137462:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff963880030600/0x8da3486b955f34c1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366647.137473:0:5815:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff963880030000/0x8da3486b955f34b3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366647.137480:0:5815:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff963880030000/0x8da3486b955f34b3 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366647.137487:0:5815:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff963880030000/0x8da3486b955f34b3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366647.137494:0:5815:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff963880030000 already unused, calling callback (ffffffffc20ee4f0) 00010000:00010000:2.0:1789366647.137498:0:5815:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff963880030000/0x8da3486b955f34b3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366647.137507:0:5815:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff963880030000/0x8da3486b955f34b3 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366647.137520:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff963890797000) 00010000:00010000:2.0:1789366647.137524:0:5815:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789366647.137529:0:5815:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff963880030000/0x8da3486b955f34b3 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366647.137536:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff963880030000/0x8da3486b955f34b3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366647.137553:0:5815:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff963880030e00/0x8da3486b955f34ba lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366647.137559:0:5815:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff963880030e00/0x8da3486b955f34ba lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366647.137572:0:5815:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff963880030e00/0x8da3486b955f34ba lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366647.137588:0:5815:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff963880030e00 already unused, calling callback (ffffffffc20ee4f0) 00010000:00010000:2.0:1789366647.137591:0:5815:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff963880030e00/0x8da3486b955f34ba lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366647.137598:0:5815:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff963880030e00/0x8da3486b955f34ba lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366647.137607:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9638a7404600) 00010000:00010000:2.0:1789366647.137610:0:5815:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789366647.137613:0:5815:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff963880030e00/0x8da3486b955f34ba lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366647.137619:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff963880030e00/0x8da3486b955f34ba lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366647.137653:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff963880031400/0x8da3486b955f34ac lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.23@tcp remote: 0xda917a494d06c029 expref: 42 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366647.137669:0:5815:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff963880030600/0x8da3486b955f34c1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.23@tcp remote: 0xda917a494d06c029 expref: 41 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366647.137676:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff96388c43f000) 00010000:00010000:2.0:1789366647.137679:0:5815:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789366647.137682:0:5815:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff963880030600, rc 0) 00000100:00100000:2.0:1789366647.137806:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963890776a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0ab23baa-a205-44ad-bf17-f7b47295d82b+41:10377:x1876286751408384:12345-192.168.202.23@tcp:101:stat.0 Request processed in 967us (1436us total) trans 0 rc 0/0 00000100:00100000:2.0:1789366647.137823:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 55 00000100:00100000:3.0:1789366647.219915:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:2.0:1789366647.220259:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751408640 00000100:00100000:2.0:1789366647.220284:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751408640 00000100:00100000:2.0:1789366647.220386:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 56 00000100:00100000:2.0:1789366647.220397:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963785f2ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0ab23baa-a205-44ad-bf17-f7b47295d82b+41:10387:x1876286751408640:12345-192.168.202.23@tcp:101:lfs.0 00010000:00010000:2.0:1789366647.220419:0:5817:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789366647.220441:0:5817:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff963880031400/0x8da3486b955f34c8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xda917a494d06c030 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789366647.220532:0:5817:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:2.0:1789366647.220750:0:5817:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff963880031400/0x8da3486b955f34c8 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.23@tcp remote: 0xda917a494d06c030 expref: 43 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366647.220767:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff963890797800) 00010000:00010000:2.0:1789366647.220770:0:5817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789366647.220776:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff963880031400/0x8da3486b955f34c8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.23@tcp remote: 0xda917a494d06c030 expref: 43 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366647.220791:0:5817:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff963880031400, rc 0) 00000100:00100000:2.0:1789366647.220863:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963785f2ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0ab23baa-a205-44ad-bf17-f7b47295d82b+42:10387:x1876286751408640:12345-192.168.202.23@tcp:101:lfs.0 Request processed in 469us (957us total) trans 4294967339 rc 301/301 00000100:00100000:2.0:1789366647.220871:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 56 00000100:00100000:1.0:1789366647.229679:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:2.0:1789366647.229761:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751408896 00000100:00100000:2.0:1789366647.229771:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751408896 00000100:00100000:2.0:1789366647.229829:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 14 00000100:00100000:2.0:1789366647.229840:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963890775c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0ab23baa-a205-44ad-bf17-f7b47295d82b+42:10387:x1876286751408896:12345-192.168.202.23@tcp:35:lfs.0 00000100:00100000:2.0:1789366647.230051:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963890775c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0ab23baa-a205-44ad-bf17-f7b47295d82b+43:10387:x1876286751408896:12345-192.168.202.23@tcp:35:lfs.0 Request processed in 214us (381us total) trans 4294967340 rc 0/0 00000100:00100000:2.0:1789366647.230056:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 14 00000100:00100000:1.0:1789366647.273796:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:3.0:1789366647.273871:0:7614:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751409152 00000100:00100000:3.0:1789366647.273893:0:7614:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751409152 00000100:00100000:3.0:1789366647.273951:0:7614:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 57 00000100:00100000:3.0:1789366647.273962:0:7614:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638bfecaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0ab23baa-a205-44ad-bf17-f7b47295d82b+43:10393:x1876286751409152:12345-192.168.202.23@tcp:101:bash.0 00010000:00010000:3.0:1789366647.273987:0:7614:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789366647.274006:0:7614:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9638832d2200/0x8da3486b955f34d6 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xda917a494d06c037 expref: -99 pid: 7614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366647.274098:0:7614:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9638832d3400/0x8da3486b955f34dd lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7614 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366647.274112:0:7614:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff963880030600/0x8da3486b955f34c1 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.23@tcp remote: 0xda917a494d06c029 expref: 44 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366647.274122:0:7614:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9638832d3400/0x8da3486b955f34dd lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7614 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366647.274152:0:7614:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff963880030600/0x8da3486b955f34c1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.23@tcp remote: 0xda917a494d06c029 expref: 44 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366647.274166:0:7614:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff963880030600/0x8da3486b955f34c1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.23@tcp remote: 0xda917a494d06c029 expref: 44 pid: 5815 timeout: 322 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789366647.274179:0:7614:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff963785f2a680 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:7614:1876286758770816:192.168.202.23@tcp:104: 00000100:00100000:3.0:1789366647.274287:0:7614:0:(client.c:2716:ptlrpc_set_wait()) set ffff9638b729e540 going to sleep for 11 seconds 00000100:00100000:3.0:1789366647.280972:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:1.0:1789366647.281080:0:7614:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff963785f2a680 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:7614:1876286758770816:192.168.202.23@tcp:104: 00010000:00010000:1.0:1789366647.281106:0:7614:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9638832d3400/0x8da3486b955f34dd lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7614 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789366647.285413:0:8419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751409280 00000100:00100000:0.0:1789366647.285428:0:8419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751409280 00010000:00010000:0.0:1789366647.285477:0:8419:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff963880030600/0x8da3486b955f34c1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.23@tcp remote: 0xda917a494d06c029 expref: 45 pid: 5815 timeout: 322 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789366647.285582:0:8419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 39 00000100:00100000:0.0:1789366647.285592:0:8419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963785f28380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0ab23baa-a205-44ad-bf17-f7b47295d82b+45:2355:x1876286751409280:12345-192.168.202.23@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789366647.285606:0:8419:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789366647.285613:0:8419:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff963880030600/0x8da3486b955f34c1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.23@tcp remote: 0xda917a494d06c029 expref: 45 pid: 5815 timeout: 322 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366647.285626:0:8419:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff963880030600/0x8da3486b955f34c1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.23@tcp remote: 0xda917a494d06c029 expref: 45 pid: 5815 timeout: 322 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366647.285647:0:8419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff963880030600/0x8da3486b955f34c1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.23@tcp remote: 0xda917a494d06c029 expref: 45 pid: 5815 timeout: 322 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366647.285664:0:8419:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff96388c43f000) 00010000:00010000:0.0:1789366647.285669:0:8419:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9638832d3400/0x8da3486b955f34dd lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7614 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366647.285675:0:8419:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9638832d3400/0x8da3486b955f34dd lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7614 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366647.285681:0:8419:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9638832d3400/0x8da3486b955f34dd lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7614 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366647.285740:0:8419:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789366647.285787:0:8419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963785f28380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0ab23baa-a205-44ad-bf17-f7b47295d82b+44:2355:x1876286751409280:12345-192.168.202.23@tcp:103:ldlm_bl.0 Request processed in 198us (4824us total) trans 0 rc 0/0 00000100:00100000:0.0:1789366647.285792:0:8419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 39 00010000:00010000:1.0:1789366647.286143:0:7614:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9638832d3400/0x8da3486b955f34dd lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7614 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366647.286150:0:7614:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9638832d3400/0x8da3486b955f34dd lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7614 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789366647.286165:0:7614:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 1234567 00010000:00010000:1.0:1789366647.286315:0:7614:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9638832d2200/0x8da3486b955f34d6 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.23@tcp remote: 0xda917a494d06c037 expref: 45 pid: 7614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366647.286333:0:7614:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9638832d3400/0x8da3486b955f34dd lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.23@tcp remote: 0xda917a494d06c037 expref: 44 pid: 7614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366647.286339:0:7614:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff96388c43f000) 00010000:00010000:1.0:1789366647.286341:0:7614:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1789366647.286343:0:7614:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9638832d3400, rc 0) 00000100:00100000:1.0:1789366647.286364:0:7614:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638bfecaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0ab23baa-a205-44ad-bf17-f7b47295d82b+44:10393:x1876286751409152:12345-192.168.202.23@tcp:101:bash.0 Request processed in 12406us (12580us total) trans 4294967341 rc 0/0 00000100:00100000:1.0:1789366647.286369:0:7614:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 57 00000100:00100000:1.0:1789366647.293704:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:2.0:1789366647.293848:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751409536 00000100:00100000:2.0:1789366647.293857:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751409536 00000100:00100000:2.0:1789366647.293916:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 58 00000100:00100000:2.0:1789366647.293926:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638bfec9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0ab23baa-a205-44ad-bf17-f7b47295d82b+44:10393:x1876286751409536:12345-192.168.202.23@tcp:36:bash.0 00010000:00010000:2.0:1789366647.294140:0:5815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff963880031400/0x8da3486b955f34eb lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366647.294155:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff963880031400/0x8da3486b955f34eb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366647.294164:0:5815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff963880031400/0x8da3486b955f34eb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789366647.294240:0:5815:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967342 00000004:00010000:2.0:1789366647.294260:0:5815:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000092c60596 reply state 00000000e2705e5a transno 4294967343 ns: mdt-lustre-MDT0000_UUID lock: ffff963880031400/0x8da3486b955f34eb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789366647.294267:0:5815:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789366647.294417:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638bfec9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0ab23baa-a205-44ad-bf17-f7b47295d82b+47:10393:x1876286751409536:12345-192.168.202.23@tcp:36:bash.0 Request processed in 493us (722us total) trans 4294967343 rc 0/0 00000100:00100000:2.0:1789366647.294422:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 58 00000020:00080000:2.0:1789366647.294427:0:5815:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1789366647.298819:0:3270:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff963880031400/0x8da3486b955f34eb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366647.298832:0:3270:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff963880031400/0x8da3486b955f34eb lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366647.298849:0:3270:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff963880031400/0x8da3486b955f34eb lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366647.298854:0:3270:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff963880031400 already unused, calling callback (ffffffffc20ee4f0) 00010000:00010000:3.0:1789366647.298857:0:3270:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff963880031400/0x8da3486b955f34eb lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366647.298862:0:3270:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff963880031400/0x8da3486b955f34eb lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366647.298875:0:3270:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff96388c43f000) 00010000:00010000:3.0:1789366647.298877:0:3270:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789366647.298880:0:3270:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff963880031400/0x8da3486b955f34eb lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366647.298884:0:3270:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff963880031400/0x8da3486b955f34eb lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789366647.299569:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:2.0:1789366647.299702:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751409664 00000100:00100000:2.0:1789366647.299710:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751409664 00000100:00100000:2.0:1789366647.299803:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 59 00000100:00100000:2.0:1789366647.299812:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638bfec8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0ab23baa-a205-44ad-bf17-f7b47295d82b+46:10393:x1876286751409664:12345-192.168.202.23@tcp:101:bash.0 00010000:00010000:2.0:1789366647.299838:0:5817:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789366647.299852:0:5817:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff963880030e00/0x8da3486b955f34f2 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xda917a494d06c03e expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366647.299921:0:5817:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff963880030000/0x8da3486b955f34f9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366647.299935:0:5817:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9638832d3400/0x8da3486b955f34dd lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.23@tcp remote: 0xda917a494d06c037 expref: 47 pid: 7614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366647.299942:0:5817:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff963880030000/0x8da3486b955f34f9 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366647.299967:0:5817:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9638832d3400/0x8da3486b955f34dd lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.23@tcp remote: 0xda917a494d06c037 expref: 47 pid: 7614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366647.299977:0:5817:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9638832d3400/0x8da3486b955f34dd lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.23@tcp remote: 0xda917a494d06c037 expref: 47 pid: 7614 timeout: 322 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789366647.299987:0:5817:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9638b7350700 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5817:1876286758770944:192.168.202.23@tcp:104: 00000100:00100000:2.0:1789366647.300064:0:5817:0:(client.c:2716:ptlrpc_set_wait()) set ffff9638bf0cb900 going to sleep for 11 seconds 00000100:00100000:2.0:1789366647.302104:0:5817:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9638b7350700 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5817:1876286758770944:192.168.202.23@tcp:104: 00010000:00010000:2.0:1789366647.302129:0:5817:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff963880030000/0x8da3486b955f34f9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789366647.304799:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:3.0:1789366647.305329:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751409792 00000100:00100000:3.0:1789366647.305340:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751409792 00010000:00010000:3.0:1789366647.305380:0:5802:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9638832d3400/0x8da3486b955f34dd lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.23@tcp remote: 0xda917a494d06c037 expref: 48 pid: 7614 timeout: 322 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789366647.306225:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 40 00000100:00100000:3.0:1789366647.306238:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638bfec9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0ab23baa-a205-44ad-bf17-f7b47295d82b+48:2354:x1876286751409792:12345-192.168.202.23@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789366647.306257:0:5802:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789366647.306263:0:5802:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9638832d3400/0x8da3486b955f34dd lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.23@tcp remote: 0xda917a494d06c037 expref: 48 pid: 7614 timeout: 322 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366647.306318:0:5802:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9638832d3400/0x8da3486b955f34dd lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.23@tcp remote: 0xda917a494d06c037 expref: 48 pid: 7614 timeout: 322 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366647.306347:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9638832d3400/0x8da3486b955f34dd lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.23@tcp remote: 0xda917a494d06c037 expref: 48 pid: 7614 timeout: 322 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366647.306361:0:5802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff96388c43f000) 00010000:00010000:3.0:1789366647.306365:0:5802:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff963880030000/0x8da3486b955f34f9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366647.306372:0:5802:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff963880030000/0x8da3486b955f34f9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366647.306378:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff963880030000/0x8da3486b955f34f9 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366647.306400:0:5802:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789366647.306452:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638bfec9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0ab23baa-a205-44ad-bf17-f7b47295d82b+47:2354:x1876286751409792:12345-192.168.202.23@tcp:103:ldlm_bl.0 Request processed in 218us (1662us total) trans 0 rc 0/0 00000100:00100000:3.0:1789366647.306457:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 40 00010000:00010000:2.0:1789366647.306461:0:5817:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff963880030000/0x8da3486b955f34f9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366647.306472:0:5817:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff963880030000/0x8da3486b955f34f9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789366647.306526:0:5817:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:2.0:1789366647.306531:0:5817:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1789366647.306550:0:5817:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff963880030000/0x8da3486b955f34f9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366647.306581:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff963880030e00/0x8da3486b955f34f2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.23@tcp remote: 0xda917a494d06c03e expref: 47 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366647.306603:0:5817:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff963880030000/0x8da3486b955f34f9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.23@tcp remote: 0xda917a494d06c03e expref: 46 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366647.306611:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff96388c43f000) 00010000:00010000:2.0:1789366647.306614:0:5817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789366647.306617:0:5817:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff963880030000, rc 0) 00000100:00100000:2.0:1789366647.306646:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638bfec8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0ab23baa-a205-44ad-bf17-f7b47295d82b+46:10393:x1876286751409664:12345-192.168.202.23@tcp:101:bash.0 Request processed in 6835us (7082us total) trans 0 rc 0/0 00000100:00100000:2.0:1789366647.306653:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 59 00000100:00100000:1.0:1789366647.310489:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:0.0:1789366647.310536:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751410048 00000100:00100000:0.0:1789366647.310546:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751410048 00000100:00100000:0.0:1789366647.310600:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 15 00000100:00100000:0.0:1789366647.310611:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963888cbb850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0ab23baa-a205-44ad-bf17-f7b47295d82b+46:10393:x1876286751410048:12345-192.168.202.23@tcp:35:bash.0 00000100:00100000:0.0:1789366647.310873:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963888cbb850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0ab23baa-a205-44ad-bf17-f7b47295d82b+47:10393:x1876286751410048:12345-192.168.202.23@tcp:35:bash.0 Request processed in 263us (392us total) trans 4294967344 rc 0/0 00000100:00100000:0.0:1789366647.310882:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 15 00000100:00100000:1.0:1789366647.391072:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:3.0:1789366647.391213:0:7614:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751410304 00000100:00100000:3.0:1789366647.391223:0:7614:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751410304 00000100:00100000:3.0:1789366647.391302:0:7614:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 60 00000100:00100000:3.0:1789366647.391313:0:7614:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638bfec9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0ab23baa-a205-44ad-bf17-f7b47295d82b+47:10403:x1876286751410304:12345-192.168.202.23@tcp:101:lfs.0 00010000:00010000:3.0:1789366647.391338:0:7614:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789366647.391360:0:7614:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9638832d3400/0x8da3486b955f3500 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xda917a494d06c045 expref: -99 pid: 7614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789366647.391463:0:7614:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:3.0:1789366647.391585:0:7614:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9638832d3400/0x8da3486b955f3500 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.23@tcp remote: 0xda917a494d06c045 expref: 49 pid: 7614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366647.392881:0:7614:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff963890797800) 00010000:00010000:3.0:1789366647.392885:0:7614:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789366647.392892:0:7614:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9638832d3400/0x8da3486b955f3500 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.23@tcp remote: 0xda917a494d06c045 expref: 49 pid: 7614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366647.392908:0:7614:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9638832d3400, rc 0) 00000100:00100000:3.0:1789366647.393028:0:7614:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638bfec9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0ab23baa-a205-44ad-bf17-f7b47295d82b+48:10403:x1876286751410304:12345-192.168.202.23@tcp:101:lfs.0 Request processed in 1716us (1964us total) trans 4294967345 rc 301/301 00000100:00100000:3.0:1789366647.393036:0:7614:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 60 00000100:00100000:1.0:1789366647.396747:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:3.0:1789366647.396832:0:7132:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751410432 00000100:00100000:3.0:1789366647.396843:0:7132:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751410432 00000100:00100000:3.0:1789366647.396896:0:7132:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 61 00000100:00100000:3.0:1789366647.396906:0:7132:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638bfec8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0ab23baa-a205-44ad-bf17-f7b47295d82b+48:10403:x1876286751410432:12345-192.168.202.23@tcp:34:lfs.0 00010000:00010000:3.0:1789366647.396977:0:7132:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9638832d3c00/0x8da3486b955f350e lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366647.396994:0:7132:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9638832d3c00/0x8da3486b955f350e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366647.397006:0:7132:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9638832d3c00/0x8da3486b955f350e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366647.397023:0:7132:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9638832d3600/0x8da3486b955f3515 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366647.397042:0:7132:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9638832d3600/0x8da3486b955f3515 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366647.397048:0:7132:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9638832d3600/0x8da3486b955f3515 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366647.397133:0:7132:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9638832d3a00/0x8da3486b955f351c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366647.397142:0:7132:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9638832d3a00/0x8da3486b955f351c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366647.397149:0:7132:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9638832d3a00/0x8da3486b955f351c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789366647.397189:0:7132:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9638832d3a00/0x8da3486b955f351c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366647.397203:0:7132:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9638832d3c00/0x8da3486b955f350e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366647.397210:0:7132:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9638832d3c00/0x8da3486b955f350e lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366647.397217:0:7132:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9638832d3c00/0x8da3486b955f350e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366647.397223:0:7132:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9638832d3c00 already unused, calling callback (ffffffffc20ee4f0) 00010000:00010000:3.0:1789366647.397228:0:7132:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9638832d3c00/0x8da3486b955f350e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366647.397235:0:7132:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9638832d3c00/0x8da3486b955f350e lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366647.397252:0:7132:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff963890797000) 00010000:00010000:3.0:1789366647.397254:0:7132:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789366647.397259:0:7132:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9638832d3c00/0x8da3486b955f350e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366647.397266:0:7132:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9638832d3c00/0x8da3486b955f350e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366647.398509:0:7132:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9638832d3600/0x8da3486b955f3515 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366647.398517:0:7132:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9638832d3600/0x8da3486b955f3515 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366647.398523:0:7132:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9638832d3600/0x8da3486b955f3515 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366647.398529:0:7132:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9638832d3600 already unused, calling callback (ffffffffc20ee4f0) 00010000:00010000:3.0:1789366647.398533:0:7132:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9638832d3600/0x8da3486b955f3515 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366647.398540:0:7132:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9638832d3600/0x8da3486b955f3515 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366647.398551:0:7132:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff96388c43f500) 00010000:00010000:3.0:1789366647.398554:0:7132:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789366647.398558:0:7132:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9638832d3600/0x8da3486b955f3515 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366647.398564:0:7132:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9638832d3600/0x8da3486b955f3515 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366647.398595:0:7132:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9638832d3a00/0x8da3486b955f351c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366647.398602:0:7132:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9638832d3a00/0x8da3486b955f351c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366647.398705:0:7132:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9638832d3a00/0x8da3486b955f351c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366647.398710:0:7132:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9638832d3a00 already unused, calling callback (ffffffffc20ee4f0) 00010000:00010000:3.0:1789366647.398712:0:7132:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9638832d3a00/0x8da3486b955f351c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366647.398733:0:7132:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9638832d3a00/0x8da3486b955f351c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366647.398742:0:7132:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff96388c43f000) 00010000:00010000:3.0:1789366647.398745:0:7132:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789366647.398749:0:7132:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9638832d3a00/0x8da3486b955f351c lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366647.398755:0:7132:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9638832d3a00/0x8da3486b955f351c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789366647.398848:0:7132:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638bfec8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0ab23baa-a205-44ad-bf17-f7b47295d82b+48:10403:x1876286751410432:12345-192.168.202.23@tcp:34:lfs.0 Request processed in 1941us (2134us total) trans 0 rc 0/0 00000100:00100000:3.0:1789366647.398857:0:7132:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 61 00000100:00100000:1.0:1789366647.403613:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:0.0:1789366647.403788:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751410688 00000100:00100000:0.0:1789366647.403799:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751410688 00000100:00100000:0.0:1789366647.403857:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 16 00000100:00100000:0.0:1789366647.403866:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638bfeca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0ab23baa-a205-44ad-bf17-f7b47295d82b+48:10403:x1876286751410688:12345-192.168.202.23@tcp:35:lfs.0 00000100:00100000:0.0:1789366647.404051:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638bfeca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0ab23baa-a205-44ad-bf17-f7b47295d82b+49:10403:x1876286751410688:12345-192.168.202.23@tcp:35:lfs.0 Request processed in 187us (450us total) trans 4294967346 rc 0/0 00000100:00100000:0.0:1789366647.404057:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 16 00000100:00100000:1.0:1789366647.433032:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:2.0:1789366647.433185:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751410944 00000100:00100000:2.0:1789366647.433196:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751410944 00000100:00100000:2.0:1789366647.433262:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 62 00000100:00100000:2.0:1789366647.433284:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638b73f9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0ab23baa-a205-44ad-bf17-f7b47295d82b+49:10406:x1876286751410944:12345-192.168.202.23@tcp:101:lfs.0 00010000:00010000:2.0:1789366647.433309:0:5817:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789366647.433329:0:5817:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff963880030e00/0x8da3486b955f3523 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xda917a494d06c04c expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366647.433403:0:5817:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff963880031400/0x8da3486b955f352a lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366647.433427:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff963880031400/0x8da3486b955f352a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366647.433439:0:5817:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff963880031400/0x8da3486b955f352a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366647.433453:0:5817:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff963880030600/0x8da3486b955f3531 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366647.433461:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff963880030600/0x8da3486b955f3531 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366647.433467:0:5817:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff963880030600/0x8da3486b955f3531 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366647.433578:0:5817:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9638a0740800/0x8da3486b955f3538 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366647.433586:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9638a0740800/0x8da3486b955f3538 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366647.433594:0:5817:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9638a0740800/0x8da3486b955f3538 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789366647.433603:0:5817:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:2.0:1789366647.434117:0:5817:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff963880031400/0x8da3486b955f352a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366647.434126:0:5817:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff963880031400/0x8da3486b955f352a lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366647.434132:0:5817:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff963880031400/0x8da3486b955f352a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366647.434144:0:5817:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff963880031400 already unused, calling callback (ffffffffc20ee4f0) 00010000:00010000:2.0:1789366647.434149:0:5817:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff963880031400/0x8da3486b955f352a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366647.434157:0:5817:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff963880031400/0x8da3486b955f352a lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366647.434169:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff963890797000) 00010000:00010000:2.0:1789366647.434173:0:5817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789366647.434178:0:5817:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff963880031400/0x8da3486b955f352a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366647.434184:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff963880031400/0x8da3486b955f352a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366647.434199:0:5817:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff963880030600/0x8da3486b955f3531 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366647.434205:0:5817:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff963880030600/0x8da3486b955f3531 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366647.434211:0:5817:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff963880030600/0x8da3486b955f3531 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366647.434216:0:5817:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff963880030600 already unused, calling callback (ffffffffc20ee4f0) 00010000:00010000:2.0:1789366647.434219:0:5817:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff963880030600/0x8da3486b955f3531 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366647.434225:0:5817:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff963880030600/0x8da3486b955f3531 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366647.434244:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9638a7404600) 00010000:00010000:2.0:1789366647.434246:0:5817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789366647.434249:0:5817:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff963880030600/0x8da3486b955f3531 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366647.434255:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff963880030600/0x8da3486b955f3531 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366647.434317:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff963880030e00/0x8da3486b955f3523 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.23@tcp remote: 0xda917a494d06c04c expref: 52 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366647.434332:0:5817:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9638a0740800/0x8da3486b955f3538 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.23@tcp remote: 0xda917a494d06c04c expref: 51 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366647.434340:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff96388c43f000) 00010000:00010000:2.0:1789366647.434343:0:5817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789366647.434345:0:5817:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9638a0740800, rc 0) 00000100:00100000:2.0:1789366647.434409:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638b73f9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0ab23baa-a205-44ad-bf17-f7b47295d82b+51:10406:x1876286751410944:12345-192.168.202.23@tcp:101:lfs.0 Request processed in 1128us (1387us total) trans 4294967347 rc 0/0 00000100:00100000:2.0:1789366647.434417:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 62 00000100:00100000:3.0:1789366647.441518:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:3.0:1789366647.441568:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:2.0:1789366647.441666:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751411200 00000100:00100000:2.0:1789366647.441677:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751411200 00000100:00100000:2.0:1789366647.441771:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 4 00000100:00100000:2.0:1789366647.441782:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638b70cdc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0ab23baa-a205-44ad-bf17-f7b47295d82b+51:2355:x1876286751411200:12345-192.168.202.23@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789366647.441797:0:5803:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789366647.441820:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9638a0740800/0x8da3486b955f3538 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.23@tcp remote: 0xda917a494d06c04c expref: 51 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366647.441858:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff96388c43f000) 00010000:00010000:2.0:1789366647.441863:0:5803:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789366647.441919:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638b70cdc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0ab23baa-a205-44ad-bf17-f7b47295d82b+50:2355:x1876286751411200:12345-192.168.202.23@tcp:103:ldlm_bl.0 Request processed in 139us (350us total) trans 0 rc 0/0 00000100:00100000:2.0:1789366647.441927:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 4 00000100:00100000:1.0:1789366647.442226:0:7614:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751411072 00000100:00100000:1.0:1789366647.442232:0:7614:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751411072 00000100:00100000:1.0:1789366647.442275:0:7614:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 63 00000100:00100000:1.0:1789366647.442284:0:7614:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963785f2a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0ab23baa-a205-44ad-bf17-f7b47295d82b+50:10406:x1876286751411072:12345-192.168.202.23@tcp:54:lfs.0 00010000:00010000:1.0:1789366647.442343:0:7614:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9638b6ce3200/0x8da3486b955f3546 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7614 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366647.442359:0:7614:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9638b6ce3200/0x8da3486b955f3546 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7614 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366647.442376:0:7614:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9638b6ce3200/0x8da3486b955f3546 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7614 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366647.442401:0:7614:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9638b6ce3200/0x8da3486b955f3546 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7614 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366647.442408:0:7614:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9638b6ce3200/0x8da3486b955f3546 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7614 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366647.442415:0:7614:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9638b6ce3200/0x8da3486b955f3546 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7614 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366647.442420:0:7614:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9638b6ce3200 already unused, calling callback (ffffffffc20ee4f0) 00010000:00010000:1.0:1789366647.442425:0:7614:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9638b6ce3200/0x8da3486b955f3546 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7614 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366647.442432:0:7614:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9638b6ce3200/0x8da3486b955f3546 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7614 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366647.442441:0:7614:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff96388c43f000) 00010000:00010000:1.0:1789366647.442444:0:7614:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1789366647.442448:0:7614:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9638b6ce3200/0x8da3486b955f3546 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7614 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366647.442454:0:7614:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9638b6ce3200/0x8da3486b955f3546 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7614 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789366647.442504:0:7614:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963785f2a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0ab23baa-a205-44ad-bf17-f7b47295d82b+50:10406:x1876286751411072:12345-192.168.202.23@tcp:54:lfs.0 Request processed in 222us (997us total) trans 0 rc 0/0 00000100:00100000:1.0:1789366647.442511:0:7614:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 63 00000100:00100000:3.0:1789366647.446371:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:0.0:1789366647.446496:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751411456 00000100:00100000:0.0:1789366647.446507:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751411456 00000100:00100000:0.0:1789366647.446562:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 17 00000100:00100000:0.0:1789366647.446572:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638987e8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0ab23baa-a205-44ad-bf17-f7b47295d82b+50:10406:x1876286751411456:12345-192.168.202.23@tcp:35:lfs.0 00000100:00100000:0.0:1789366647.446851:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638987e8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0ab23baa-a205-44ad-bf17-f7b47295d82b+51:10406:x1876286751411456:12345-192.168.202.23@tcp:35:lfs.0 Request processed in 279us (493us total) trans 4294967348 rc 0/0 00000100:00100000:0.0:1789366647.446868:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 17 00000100:00100000:2.0:1789366647.508520:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:2.0:1789366647.508560:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:2.0:1789366647.508603:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:3.0:1789366647.508796:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751411584 00000100:00100000:3.0:1789366647.508810:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751411584 00000100:00100000:3.0:1789366647.508873:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 271 00000100:00100000:3.0:1789366647.508885:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638b4e83450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:14a2847b-91d8-4d87-b71b-010443acc91a+13:2354:x1876286751411584:12345-192.168.202.23@tcp:400:kworker.0 00000100:00100000:3.0:1789366647.508968:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638b4e83450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:14a2847b-91d8-4d87-b71b-010443acc91a+13:2354:x1876286751411584:12345-192.168.202.23@tcp:400:kworker.0 Request processed in 85us (458us total) trans 0 rc 0/0 00000100:00100000:3.0:1789366647.508975:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 271 00000100:00100000:0.0:1789366647.509339:0:7132:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751411840 00000100:00100000:0.0:1789366647.509345:0:7132:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751411840 00000100:00100000:0.0:1789366647.509400:0:7132:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 105 00000100:00100000:0.0:1789366647.509409:0:7132:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638b7350700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b9764435-e52f-45ac-a5f9-bab1231105ac+5:2354:x1876286751411840:12345-192.168.202.23@tcp:400:kworker.0 00000100:00100000:0.0:1789366647.509447:0:7132:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638b7350700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b9764435-e52f-45ac-a5f9-bab1231105ac+5:2354:x1876286751411840:12345-192.168.202.23@tcp:400:kworker.0 Request processed in 40us (886us total) trans 0 rc 0/0 00000100:00100000:0.0:1789366647.509454:0:7132:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 105 00000100:00080000:2.0:1789366647.509508:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789366647.509671:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751411712 00000100:00100000:1.0:1789366647.509691:0:6660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751411712 00000100:00100000:1.0:1789366647.509759:0:6660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 48 00000100:00100000:1.0:1789366647.509767:0:6660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638b7352d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0ab23baa-a205-44ad-bf17-f7b47295d82b+7:2354:x1876286751411712:12345-192.168.202.23@tcp:400:kworker.0 00000100:00100000:1.0:1789366647.509808:0:6660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638b7352d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0ab23baa-a205-44ad-bf17-f7b47295d82b+7:2354:x1876286751411712:12345-192.168.202.23@tcp:400:kworker.0 Request processed in 42us (1204us total) trans 0 rc 0/0 00000100:00100000:1.0:1789366647.509815:0:6660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 48 00000100:00100000:3.0:1789366647.573791:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:2.0:1789366647.573997:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751412096 00000100:00100000:2.0:1789366647.574007:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751412096 00000100:00100000:2.0:1789366647.574122:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 64 00000100:00100000:2.0:1789366647.574139:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638987eaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0ab23baa-a205-44ad-bf17-f7b47295d82b+51:10424:x1876286751412096:12345-192.168.202.23@tcp:101:cat.0 00010000:00010000:2.0:1789366647.574163:0:5817:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789366647.574187:0:5817:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff963880030600/0x8da3486b955f354d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xda917a494d06c053 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366647.574298:0:5817:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff963880031400/0x8da3486b955f3554 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366647.574316:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff963880031400/0x8da3486b955f3554 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366647.574331:0:5817:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff963880031400/0x8da3486b955f3554 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789366647.574343:0:5817:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:2.0:1789366647.574499:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff963880030600/0x8da3486b955f354d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.23@tcp remote: 0xda917a494d06c053 expref: 54 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366647.574515:0:5817:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff963880031400/0x8da3486b955f3554 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.23@tcp remote: 0xda917a494d06c053 expref: 53 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366647.574521:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff96388c43f000) 00010000:00010000:2.0:1789366647.574524:0:5817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1789366647.574527:0:5817:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff963880031400, rc 0) 00000100:00100000:2.0:1789366647.574588:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638987eaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0ab23baa-a205-44ad-bf17-f7b47295d82b+53:10424:x1876286751412096:12345-192.168.202.23@tcp:101:cat.0 Request processed in 452us (808us total) trans 4294967349 rc 0/0 00000100:00100000:2.0:1789366647.574593:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 64 00000100:00100000:3.0:1789366647.611538:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:0.0:1789366647.611664:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751412224 00000100:00100000:0.0:1789366647.611675:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751412224 00000100:00100000:0.0:1789366647.611763:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 65 00000100:00100000:0.0:1789366647.611773:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638987eb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0ab23baa-a205-44ad-bf17-f7b47295d82b+53:10425:x1876286751412224:12345-192.168.202.23@tcp:101:lfs.0 00010000:00010000:0.0:1789366647.611796:0:5816:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789366647.611818:0:5816:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720c600/0x8da3486b955f3562 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xda917a494d06c05a expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366647.611884:0:5816:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720d200/0x8da3486b955f3569 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366647.611898:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720d200/0x8da3486b955f3569 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366647.611910:0:5816:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720d200/0x8da3486b955f3569 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789366647.611943:0:5816:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00000004:00200000:0.0:1789366647.611947:0:5816:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1789366647.611979:0:5816:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720d200/0x8da3486b955f3569 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366647.612004:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720c600/0x8da3486b955f3562 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.23@tcp remote: 0xda917a494d06c05a expref: 55 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366647.612022:0:5816:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720d200/0x8da3486b955f3569 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.23@tcp remote: 0xda917a494d06c05a expref: 54 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366647.612031:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff963890797000) 00010000:00010000:0.0:1789366647.612034:0:5816:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789366647.612038:0:5816:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9638b720d200, rc 0) 00000100:00100000:0.0:1789366647.612110:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638987eb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0ab23baa-a205-44ad-bf17-f7b47295d82b+54:10425:x1876286751412224:12345-192.168.202.23@tcp:101:lfs.0 Request processed in 338us (583us total) trans 0 rc 0/0 00000100:00100000:0.0:1789366647.612117:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 65 00000100:00100000:0.0:1789366647.621334:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:2.0:1789366647.621489:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751412608 00000100:00100000:2.0:1789366647.621499:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751412608 00000100:00100000:2.0:1789366647.621561:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 18 00000100:00100000:2.0:1789366647.621571:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638b702ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0ab23baa-a205-44ad-bf17-f7b47295d82b+54:10425:x1876286751412608:12345-192.168.202.23@tcp:35:lfs.0 00000100:00100000:2.0:1789366647.622436:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638b702ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0ab23baa-a205-44ad-bf17-f7b47295d82b+55:10425:x1876286751412608:12345-192.168.202.23@tcp:35:lfs.0 Request processed in 865us (1111us total) trans 4294967350 rc 0/0 00000100:00100000:2.0:1789366647.622446:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 18 00000100:00100000:1.0:1789366647.631221:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:3.0:1789366647.631285:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751412736 00000100:00100000:3.0:1789366647.631295:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751412736 00000100:00100000:3.0:1789366647.631423:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 5 00000100:00100000:3.0:1789366647.631435:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638b73f9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0ab23baa-a205-44ad-bf17-f7b47295d82b+55:10425:x1876286751412736:12345-192.168.202.23@tcp:103:lfs.0 00010000:00010000:3.0:1789366647.631452:0:5802:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:3.0:1789366647.631480:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff963880030000/0x8da3486b955f34f9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.23@tcp remote: 0xda917a494d06c03e expref: 55 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366647.631507:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff963880031400/0x8da3486b955f3554 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.23@tcp remote: 0xda917a494d06c053 expref: 54 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366647.631521:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9638832d2000/0x8da3486b955f3404 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.23@tcp remote: 0xda917a494d06bfff expref: 53 pid: 7132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366647.631533:0:5802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff96388c43f000) 00010000:00010000:3.0:1789366647.631546:0:5802:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789366647.631611:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638b73f9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0ab23baa-a205-44ad-bf17-f7b47295d82b+52:10425:x1876286751412736:12345-192.168.202.23@tcp:103:lfs.0 Request processed in 179us (398us total) trans 0 rc 0/0 00000100:00100000:3.0:1789366647.631642:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 5 00000100:00100000:3.0:1789366647.634917:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:0.0:1789366647.635034:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751412864 00000100:00100000:0.0:1789366647.635043:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751412864 00000100:00100000:0.0:1789366647.635149:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 66 00000100:00100000:0.0:1789366647.635158:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638987ebb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0ab23baa-a205-44ad-bf17-f7b47295d82b+52:10425:x1876286751412864:12345-192.168.202.23@tcp:58:lfs.0 00010000:00010000:0.0:1789366647.635283:0:5815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720c600/0x8da3486b955f3570 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366647.635301:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720c600/0x8da3486b955f3570 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366647.635312:0:5815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720c600/0x8da3486b955f3570 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1789366647.635908:0:5815:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1789366647.636088:0:5815:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 64 off8256 00000040:00080000:0.0:1789366647.636151:0:5815:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1, 136 off8328 00000100:00100000:0.0:1789366647.636252:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638987ebb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0ab23baa-a205-44ad-bf17-f7b47295d82b+52:10425:x1876286751412864:12345-192.168.202.23@tcp:58:lfs.0 Request processed in 1091us (1338us total) trans 0 rc 0/0 00000100:00100000:0.0:1789366647.636261:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 66 00000100:00100000:1.0:1789366647.657194:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:2.0:1789366647.657316:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751412992 00000100:00100000:2.0:1789366647.657326:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751412992 00000100:00100000:2.0:1789366647.657389:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 67 00000100:00100000:2.0:1789366647.657401:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638b73f8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0ab23baa-a205-44ad-bf17-f7b47295d82b+52:10427:x1876286751412992:12345-192.168.202.23@tcp:101:lfs.0 00010000:00010000:2.0:1789366647.657423:0:5817:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789366647.657446:0:5817:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff963880030600/0x8da3486b955f3577 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xda917a494d06c061 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366647.657534:0:5817:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff963880031400/0x8da3486b955f357e lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366647.657549:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff963880031400/0x8da3486b955f357e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366647.657560:0:5817:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff963880031400/0x8da3486b955f357e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366647.657573:0:5817:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff963880030000/0x8da3486b955f3585 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366647.657581:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff963880030000/0x8da3486b955f3585 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366647.657587:0:5817:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff963880030000/0x8da3486b955f3585 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366647.658147:0:5817:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff963880030e00/0x8da3486b955f358c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366647.658157:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff963880030e00/0x8da3486b955f358c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366647.658165:0:5817:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff963880030e00/0x8da3486b955f358c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789366647.658205:0:5817:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:2.0:1789366647.658210:0:5817:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1789366647.658229:0:5817:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff963880030e00/0x8da3486b955f358c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366647.658256:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff963880030e00/0x8da3486b955f358c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366647.658276:0:5817:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff963880031400/0x8da3486b955f357e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366647.658284:0:5817:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff963880031400/0x8da3486b955f357e lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366647.658291:0:5817:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff963880031400/0x8da3486b955f357e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366647.658297:0:5817:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff963880031400 already unused, calling callback (ffffffffc20ee4f0) 00010000:00010000:2.0:1789366647.658302:0:5817:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff963880031400/0x8da3486b955f357e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366647.658312:0:5817:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff963880031400/0x8da3486b955f357e lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366647.658329:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff963890797000) 00010000:00010000:2.0:1789366647.658332:0:5817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789366647.658338:0:5817:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff963880031400/0x8da3486b955f357e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366647.660288:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff963880031400/0x8da3486b955f357e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366647.660312:0:5817:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff963880030000/0x8da3486b955f3585 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366647.660319:0:5817:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff963880030000/0x8da3486b955f3585 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366647.660340:0:5817:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff963880030000/0x8da3486b955f3585 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366647.660357:0:5817:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff963880030000 already unused, calling callback (ffffffffc20ee4f0) 00010000:00010000:2.0:1789366647.660362:0:5817:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff963880030000/0x8da3486b955f3585 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366647.660370:0:5817:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff963880030000/0x8da3486b955f3585 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366647.660385:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9638a7404600) 00010000:00010000:2.0:1789366647.660388:0:5817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789366647.660392:0:5817:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff963880030000/0x8da3486b955f3585 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366647.660398:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff963880030000/0x8da3486b955f3585 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366647.660453:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff963880030600/0x8da3486b955f3577 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.23@tcp remote: 0xda917a494d06c061 expref: 54 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366647.660467:0:5817:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff963880030e00/0x8da3486b955f358c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.23@tcp remote: 0xda917a494d06c061 expref: 53 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366647.660474:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff963890797600) 00010000:00010000:2.0:1789366647.660476:0:5817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789366647.660479:0:5817:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff963880030e00, rc 0) 00000100:00100000:2.0:1789366647.660555:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638b73f8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0ab23baa-a205-44ad-bf17-f7b47295d82b+53:10427:x1876286751412992:12345-192.168.202.23@tcp:101:lfs.0 Request processed in 3156us (3372us total) trans 0 rc 0/0 00000100:00100000:2.0:1789366647.660577:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 67 00000004:00080000:1.0:1789366647.736132:0:8064:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 223200410662ns, next at 224200407879ns, rc = 0 00000100:00100000:3.0:1789366647.736152:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9638b73fa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3284:1876286758771072:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789366647.736235:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789366647.736311:0:6663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286758771072 00000100:00100000:1.0:1789366647.736320:0:6663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286758771072 00000100:00100000:1.0:1789366647.736367:0:6663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1789366647.736378:0:6663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638987ea300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3284:x1876286758771072:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789366647.736413:0:6663:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 1703936 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789366647.736473:0:6663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638987ea300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3284:x1876286758771072:12345-0@lo:13:osp-pre-1-0.0 Request processed in 96us (237us total) trans 0 rc 0/0 00000100:00100000:1.0:1789366647.736480:0:6663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1789366647.736759:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9638b73fa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3284:1876286758771072:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789366647.738395:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9638b7350a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8cde4528-5832-4854-a387-4adacc3dd0ab:3285:1876286758771200:0@lo:400:kworker.0 00000100:00100000:2.0:1789366647.738431:0:3286:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9638b7352680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3286:1876286758771328:0@lo:400:kworker.0 00000100:00100000:1.0:1789366647.738461:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789366647.738478:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789366647.738514:0:3286:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789366647.738517:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9638b7351500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3285:1876286758771712:0@lo:400:kworker.0 00000100:00100000:2.0:1789366647.738525:0:3286:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9638b7351c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3286:1876286758771456:0@lo:400:kworker.0 00000100:00100000:1.0:1789366647.738553:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789366647.738578:0:7132:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286758771328 00000100:00100000:2.0:1789366647.738586:0:7132:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286758771328 00000100:00100000:1.0:1789366647.738590:0:3285:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789366647.738601:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789366647.738610:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9638b7351180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3285:1876286758771584:0@lo:400:kworker.0 00000100:00100000:2.0:1789366647.738635:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286758771712 00000100:00100000:2.0:1789366647.738640:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286758771712 00000100:00100000:1.0:1789366647.738645:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789366647.738684:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286758771200 00000100:00100000:1.0:1789366647.738689:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286758771200 00000100:00100000:2.0:1789366647.738694:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286758771456 00000100:00100000:2.0:1789366647.738700:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286758771456 00000100:00100000:1.0:1789366647.738752:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 272 00000100:00100000:1.0:1789366647.738762:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638b4e81050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8cde4528-5832-4854-a387-4adacc3dd0ab+19:3285:x1876286758771200:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789366647.738766:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1789366647.738777:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638b73fb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3285:x1876286758771712:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789366647.738815:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638b4e81050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8cde4528-5832-4854-a387-4adacc3dd0ab+19:3285:x1876286758771200:12345-0@lo:400:kworker.0 Request processed in 55us (355us total) trans 0 rc 0/0 00000100:00100000:2.0:1789366647.738826:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638b73fb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3285:x1876286758771712:12345-0@lo:400:kworker.0 Request processed in 49us (271us total) trans 0 rc 0/0 00000100:00100000:1.0:1789366647.738827:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 272 00000100:00100000:2.0:1789366647.738838:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1789366647.738859:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:2.0:1789366647.738867:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638b7352300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3286:x1876286758771456:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789366647.738880:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286758771584 00000100:00100000:1.0:1789366647.738886:0:6659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286758771584 00000100:00100000:2.0:1789366647.738906:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638b7352300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3286:x1876286758771456:12345-0@lo:400:kworker.0 Request processed in 39us (303us total) trans 0 rc 0/0 00000100:00100000:1.0:1789366647.738914:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1789366647.738917:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1789366647.738928:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638b73f8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3285:x1876286758771584:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1789366647.738943:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789366647.738950:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789366647.738965:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638b73f8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3285:x1876286758771584:12345-0@lo:400:kworker.0 Request processed in 43us (323us total) trans 0 rc 0/0 00000100:00100000:1.0:1789366647.738974:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1789366647.738980:0:3286:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9638b7351c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3286:1876286758771456:0@lo:400:kworker.0 00000100:00100000:1.0:1789366647.739008:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9638b7351180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3285:1876286758771584:0@lo:400:kworker.0 00000100:00100000:1.0:1789366647.739019:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9638b7351500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3285:1876286758771712:0@lo:400:kworker.0 00000100:00100000:1.0:1789366647.739026:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9638b7350a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8cde4528-5832-4854-a387-4adacc3dd0ab:3285:1876286758771200:0@lo:400:kworker.0 00000100:00100000:1.0:1789366647.739059:0:7614:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1789366647.739067:0:7614:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638b7350e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3286:x1876286758771328:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789366647.739100:0:7614:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638b7350e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3286:x1876286758771328:12345-0@lo:400:kworker.0 Request processed in 34us (624us total) trans 0 rc 0/0 00000100:00100000:3.0:1789366647.739170:0:3286:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9638b7352680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3286:1876286758771328:0@lo:400:kworker.0 00000100:00100000:1.0:1789366647.740795:0:7614:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00010000:00010000:3.0:1789366647.866965:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1789366648.149375:0:11959:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1789366648.149384:0:11959:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1789366648.149418:0:11959:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:1.0:1789366648.149423:0:11959:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000001:00080000:3.0:1789366648.269432:0:5837:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967348 is committed 00000004:00080000:3.0:1789366648.269458:0:5837:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3 committed 00000004:00080000:3.0:1789366648.269485:0:5837:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2 committed 00000020:00080000:3.0:1789366648.269495:0:5837:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9638bfe9c0c0 refcount 2 committed 0 result 0 batchid 1 00000020:00080000:3.0:1789366648.269500:0:5837:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9638af03c800 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9638bfe9c6c0 00000020:00080000:3.0:1789366648.269504:0:5837:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9638af03c600 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff96388588ec00 00000001:00080000:3.0:1789366648.269531:0:5837:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967350 is committed 00000100:00100000:3.0:1789366648.269742:0:3286:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9638b702c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3286:1876286758771840:0@lo:6:osp-syn-1-0.0 00000020:00080000:1.0:1789366648.269770:0:5848:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 1 committed batchid 0 00000100:00100000:3.0:1789366648.269815:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00080000:1.0:1789366648.269908:0:5848:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000100:00100000:0.0:1789366648.270117:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286758771840 00000100:00100000:0.0:1789366648.270124:0:6660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286758771840 00000100:00100000:0.0:1789366648.270174:0:6660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1789366648.270181:0:6660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638987e8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3286:x1876286758771840:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1789366648.270202:0:6660:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:2 count 1 00000100:00080000:2.0:1789366648.270214:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00002000:00010000:0.0:1789366648.270230:0:6660:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x2:0x0] initial LVB size: 13, mtime: 0x6aa79176, atime: 0x6aa79176, ctime: 0x6aa79176, blocks: 0x1 00010000:00010000:0.0:1789366648.270238:0:6660:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005ab4af2f/0x8da3486b955f3593 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366648.270251:0:6660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=223s v=(0 0) 00010000:00010000:0.0:1789366648.270255:0:6660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789366648.270270:0:6660:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005ab4af2f/0x8da3486b955f3593 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366648.270288:0:6660:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005ab4af2f/0x8da3486b955f3593 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366648.270299:0:6660:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005ab4af2f/0x8da3486b955f3593 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366648.270308:0:6660:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005ab4af2f/0x8da3486b955f3593 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366648.270347:0:6660:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789366648.270368:0:6675:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789366648.270374:0:6675:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005ab4af2f/0x8da3486b955f3593 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366648.270382:0:6675:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9638b720d000 already unused, calling callback (ffffffffc16df520) 00010000:00010000:3.0:1789366648.270387:0:6675:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005ab4af2f/0x8da3486b955f3593 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366648.270406:0:6675:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005ab4af2f/0x8da3486b955f3593 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366648.270421:0:6675:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005ab4af2f/0x8da3486b955f3593 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366648.270428:0:6675:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005ab4af2f/0x8da3486b955f3593 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366648.270445:0:6675:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789366648.270446:0:6675:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789366648.270447:0:6675:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789366648.270766:0:6660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638987e8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3286:x1876286758771840:12345-0@lo:6:osp-syn-1-0.0 Request processed in 584us (951us total) trans 4294967301 rc 0/0 00000100:00100000:0.0:1789366648.270774:0:6660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000004:00080000:3.0:1789366648.270795:0:3286:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9638b702c700/2, rc 0, transno 4294967301 00000100:00100000:3.0:1789366648.270801:0:3286:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9638b702c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3286:1876286758771840:0@lo:6:osp-syn-1-0.0 00000040:00080000:2.0:1789366648.568168:0:11650:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1789366648.568178:0:11650:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1789366648.568254:0:11650:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:2.0:1789366648.568272:0:11650:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1789366648.568403:0:11650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9638b7351c00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11650:1876286758771968:192.168.202.23@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1789366648.568526:0:11650:0:(client.c:2716:ptlrpc_set_wait()) set ffff9638bf0cb240 going to sleep for 11 seconds 00000100:00100000:1.0:1789366648.572132:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:3.0:1789366648.572239:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751413120 00000100:00100000:3.0:1789366648.572249:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751413120 00000100:00100000:3.0:1789366648.572346:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 1 00000100:00100000:3.0:1789366648.572359:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638b73fb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:0ab23baa-a205-44ad-bf17-f7b47295d82b+12:10439:x1876286751413120:12345-192.168.202.23@tcp:900:lhsmtool_posix.0 00000100:00100000:3.0:1789366648.572442:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638b73fb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:0ab23baa-a205-44ad-bf17-f7b47295d82b+12:10439:x1876286751413120:12345-192.168.202.23@tcp:900:lhsmtool_posix.0 Request processed in 87us (321us total) trans 0 rc 0/0 00000100:00100000:3.0:1789366648.572450:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 1 00000100:00080000:0.0:1789366648.573014:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789366648.573348:0:11650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9638b7351c00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11650:1876286758771968:192.168.202.23@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1789366648.575130:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:2.0:1789366648.575283:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751413248 00000100:00100000:2.0:1789366648.575292:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751413248 00000100:00100000:2.0:1789366648.575428:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 68 00000100:00100000:2.0:1789366648.575439:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638b73faa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0ab23baa-a205-44ad-bf17-f7b47295d82b+11:10439:x1876286751413248:12345-192.168.202.23@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1789366648.575470:0:5816:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1789366648.575617:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638b73faa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0ab23baa-a205-44ad-bf17-f7b47295d82b+11:10439:x1876286751413248:12345-192.168.202.23@tcp:53:lhsmtool_posix.0 Request processed in 180us (493us total) trans 0 rc 0/0 00000100:00100000:2.0:1789366648.575624:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 68 00000100:00100000:3.0:1789366648.584316:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:0.0:1789366648.585098:0:7132:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751413376 00000100:00100000:0.0:1789366648.585109:0:7132:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751413376 00000100:00100000:0.0:1789366648.585210:0:7132:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 69 00000100:00100000:0.0:1789366648.585221:0:7132:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638987ea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0ab23baa-a205-44ad-bf17-f7b47295d82b+11:10439:x1876286751413376:12345-192.168.202.23@tcp:34:lhsmtool_posix.0 00010000:00010000:0.0:1789366648.585297:0:7132:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720cc00/0x8da3486b955f359a lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366648.585313:0:7132:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720cc00/0x8da3486b955f359a lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366648.585326:0:7132:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720cc00/0x8da3486b955f359a lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366648.585374:0:7132:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720d600/0x8da3486b955f35a1 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366648.585382:0:7132:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720d600/0x8da3486b955f35a1 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366648.585389:0:7132:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720d600/0x8da3486b955f35a1 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366648.585410:0:7132:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720dc00/0x8da3486b955f35a8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366648.585435:0:7132:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720dc00/0x8da3486b955f35a8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366648.585442:0:7132:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720dc00/0x8da3486b955f35a8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789366648.585480:0:7132:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:0.0:1789366648.585484:0:7132:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1789366648.585497:0:7132:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720dc00/0x8da3486b955f35a8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366648.585507:0:7132:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720cc00/0x8da3486b955f359a lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366648.585514:0:7132:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720cc00/0x8da3486b955f359a lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366648.585521:0:7132:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720cc00/0x8da3486b955f359a lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366648.585527:0:7132:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9638b720cc00 already unused, calling callback (ffffffffc20ee4f0) 00010000:00010000:0.0:1789366648.585531:0:7132:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720cc00/0x8da3486b955f359a lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366648.585538:0:7132:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720cc00/0x8da3486b955f359a lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366648.585549:0:7132:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9638a7404100) 00010000:00010000:0.0:1789366648.585552:0:7132:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789366648.585556:0:7132:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720cc00/0x8da3486b955f359a lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366648.585571:0:7132:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720cc00/0x8da3486b955f359a lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366648.585583:0:7132:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720d600/0x8da3486b955f35a1 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366648.585589:0:7132:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720d600/0x8da3486b955f35a1 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366648.585595:0:7132:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720d600/0x8da3486b955f35a1 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366648.585612:0:7132:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9638b720d600 already unused, calling callback (ffffffffc20ee4f0) 00010000:00010000:0.0:1789366648.585615:0:7132:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720d600/0x8da3486b955f35a1 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366648.585621:0:7132:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720d600/0x8da3486b955f35a1 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366648.585628:0:7132:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x3c15db59 (ffff963890797500) 00010000:00010000:0.0:1789366648.585631:0:7132:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789366648.585633:0:7132:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720d600/0x8da3486b955f35a1 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366648.585639:0:7132:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720d600/0x8da3486b955f35a1 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366648.585663:0:7132:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720dc00/0x8da3486b955f35a8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366648.585669:0:7132:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720dc00/0x8da3486b955f35a8 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366648.585679:0:7132:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720dc00/0x8da3486b955f35a8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366648.585684:0:7132:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9638b720dc00 already unused, calling callback (ffffffffc20ee4f0) 00010000:00010000:0.0:1789366648.585687:0:7132:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720dc00/0x8da3486b955f35a8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366648.585693:0:7132:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720dc00/0x8da3486b955f35a8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366648.585699:0:7132:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff963890797600) 00010000:00010000:0.0:1789366648.585701:0:7132:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789366648.585704:0:7132:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720dc00/0x8da3486b955f35a8 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366648.585710:0:7132:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720dc00/0x8da3486b955f35a8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789366648.586124:0:7132:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638987ea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0ab23baa-a205-44ad-bf17-f7b47295d82b+11:10439:x1876286751413376:12345-192.168.202.23@tcp:34:lhsmtool_posix.0 Request processed in 903us (1814us total) trans 0 rc 0/0 00000100:00100000:0.0:1789366648.586132:0:7132:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 69 00000100:00100000:1.0:1789366648.590544:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:2.0:1789366648.590701:0:7614:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751413632 00000100:00100000:2.0:1789366648.590712:0:7614:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751413632 00000100:00100000:2.0:1789366648.591002:0:7614:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 70 00000100:00100000:2.0:1789366648.591013:0:7614:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638b73fb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0ab23baa-a205-44ad-bf17-f7b47295d82b+11:10439:x1876286751413632:12345-192.168.202.23@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789366648.591041:0:7614:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789366648.591063:0:7614:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff963880030000/0x8da3486b955f35af lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xda917a494d06c068 expref: -99 pid: 7614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366648.591167:0:7614:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff963880031400/0x8da3486b955f35b6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7614 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366648.591183:0:7614:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff963880031400/0x8da3486b955f35b6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7614 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366648.591209:0:7614:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff963880031400/0x8da3486b955f35b6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7614 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789366648.591221:0:7614:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:2.0:1789366648.591818:0:7614:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff963880031400/0x8da3486b955f35b6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7614 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366648.591828:0:7614:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff963880031400/0x8da3486b955f35b6 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7614 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366648.591835:0:7614:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff963880031400/0x8da3486b955f35b6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7614 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366648.591841:0:7614:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff963880031400 already unused, calling callback (ffffffffc20ee4f0) 00010000:00010000:2.0:1789366648.591846:0:7614:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff963880031400/0x8da3486b955f35b6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7614 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366648.591854:0:7614:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff963880031400/0x8da3486b955f35b6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7614 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366648.591866:0:7614:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff963890797600) 00010000:00010000:2.0:1789366648.591869:0:7614:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789366648.591874:0:7614:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff963880031400/0x8da3486b955f35b6 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7614 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366648.591880:0:7614:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff963880031400/0x8da3486b955f35b6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7614 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366648.591922:0:7614:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff963880030000/0x8da3486b955f35af lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.23@tcp remote: 0xda917a494d06c068 expref: 13 pid: 7614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366648.591948:0:7614:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9638a7404100) 00010000:00010000:2.0:1789366648.591950:0:7614:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789366648.591955:0:7614:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff963880030000/0x8da3486b955f35af lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.23@tcp remote: 0xda917a494d06c068 expref: 13 pid: 7614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366648.591967:0:7614:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff963880030000, rc 0) 00000100:00100000:2.0:1789366648.592288:0:7614:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638b73fb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0ab23baa-a205-44ad-bf17-f7b47295d82b+12:10439:x1876286751413632:12345-192.168.202.23@tcp:101:lhsmtool_posix.0 Request processed in 1019us (1496us total) trans 4294967351 rc 301/301 00000100:00100000:2.0:1789366648.592296:0:7614:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 70 00000100:00100000:1.0:1789366648.595017:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:0.0:1789366648.596303:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751413760 00000100:00100000:0.0:1789366648.596314:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751413760 00000100:00100000:0.0:1789366648.596390:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 71 00000100:00100000:0.0:1789366648.596400:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638b73f8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0ab23baa-a205-44ad-bf17-f7b47295d82b+12:10439:x1876286751413760:12345-192.168.202.23@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1789366648.596432:0:5816:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1789366648.596534:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638b73f8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0ab23baa-a205-44ad-bf17-f7b47295d82b+12:10439:x1876286751413760:12345-192.168.202.23@tcp:53:lhsmtool_posix.0 Request processed in 135us (1525us total) trans 0 rc 0/0 00000100:00100000:0.0:1789366648.596558:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 71 00000100:00100000:0.0:1789366648.602565:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:3.0:1789366648.602651:0:7132:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751414016 00000100:00100000:3.0:1789366648.602672:0:7132:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751414016 00000100:00100000:3.0:1789366648.602749:0:7132:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 72 00000100:00100000:3.0:1789366648.602785:0:7132:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963890774700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0ab23baa-a205-44ad-bf17-f7b47295d82b+12:10439:x1876286751414016:12345-192.168.202.23@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789366648.602804:0:7132:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789366648.602807:0:7132:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1789366648.602828:0:7132:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720d200/0x8da3486b955f3569 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.23@tcp remote: 0xda917a494d06c05a expref: 12 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366648.602845:0:7132:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff963890797000) 00010000:00010000:3.0:1789366648.602851:0:7132:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789366648.602864:0:7132:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9638832d2000/0x8da3486b955f35c4 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xda917a494d06c06f expref: -99 pid: 7132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1789366648.605410:0:7132:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x3:0x0], index 0: 0 00010000:00010000:2.0:1789366648.605630:0:7132:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff963880030600/0x8da3486b955f35cb lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366648.605647:0:7132:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff963880030600/0x8da3486b955f35cb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366648.605659:0:7132:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff963880030600/0x8da3486b955f35cb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366648.605911:0:7132:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9638832d2000/0x8da3486b955f35c4 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.23@tcp remote: 0xda917a494d06c06f expref: 14 pid: 7132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366648.605928:0:7132:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff963880030600/0x8da3486b955f35cb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.23@tcp remote: 0xda917a494d06c06f expref: 13 pid: 7132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366648.605935:0:7132:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9638a7404600) 00010000:00010000:2.0:1789366648.605937:0:7132:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789366648.605945:0:7132:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff963880030600, rc 0) 00000100:00100000:2.0:1789366648.606176:0:7132:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963890774700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0ab23baa-a205-44ad-bf17-f7b47295d82b+13:10439:x1876286751414016:12345-192.168.202.23@tcp:101:lhsmtool_posix.0 Request processed in 3402us (3620us total) trans 4294967352 rc 0/0 00000100:00100000:2.0:1789366648.606185:0:7132:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 72 00000100:00100000:1.0:1789366648.610142:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:2.0:1789366648.610243:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751414272 00000100:00100000:2.0:1789366648.610264:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751414272 00000100:00100000:2.0:1789366648.610427:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 73 00000100:00100000:2.0:1789366648.610439:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638b73f9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0ab23baa-a205-44ad-bf17-f7b47295d82b+13:10439:x1876286751414272:12345-192.168.202.23@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1789366648.610496:0:5815:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789366648.610524:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff963880030600/0x8da3486b955f35cb lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.23@tcp remote: 0xda917a494d06c06f expref: 13 pid: 7132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366648.610548:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9638a7404600) 00010000:00010000:2.0:1789366648.610561:0:5815:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789366648.610586:0:5815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff963880030000/0x8da3486b955f35d9 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366648.610599:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff963880030000/0x8da3486b955f35d9 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366648.610608:0:5815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff963880030000/0x8da3486b955f35d9 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366648.610642:0:5815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff963880031400/0x8da3486b955f35e0 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x2804eb0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366648.610650:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff963880031400/0x8da3486b955f35e0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x2804eb0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366648.612884:0:5815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff963880031400/0x8da3486b955f35e0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x2804eb0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366648.613429:0:5815:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff963880030000/0x8da3486b955f35d9 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366648.613439:0:5815:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff963880030000/0x8da3486b955f35d9 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366648.613447:0:5815:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff963880030000/0x8da3486b955f35d9 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366648.613452:0:5815:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff963880030000 already unused, calling callback (ffffffffc20ee4f0) 00010000:00010000:2.0:1789366648.613457:0:5815:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff963880030000/0x8da3486b955f35d9 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366648.613466:0:5815:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff963880030000/0x8da3486b955f35d9 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366648.613479:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff963890797000) 00010000:00010000:2.0:1789366648.613482:0:5815:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789366648.613487:0:5815:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff963880030000/0x8da3486b955f35d9 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366648.613493:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff963880030000/0x8da3486b955f35d9 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366648.613507:0:5815:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff963880031400/0x8da3486b955f35e0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x2804eb0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366648.613513:0:5815:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff963880031400/0x8da3486b955f35e0 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x2804eb0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366648.613519:0:5815:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff963880031400/0x8da3486b955f35e0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x2804eb0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366648.613530:0:5815:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff963880031400 already unused, calling callback (ffffffffc20ee4f0) 00010000:00010000:2.0:1789366648.613533:0:5815:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff963880031400/0x8da3486b955f35e0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x2804eb0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366648.613538:0:5815:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff963880031400/0x8da3486b955f35e0 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x2804eb0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366648.613546:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x2804eb0 (ffff9638a7404500) 00010000:00010000:2.0:1789366648.613549:0:5815:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789366648.613551:0:5815:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff963880031400/0x8da3486b955f35e0 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x2804eb0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366648.613557:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff963880031400/0x8da3486b955f35e0 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x2804eb0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789366648.613692:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638b73f9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0ab23baa-a205-44ad-bf17-f7b47295d82b+12:10439:x1876286751414272:12345-192.168.202.23@tcp:36:lhsmtool_posix.0 Request processed in 3251us (3555us total) trans 0 rc -2/-2 00000100:00100000:2.0:1789366648.613702:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 73 00000100:00100000:1.0:1789366648.619392:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:2.0:1789366648.619481:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751414400 00000100:00100000:2.0:1789366648.619491:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751414400 00000100:00100000:2.0:1789366648.619551:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 74 00000100:00100000:2.0:1789366648.619561:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638b73fbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0ab23baa-a205-44ad-bf17-f7b47295d82b+12:10439:x1876286751414400:12345-192.168.202.23@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789366648.619581:0:5817:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789366648.619622:0:5817:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9638a0740800/0x8da3486b955f35e7 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xda917a494d06c076 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366648.619680:0:5817:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9800/0x8da3486b955f35ee lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366648.619705:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9800/0x8da3486b955f35ee lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366648.619750:0:5817:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9800/0x8da3486b955f35ee lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366648.619846:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9638a0740800/0x8da3486b955f35e7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.23@tcp remote: 0xda917a494d06c076 expref: 14 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366648.619863:0:5817:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9800/0x8da3486b955f35ee lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.23@tcp remote: 0xda917a494d06c076 expref: 13 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366648.619872:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9638a7404300) 00010000:00010000:2.0:1789366648.619875:0:5817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1789366648.619878:0:5817:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9638902c9800, rc 0) 00000100:00100000:2.0:1789366648.619927:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638b73fbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0ab23baa-a205-44ad-bf17-f7b47295d82b+13:10439:x1876286751414400:12345-192.168.202.23@tcp:101:lhsmtool_posix.0 Request processed in 368us (546us total) trans 0 rc 0/0 00000100:00100000:2.0:1789366648.619934:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 74 00000100:00100000:1.0:1789366648.629225:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:2.0:1789366648.629319:0:7132:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751414656 00000100:00100000:2.0:1789366648.629339:0:7132:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751414656 00000100:00100000:2.0:1789366648.629412:0:7132:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 75 00000100:00100000:2.0:1789366648.629423:0:7132:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638b73f9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0ab23baa-a205-44ad-bf17-f7b47295d82b+13:10439:x1876286751414656:12345-192.168.202.23@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1789366648.629513:0:7132:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9a00/0x8da3486b955f35f5 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366648.629531:0:7132:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9a00/0x8da3486b955f35f5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366648.629564:0:7132:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9a00/0x8da3486b955f35f5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1789366648.629909:0:7132:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].3, 88 off8408 00000004:00080000:2.0:1789366648.629920:0:7132:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 224094201382ns, next at 225094199147ns, rc = 0 00000004:00010000:2.0:1789366648.630002:0:7132:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000001f8cee23 reply state 00000000d0f96949 transno 4294967353 ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9a00/0x8da3486b955f35f5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789366648.630012:0:7132:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789366648.630877:0:7132:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638b73f9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0ab23baa-a205-44ad-bf17-f7b47295d82b+15:10439:x1876286751414656:12345-192.168.202.23@tcp:36:lhsmtool_posix.0 Request processed in 1452us (1658us total) trans 4294967353 rc 0/0 00000100:00100000:2.0:1789366648.630888:0:7132:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 75 00010000:00010000:0.0:1789366648.637966:0:3271:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9a00/0x8da3486b955f35f5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366648.637984:0:3271:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9a00/0x8da3486b955f35f5 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366648.638003:0:3271:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9a00/0x8da3486b955f35f5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366648.638009:0:3271:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9638902c9a00 already unused, calling callback (ffffffffc20ee4f0) 00010000:00010000:0.0:1789366648.638014:0:3271:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9a00/0x8da3486b955f35f5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366648.638029:0:3271:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9a00/0x8da3486b955f35f5 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366648.638054:0:3271:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9638a7404300) 00010000:00010000:0.0:1789366648.638057:0:3271:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1789366648.638061:0:3271:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9a00/0x8da3486b955f35f5 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366648.638067:0:3271:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9a00/0x8da3486b955f35f5 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789366648.644682:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:2.0:1789366648.645928:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751414784 00000100:00100000:2.0:1789366648.645942:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751414784 00000100:00100000:2.0:1789366648.646203:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 76 00000100:00100000:2.0:1789366648.646215:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638b73f8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0ab23baa-a205-44ad-bf17-f7b47295d82b+14:10439:x1876286751414784:12345-192.168.202.23@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789366648.646238:0:5815:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789366648.647553:0:5815:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c8200/0x8da3486b955f35fc lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xda917a494d06c07d expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366648.648251:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c8200/0x8da3486b955f35fc lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.23@tcp remote: 0xda917a494d06c07d expref: 15 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366648.648278:0:5815:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c8200/0x8da3486b955f35fc lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.23@tcp remote: 0xda917a494d06c07d expref: 15 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366648.648300:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9638a7404300) 00010000:00010000:2.0:1789366648.648318:0:5815:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789366648.648322:0:5815:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9638902c8200, rc 0) 00000100:00100000:2.0:1789366648.649293:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638b73f8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0ab23baa-a205-44ad-bf17-f7b47295d82b+15:10439:x1876286751414784:12345-192.168.202.23@tcp:101:lhsmtool_posix.0 Request processed in 3076us (4616us total) trans 0 rc 0/0 00000100:00100000:2.0:1789366648.649303:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 76 00000100:00100000:2.0:1789366648.653297:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:0.0:1789366648.653538:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751414912 00000100:00100000:0.0:1789366648.653547:0:6659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751414912 00000100:00100000:0.0:1789366648.653600:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 25 00000100:00100000:0.0:1789366648.653609:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638b7351c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2353:x1876286751414912:12345-192.168.202.23@tcp:8:lhsmtool_posix.0 00010000:00080000:0.0:1789366648.653656:0:6659:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 0ab23baa-a205-44ad-bf17-f7b47295d82b@192.168.202.23@tcp t0 exp 0000000000000000 cur 224 last 0 00000020:00000080:0.0:1789366648.653688:0:6659:0:(genops.c:1385:class_connect()) connect: client 0ab23baa-a205-44ad-bf17-f7b47295d82b, cookie 0x8da3486b955f3603 00002000:00100000:0.0:1789366648.653700:0:6659:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 0ab23baa-a205-44ad-bf17-f7b47295d82b/ffff96388891b800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a06 ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1789366648.654405:0:6659:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:0.0:1789366648.655859:0:6659:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1789366648.655903:0:6659:0:(import.c:65:import_set_state_nolock()) ffff96388891e800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789366648.655997:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638b7351c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0ab23baa-a205-44ad-bf17-f7b47295d82b+6:2353:x1876286751414912:12345-192.168.202.23@tcp:8:lhsmtool_posix.0 Request processed in 2385us (2706us total) trans 0 rc 0/0 00000100:00100000:0.0:1789366648.656008:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 25 00000100:00100000:1.0:1789366648.662889:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:2.0:1789366648.663582:0:8065:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751415040 00000100:00100000:2.0:1789366648.663695:0:8065:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751415040 00000100:00100000:2.0:1789366648.663811:0:8065:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 26 00000100:00100000:2.0:1789366648.663823:0:8065:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638b73fad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0ab23baa-a205-44ad-bf17-f7b47295d82b+6:0:x1876286751415040:12345-192.168.202.23@tcp:2:lhsmtool_posix.0 00000100:00080000:0.0:1789366648.665039:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789366648.717521:0:8065:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638b73fad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0ab23baa-a205-44ad-bf17-f7b47295d82b+7:0:x1876286751415040:12345-192.168.202.23@tcp:2:lhsmtool_posix.0 Request processed in 53690us (54631us total) trans 4294967301 rc 0/0 00000100:00100000:2.0:1789366648.717535:0:8065:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 26 00000001:00100000:1.0:1789366648.717582:0:6685:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 0ab23baa-a205-44ad-bf17-f7b47295d82b 00000001:00080000:1.0:1789366648.717597:0:6685:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967301 is committed 00000100:00100000:1.0:1789366648.723701:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:2.0:1789366648.723837:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751415296 00000100:00100000:2.0:1789366648.723848:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751415296 00000100:00100000:2.0:1789366648.724047:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 19 00000100:00100000:2.0:1789366648.724060:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638b73f8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0ab23baa-a205-44ad-bf17-f7b47295d82b+15:10439:x1876286751415296:12345-192.168.202.23@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1789366648.724283:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638b73f8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0ab23baa-a205-44ad-bf17-f7b47295d82b+16:10439:x1876286751415296:12345-192.168.202.23@tcp:35:lhsmtool_posix.0 Request processed in 226us (591us total) trans 4294967354 rc 0/0 00000100:00100000:2.0:1789366648.724289:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 19 00000100:00100000:2.0:1789366648.726337:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:0.0:1789366648.726393:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751415552 00000100:00100000:0.0:1789366648.726401:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751415552 00000100:00100000:0.0:1789366648.726452:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 77 00000100:00100000:0.0:1789366648.726462:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638b7353100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0ab23baa-a205-44ad-bf17-f7b47295d82b+16:10439:x1876286751415552:12345-192.168.202.23@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1789366648.726552:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638b7353100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0ab23baa-a205-44ad-bf17-f7b47295d82b+16:10439:x1876286751415552:12345-192.168.202.23@tcp:57:lhsmtool_posix.0 Request processed in 91us (218us total) trans 0 rc 0/0 00000100:00100000:0.0:1789366648.726560:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 77 00000100:00100000:1.0:1789366648.731783:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:2.0:1789366648.731892:0:7614:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751415680 00000100:00100000:2.0:1789366648.731900:0:7614:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751415680 00000100:00100000:2.0:1789366648.731944:0:7614:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 78 00000100:00100000:2.0:1789366648.731951:0:7614:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638b73fa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0ab23baa-a205-44ad-bf17-f7b47295d82b+16:10439:x1876286751415680:12345-192.168.202.23@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789366648.731968:0:7614:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789366648.732002:0:7614:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9000/0x8da3486b955f360a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xda917a494d06c084 expref: -99 pid: 7614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366648.732057:0:7614:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9c00/0x8da3486b955f3611 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7614 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366648.732068:0:7614:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9c00/0x8da3486b955f3611 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7614 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366648.732076:0:7614:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9c00/0x8da3486b955f3611 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7614 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789366648.732105:0:7614:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1789366648.732117:0:7614:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9c00/0x8da3486b955f3611 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7614 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366648.732136:0:7614:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9000/0x8da3486b955f360a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.23@tcp remote: 0xda917a494d06c084 expref: 18 pid: 7614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366648.732153:0:7614:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9c00/0x8da3486b955f3611 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.23@tcp remote: 0xda917a494d06c084 expref: 17 pid: 7614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366648.732161:0:7614:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9638a7404300) 00010000:00010000:2.0:1789366648.732164:0:7614:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1789366648.732168:0:7614:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9638902c9c00, rc 0) 00000100:00100000:2.0:1789366648.732216:0:7614:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638b73fa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0ab23baa-a205-44ad-bf17-f7b47295d82b+17:10439:x1876286751415680:12345-192.168.202.23@tcp:101:lhsmtool_posix.0 Request processed in 266us (442us total) trans 0 rc 0/0 00000100:00100000:2.0:1789366648.732225:0:7614:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 78 00000100:00100000:1.0:1789366648.736801:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:2.0:1789366648.736882:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751415808 00000100:00100000:2.0:1789366648.736890:0:6661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751415808 00000100:00100000:2.0:1789366648.736942:0:6661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 27 00000100:00100000:2.0:1789366648.736950:0:6661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638b73f9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0ab23baa-a205-44ad-bf17-f7b47295d82b+5:2354:x1876286751415808:12345-192.168.202.23@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789366648.736966:0:6661:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789366648.736983:0:6661:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000dce0b69e/0x8da3486b955f3618 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda917a494d06c08b expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789366648.737005:0:6661:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6aa79178, blocks: 0x1 00010000:00010000:2.0:1789366648.737019:0:6661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=224s v=(0 0) 00010000:00010000:2.0:1789366648.737023:0:6661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789366648.737029:0:6661:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000dce0b69e/0x8da3486b955f3618 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.23@tcp remote: 0xda917a494d06c08b expref: 6 pid: 6661 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366648.737043:0:6661:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000dce0b69e/0x8da3486b955f3618 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.23@tcp remote: 0xda917a494d06c08b expref: 6 pid: 6661 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366648.737053:0:6661:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9638902c8a00, rc 0) 00000100:00100000:2.0:1789366648.737096:0:6661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638b73f9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0ab23baa-a205-44ad-bf17-f7b47295d82b+6:2354:x1876286751415808:12345-192.168.202.23@tcp:101:lhsmtool_posix.0 Request processed in 148us (304us total) trans 0 rc 0/0 00000100:00100000:2.0:1789366648.737100:0:6661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 27 00000100:00100000:3.0:1789366648.741051:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:2.0:1789366648.741116:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751416064 00000100:00100000:2.0:1789366648.741127:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751416064 00000100:00100000:2.0:1789366648.741198:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 79 00000100:00100000:2.0:1789366648.741208:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638b4f19500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0ab23baa-a205-44ad-bf17-f7b47295d82b+17:10439:x1876286751416064:12345-192.168.202.23@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1789366648.741323:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638b4f19500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0ab23baa-a205-44ad-bf17-f7b47295d82b+17:10439:x1876286751416064:12345-192.168.202.23@tcp:57:lhsmtool_posix.0 Request processed in 116us (281us total) trans 0 rc 0/0 00000100:00100000:2.0:1789366648.741332:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 79 00000100:00100000:1.0:1789366648.743401:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:0.0:1789366648.743500:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751416192 00000100:00100000:0.0:1789366648.743509:0:6660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751416192 00000100:00100000:0.0:1789366648.743566:0:6660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 28 00000100:00100000:0.0:1789366648.743576:0:6660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638b73fa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0ab23baa-a205-44ad-bf17-f7b47295d82b+6:10439:x1876286751416192:12345-192.168.202.23@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789366648.743594:0:6660:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789366648.743623:0:6660:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a1abbe94/0x8da3486b955f361f lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda917a494d06c092 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366648.743671:0:6660:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000dce0b69e/0x8da3486b955f3618 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.23@tcp remote: 0xda917a494d06c08b expref: 7 pid: 6661 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366648.743680:0:6660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789366648.743684:0:6660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789366648.743690:0:6660:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a1abbe94/0x8da3486b955f361f lrc: 4/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.23@tcp remote: 0xda917a494d06c092 expref: 7 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366648.743762:0:6660:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000dce0b69e/0x8da3486b955f3618 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.23@tcp remote: 0xda917a494d06c08b expref: 7 pid: 6661 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366648.743775:0:6660:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000dce0b69e/0x8da3486b955f3618 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.23@tcp remote: 0xda917a494d06c08b expref: 7 pid: 6661 timeout: 324 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789366648.743788:0:6660:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff963890775c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6660:1876286758772096:192.168.202.23@tcp:104: 00000100:00100000:0.0:1789366648.743944:0:6660:0:(client.c:2716:ptlrpc_set_wait()) set ffff9638b70ff0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789366648.746953:0:6660:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff963890775c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6660:1876286758772096:192.168.202.23@tcp:104: 00010000:00010000:0.0:1789366648.746999:0:6660:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000a1abbe94/0x8da3486b955f361f lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.23@tcp remote: 0xda917a494d06c092 expref: 7 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366648.747019:0:6660:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9638b720dc00, rc 0) 00000100:00100000:0.0:1789366648.747068:0:6660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638b73fa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0ab23baa-a205-44ad-bf17-f7b47295d82b+7:10439:x1876286751416192:12345-192.168.202.23@tcp:101:lhsmtool_posix.0 Request processed in 3494us (3675us total) trans 0 rc 0/0 00000100:00100000:0.0:1789366648.747075:0:6660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 28 00000100:00100000:3.0:1789366648.747271:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:2.0:1789366648.748083:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751416320 00000100:00100000:2.0:1789366648.748092:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751416320 00010000:00010000:2.0:1789366648.748126:0:5803:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000dce0b69e/0x8da3486b955f3618 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.23@tcp remote: 0xda917a494d06c08b expref: 7 pid: 6661 timeout: 324 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789366648.748192:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 41 00000100:00100000:2.0:1789366648.748201:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638b4f18a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0ab23baa-a205-44ad-bf17-f7b47295d82b+7:2355:x1876286751416320:12345-192.168.202.23@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789366648.748213:0:5803:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789366648.748233:0:5803:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000dce0b69e/0x8da3486b955f3618 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.23@tcp remote: 0xda917a494d06c08b expref: 7 pid: 6661 timeout: 324 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366648.748245:0:5803:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000dce0b69e/0x8da3486b955f3618 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.23@tcp remote: 0xda917a494d06c08b expref: 7 pid: 6661 timeout: 324 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366648.748275:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000dce0b69e/0x8da3486b955f3618 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.23@tcp remote: 0xda917a494d06c08b expref: 7 pid: 6661 timeout: 324 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366648.748289:0:5803:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789366648.748294:0:5803:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789366648.748301:0:5803:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000a1abbe94/0x8da3486b955f361f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.23@tcp remote: 0xda917a494d06c092 expref: 6 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366648.748312:0:5803:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a1abbe94/0x8da3486b955f361f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.23@tcp remote: 0xda917a494d06c092 expref: 6 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366648.748341:0:5803:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000a1abbe94/0x8da3486b955f361f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.23@tcp remote: 0xda917a494d06c092 expref: 6 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789366648.748364:0:5803:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9638b7350380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:5803:1876286758772224:192.168.202.23@tcp:105: 00000100:00100000:2.0:1789366648.748427:0:5803:0:(client.c:2716:ptlrpc_set_wait()) set ffff9638bf0cb480 going to sleep for 11 seconds 00000100:00100000:1.0:1789366648.750943:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:2.0:1789366648.751031:0:5803:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9638b7350380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:5803:1876286758772224:192.168.202.23@tcp:105: 00010000:00010000:2.0:1789366648.751051:0:5803:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789366648.751101:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638b4f18a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0ab23baa-a205-44ad-bf17-f7b47295d82b+6:2355:x1876286751416320:12345-192.168.202.23@tcp:103:ldlm_bl.0 Request processed in 2901us (3831us total) trans 0 rc 0/0 00000100:00100000:2.0:1789366648.751111:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 41 00000100:00100000:3.0:1789366648.751285:0:6666:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751416448 00000100:00100000:3.0:1789366648.751291:0:6666:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751416448 00002000:00100000:3.0:1789366648.751327:0:6666:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3:0x0] (0->8) req@ffff9638b7215180 x1876286751416448/t0(0) o4->0ab23baa-a205-44ad-bf17-f7b47295d82b@192.168.202.23@tcp:49/0 lens 504/0 e 0 to 0 dl 1789366659 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789366648.751337:0:6666:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9638b7215180 with x1876286751416448 ext(0->8) 00002000:00010000:3.0:1789366648.751342:0:6666:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9638b7215180 00000100:00100000:3.0:1789366648.751371:0:6666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 0 00000100:00100000:3.0:1789366648.751379:0:6666:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638b7215180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0ab23baa-a205-44ad-bf17-f7b47295d82b+6:2356:x1876286751416448:12345-192.168.202.23@tcp:4:lhsmtool_posix.0 00000100:00100000:3.0:1789366648.751985:0:6666:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638b7215180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0ab23baa-a205-44ad-bf17-f7b47295d82b+8:2356:x1876286751416448:12345-192.168.202.23@tcp:4:lhsmtool_posix.0 Request processed in 604us (1046us total) trans 4294967302 rc 0/0 00000100:00100000:3.0:1789366648.751992:0:6666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 0 00002000:00100000:3.0:1789366648.751999:0:6666:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3:0x0] (0->8) req@ffff9638b7215180 x1876286751416448/t4294967302(0) o4->0ab23baa-a205-44ad-bf17-f7b47295d82b@192.168.202.23@tcp:49/0 lens 504/448 e 0 to 0 dl 1789366659 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789366648.752017:0:6666:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9638b7215180 with x1876286751416448 ext(0->8) 00002000:00010000:3.0:1789366648.752021:0:6666:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9638b7215180 00000100:00100000:1.0:1789366648.754551:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:0.0:1789366648.754814:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751416576 00000100:00100000:0.0:1789366648.754823:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751416576 00000100:00100000:0.0:1789366648.754907:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 80 00000100:00100000:0.0:1789366648.754915:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638b7215500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0ab23baa-a205-44ad-bf17-f7b47295d82b+17:10439:x1876286751416576:12345-192.168.202.23@tcp:44:lhsmtool_posix.0 00000020:00080000:1.0:1789366648.777111:0:5837:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 1 batchid updated 00000001:00080000:1.0:1789366648.777142:0:5837:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967354 is committed 00000004:00080000:1.0:1789366648.777151:0:5837:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 4 committed 00000020:00080000:3.0:1789366648.777251:0:5848:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000020:00080000:3.0:1789366648.777272:0:5848:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000100:00100000:2.0:1789366648.777585:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638b7215500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0ab23baa-a205-44ad-bf17-f7b47295d82b+13:10439:x1876286751416576:12345-192.168.202.23@tcp:44:lhsmtool_posix.0 Request processed in 22664us (23035us total) trans 0 rc 0/0 00000100:00100000:2.0:1789366648.777597:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 80 00000100:00100000:3.0:1789366648.777800:0:3287:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9638b7350380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3287:1876286758772352:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1789366648.777851:0:3287:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789366648.777966:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286758772352 00000100:00100000:2.0:1789366648.777972:0:6659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286758772352 00000100:00100000:2.0:1789366648.778028:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1789366648.778037:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638b4f19880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3287:x1876286758772352:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:2.0:1789366648.778173:0:6659:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:2.0:1789366648.778177:0:6659:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb mtime from disk: 0 -> 1789366649 00002000:00010000:2.0:1789366648.778179:0:6659:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1789366648.778182:0:6659:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb ctime from disk: 1789366648 -> 1789366649 00002000:00010000:2.0:1789366648.778185:0:6659:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:2.0:1789366648.778220:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638b4f19880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3287:x1876286758772352:12345-0@lo:2:osp-syn-0-0.0 Request processed in 184us (367us total) trans 4294967303 rc 0/0 00000100:00100000:2.0:1789366648.778227:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000004:00080000:2.0:1789366648.778273:0:3287:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9638b7350380/2, rc 0, transno 4294967303 00000100:00100000:2.0:1789366648.778278:0:3287:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9638b7350380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3287:1876286758772352:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1789366648.784795:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:2.0:1789366648.784884:0:8065:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751416704 00000100:00100000:2.0:1789366648.784893:0:8065:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751416704 00000100:00100000:2.0:1789366648.784937:0:8065:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 30 00000100:00100000:2.0:1789366648.784946:0:8065:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638b7214e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0ab23baa-a205-44ad-bf17-f7b47295d82b+8:2355:x1876286751416704:12345-192.168.202.23@tcp:16:lhsmtool_posix.0 00000001:00080000:3.0:1789366648.827948:0:6685:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967303 is committed 00000001:00080000:3.0:1789366648.827964:0:6685:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967302 is committed 00000100:00100000:2.0:1789366648.828169:0:8065:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638b7214e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0ab23baa-a205-44ad-bf17-f7b47295d82b+6:2355:x1876286751416704:12345-192.168.202.23@tcp:16:lhsmtool_posix.0 Request processed in 43218us (43377us total) trans 0 rc 0/0 00000100:00100000:2.0:1789366648.828180:0:8065:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 30 00000100:00100000:1.0:1789366648.834109:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:2.0:1789366648.834203:0:7614:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751416960 00000100:00100000:2.0:1789366648.834213:0:7614:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751416960 00000100:00100000:2.0:1789366648.834324:0:7614:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 81 00000100:00100000:2.0:1789366648.834335:0:7614:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638b7216300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0ab23baa-a205-44ad-bf17-f7b47295d82b+13:10439:x1876286751416960:12345-192.168.202.23@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1789366648.834383:0:7614:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789366648.834406:0:7614:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9c00/0x8da3486b955f3611 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.23@tcp remote: 0xda917a494d06c084 expref: 13 pid: 7614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366648.834426:0:7614:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9638a7404300) 00010000:00010000:2.0:1789366648.834431:0:7614:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789366648.834458:0:7614:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9000/0x8da3486b955f3626 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7614 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366648.834471:0:7614:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9000/0x8da3486b955f3626 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7614 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366648.836641:0:7614:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9000/0x8da3486b955f3626 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7614 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789366648.836951:0:7614:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000475d51e8 reply state 000000005b447803 transno 4294967355 ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9000/0x8da3486b955f3626 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7614 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789366648.836980:0:7614:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789366648.837101:0:7614:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638b7216300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0ab23baa-a205-44ad-bf17-f7b47295d82b+14:10439:x1876286751416960:12345-192.168.202.23@tcp:36:lhsmtool_posix.0 Request processed in 2763us (2996us total) trans 4294967355 rc 0/0 00000100:00100000:2.0:1789366648.837111:0:7614:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 81 00000100:00100000:2.0:1789366648.839669:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00010000:00010000:3.0:1789366648.839760:0:3270:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9000/0x8da3486b955f3626 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7614 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366648.839775:0:3270:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9000/0x8da3486b955f3626 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7614 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366648.839783:0:3270:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9000/0x8da3486b955f3626 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7614 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366648.839789:0:3270:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9638902c9000 already unused, calling callback (ffffffffc20ee4f0) 00010000:00010000:3.0:1789366648.839794:0:3270:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9000/0x8da3486b955f3626 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7614 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366648.839803:0:3270:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9000/0x8da3486b955f3626 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7614 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366648.839819:0:3270:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9638a7404300) 00010000:00010000:3.0:1789366648.839822:0:3270:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789366648.839827:0:3270:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9000/0x8da3486b955f3626 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7614 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789366648.839827:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751417088 00000100:00100000:0.0:1789366648.839836:0:6659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751417088 00010000:00010000:3.0:1789366648.839851:0:3270:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9000/0x8da3486b955f3626 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7614 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789366648.839918:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 31 00000100:00100000:0.0:1789366648.839928:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638b7353800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0ab23baa-a205-44ad-bf17-f7b47295d82b+6:2356:x1876286751417088:12345-192.168.202.23@tcp:2:lhsmtool_posix.0 00002000:00010000:0.0:1789366648.840185:0:6659:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:0.0:1789366648.840189:0:6659:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb mtime from disk: 1789366649 -> 1789366647 00002000:00010000:0.0:1789366648.840191:0:6659:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb atime from disk: 0 -> 1789366646 00002000:00010000:0.0:1789366648.840193:0:6659:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb ctime from disk: 1789366649 -> 1789366647 00002000:00010000:0.0:1789366648.840195:0:6659:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:0.0:1789366648.840253:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638b7353800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0ab23baa-a205-44ad-bf17-f7b47295d82b+7:2356:x1876286751417088:12345-192.168.202.23@tcp:2:lhsmtool_posix.0 Request processed in 326us (591us total) trans 4294967304 rc 0/0 00000100:00100000:0.0:1789366648.840269:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 31 00000100:00100000:3.0:1789366648.842002:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:0.0:1789366648.842294:0:7132:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751417344 00000100:00100000:0.0:1789366648.842303:0:7132:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751417344 00000100:00100000:0.0:1789366648.842395:0:7132:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 82 00000100:00100000:0.0:1789366648.842406:0:7132:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638b73cdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0ab23baa-a205-44ad-bf17-f7b47295d82b+13:10439:x1876286751417344:12345-192.168.202.23@tcp:55:lhsmtool_posix.0 00010000:00010000:0.0:1789366648.842571:0:7132:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720d600/0x8da3486b955f362d lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366648.842589:0:7132:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9800/0x8da3486b955f35ee lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.23@tcp remote: 0xda917a494d06c076 expref: 13 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366648.842608:0:7132:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720d600/0x8da3486b955f362d lrc: 4/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366648.842655:0:7132:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9800/0x8da3486b955f35ee lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.23@tcp remote: 0xda917a494d06c076 expref: 13 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366648.842669:0:7132:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9800/0x8da3486b955f35ee lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.23@tcp remote: 0xda917a494d06c076 expref: 13 pid: 5817 timeout: 324 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789366648.842683:0:7132:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff963890775c00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7132:1876286758772480:192.168.202.23@tcp:104: 00000100:00100000:0.0:1789366648.842931:0:7132:0:(client.c:2716:ptlrpc_set_wait()) set ffff9638b70ffc00 going to sleep for 11 seconds 00000100:00100000:1.0:1789366648.848584:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:3.0:1789366648.848782:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751417472 00000100:00100000:3.0:1789366648.848791:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751417472 00010000:00010000:3.0:1789366648.848834:0:5801:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9800/0x8da3486b955f35ee lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.23@tcp remote: 0xda917a494d06c076 expref: 14 pid: 5817 timeout: 324 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789366648.848882:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 42 00000100:00100000:3.0:1789366648.848892:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96389861ec50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0ab23baa-a205-44ad-bf17-f7b47295d82b+14:2355:x1876286751417472:12345-192.168.202.23@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789366648.848909:0:5801:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789366648.848916:0:5801:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9800/0x8da3486b955f35ee lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.23@tcp remote: 0xda917a494d06c076 expref: 14 pid: 5817 timeout: 324 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366648.848929:0:5801:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9800/0x8da3486b955f35ee lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.23@tcp remote: 0xda917a494d06c076 expref: 14 pid: 5817 timeout: 324 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366648.848951:0:5801:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9638a7404300) 00010000:00010000:3.0:1789366648.848956:0:5801:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720d600/0x8da3486b955f362d lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366648.848965:0:5801:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720d600/0x8da3486b955f362d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366648.848972:0:5801:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720d600/0x8da3486b955f362d lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366648.849007:0:5801:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789366648.849056:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96389861ec50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0ab23baa-a205-44ad-bf17-f7b47295d82b+14:2355:x1876286751417472:12345-192.168.202.23@tcp:103:ldlm_bl.0 Request processed in 165us (481us total) trans 0 rc 0/0 00000100:00100000:3.0:1789366648.849063:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 42 00010000:00010000:0.0:1789366648.850509:0:7132:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9800/0x8da3486b955f35ee lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.23@tcp remote: 0xda917a494d06c076 expref: 13 pid: 5817 timeout: 324 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789366648.850531:0:7132:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff963890775c00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7132:1876286758772480:192.168.202.23@tcp:104: 00010000:00010000:0.0:1789366648.850569:0:7132:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720d600/0x8da3486b955f362d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366648.850581:0:7132:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720d600/0x8da3486b955f362d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366648.850587:0:7132:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720d600/0x8da3486b955f362d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366648.850858:0:7132:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720d600/0x8da3486b955f362d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366648.850866:0:7132:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720d600/0x8da3486b955f362d lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366648.850873:0:7132:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720d600/0x8da3486b955f362d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366648.850893:0:7132:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9638b720d600 already unused, calling callback (ffffffffc20ee4f0) 00010000:00010000:0.0:1789366648.850898:0:7132:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720d600/0x8da3486b955f362d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366648.850906:0:7132:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720d600/0x8da3486b955f362d lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366648.850920:0:7132:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9638a7404300) 00010000:00010000:0.0:1789366648.850924:0:7132:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:0.0:1789366648.850928:0:7132:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720d600/0x8da3486b955f362d lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366648.850935:0:7132:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720d600/0x8da3486b955f362d lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789366648.851004:0:7132:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638b73cdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0ab23baa-a205-44ad-bf17-f7b47295d82b+12:10439:x1876286751417344:12345-192.168.202.23@tcp:55:lhsmtool_posix.0 Request processed in 8598us (9008us total) trans 0 rc -22/-22 00000100:00100000:0.0:1789366648.851013:0:7132:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 82 00000100:00100000:1.0:1789366648.855822:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:0.0:1789366648.855939:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751417600 00000100:00100000:0.0:1789366648.855950:0:6660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751417600 00000100:00100000:0.0:1789366648.856001:0:6660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 32 00000100:00100000:0.0:1789366648.856011:0:6660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638b7217100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0ab23baa-a205-44ad-bf17-f7b47295d82b+7:2355:x1876286751417600:12345-192.168.202.23@tcp:1:lhsmtool_posix.0 00010000:00010000:0.0:1789366648.856058:0:6660:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000087a2e4dd/0x8da3486b955f3634 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366648.856080:0:6660:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000a1abbe94/0x8da3486b955f361f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.23@tcp remote: 0xda917a494d06c092 expref: 7 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366648.856106:0:6660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789366648.856111:0:6660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789366648.856117:0:6660:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000087a2e4dd/0x8da3486b955f3634 lrc: 4/1,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366648.856153:0:6660:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000a1abbe94/0x8da3486b955f361f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.23@tcp remote: 0xda917a494d06c092 expref: 7 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366648.856167:0:6660:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000a1abbe94/0x8da3486b955f361f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.23@tcp remote: 0xda917a494d06c092 expref: 7 pid: 6660 timeout: 324 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789366648.856183:0:6660:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff963890775c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6660:1876286758772608:192.168.202.23@tcp:104: 00000100:00100000:0.0:1789366648.856287:0:6660:0:(client.c:2716:ptlrpc_set_wait()) set ffff9638b70ffc00 going to sleep for 11 seconds 00000100:00100000:1.0:1789366648.859327:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:2.0:1789366648.859421:0:8419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751417728 00000100:00100000:2.0:1789366648.859430:0:8419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751417728 00010000:00010000:2.0:1789366648.859471:0:8419:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000a1abbe94/0x8da3486b955f361f lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.23@tcp remote: 0xda917a494d06c092 expref: 8 pid: 6660 timeout: 324 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789366648.859526:0:8419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 43 00000100:00100000:2.0:1789366648.859537:0:8419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638b7214380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0ab23baa-a205-44ad-bf17-f7b47295d82b+8:2354:x1876286751417728:12345-192.168.202.23@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789366648.859563:0:8419:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789366648.859590:0:8419:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000a1abbe94/0x8da3486b955f361f lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.23@tcp remote: 0xda917a494d06c092 expref: 8 pid: 6660 timeout: 324 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366648.859608:0:8419:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000a1abbe94/0x8da3486b955f361f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.23@tcp remote: 0xda917a494d06c092 expref: 8 pid: 6660 timeout: 324 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366648.859635:0:8419:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789366648.859639:0:8419:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789366648.859646:0:8419:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000087a2e4dd/0x8da3486b955f3634 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366648.859665:0:8419:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000087a2e4dd/0x8da3486b955f3634 lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366648.859703:0:8419:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789366648.859933:0:8419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638b7214380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0ab23baa-a205-44ad-bf17-f7b47295d82b+8:2354:x1876286751417728:12345-192.168.202.23@tcp:103:ldlm_bl.0 Request processed in 397us (616us total) trans 0 rc 0/0 00000100:00100000:2.0:1789366648.859942:0:8419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 43 00010000:00010000:0.0:1789366648.861096:0:6660:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a1abbe94/0x8da3486b955f361f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.23@tcp remote: 0xda917a494d06c092 expref: 7 pid: 6660 timeout: 324 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789366648.861116:0:6660:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff963890775c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6660:1876286758772608:192.168.202.23@tcp:104: 00010000:00010000:0.0:1789366648.861139:0:6660:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000087a2e4dd/0x8da3486b955f3634 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366648.861151:0:6660:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000087a2e4dd/0x8da3486b955f3634 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366648.861159:0:6660:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000087a2e4dd/0x8da3486b955f3634 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366648.861200:0:6660:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000087a2e4dd/0x8da3486b955f3634 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366648.861209:0:6660:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000087a2e4dd/0x8da3486b955f3634 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366648.861218:0:6660:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000087a2e4dd/0x8da3486b955f3634 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366648.861225:0:6660:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9638b720cc00 already unused, calling callback (ffffffffc16df520) 00010000:00010000:0.0:1789366648.861229:0:6660:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000087a2e4dd/0x8da3486b955f3634 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366648.861239:0:6660:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000087a2e4dd/0x8da3486b955f3634 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366648.861266:0:6660:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000087a2e4dd/0x8da3486b955f3634 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366648.861273:0:6660:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000087a2e4dd/0x8da3486b955f3634 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789366648.861381:0:6660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638b7217100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0ab23baa-a205-44ad-bf17-f7b47295d82b+6:2355:x1876286751417600:12345-192.168.202.23@tcp:1:lhsmtool_posix.0 Request processed in 5371us (5570us total) trans 0 rc 0/0 00000100:00100000:0.0:1789366648.861390:0:6660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 32 00000100:00100000:1.0:1789366648.864889:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:2.0:1789366648.864989:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751417984 00000100:00100000:2.0:1789366648.865000:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751417984 00000100:00100000:2.0:1789366648.865087:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 83 00000100:00100000:2.0:1789366648.865099:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638b7217800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0ab23baa-a205-44ad-bf17-f7b47295d82b+12:10439:x1876286751417984:12345-192.168.202.23@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1789366648.865191:0:5816:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9c00/0x8da3486b955f363b lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366648.865213:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9c00/0x8da3486b955f363b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366648.865226:0:5816:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9c00/0x8da3486b955f363b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366648.865460:0:5816:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9600/0x8da3486b955f3642 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366648.865471:0:5816:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c8200/0x8da3486b955f35fc lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.23@tcp remote: 0xda917a494d06c07d expref: 13 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366648.865491:0:5816:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9600/0x8da3486b955f3642 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366648.865524:0:5816:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c8200/0x8da3486b955f35fc lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.23@tcp remote: 0xda917a494d06c07d expref: 13 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366648.865681:0:5816:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c8200/0x8da3486b955f35fc lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.23@tcp remote: 0xda917a494d06c07d expref: 13 pid: 5815 timeout: 324 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789366648.865699:0:5816:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9638b7352a00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5816:1876286758772736:192.168.202.23@tcp:104: 00000100:00100000:2.0:1789366648.865893:0:5816:0:(client.c:2716:ptlrpc_set_wait()) set ffff9638bf0cb3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789366648.869840:0:5816:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9638b7352a00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5816:1876286758772736:192.168.202.23@tcp:104: 00010000:00010000:2.0:1789366648.869870:0:5816:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9600/0x8da3486b955f3642 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789366648.869967:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:3.0:1789366648.870159:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751418112 00000100:00100000:3.0:1789366648.870167:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751418112 00010000:00010000:3.0:1789366648.870205:0:5801:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c8200/0x8da3486b955f35fc lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.23@tcp remote: 0xda917a494d06c07d expref: 14 pid: 5815 timeout: 324 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789366648.870245:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 44 00000100:00100000:3.0:1789366648.870267:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638b7216a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0ab23baa-a205-44ad-bf17-f7b47295d82b+14:2354:x1876286751418112:12345-192.168.202.23@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789366648.870282:0:5801:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789366648.870289:0:5801:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c8200/0x8da3486b955f35fc lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.23@tcp remote: 0xda917a494d06c07d expref: 14 pid: 5815 timeout: 324 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366648.870299:0:5801:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c8200/0x8da3486b955f35fc lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.23@tcp remote: 0xda917a494d06c07d expref: 14 pid: 5815 timeout: 324 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366648.870318:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c8200/0x8da3486b955f35fc lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.23@tcp remote: 0xda917a494d06c07d expref: 14 pid: 5815 timeout: 324 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366648.870329:0:5801:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9638a7404300) 00010000:00010000:3.0:1789366648.870333:0:5801:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9600/0x8da3486b955f3642 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366648.870340:0:5801:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9600/0x8da3486b955f3642 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366648.870352:0:5801:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9600/0x8da3486b955f3642 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366648.870371:0:5801:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789366648.870394:0:5816:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9600/0x8da3486b955f3642 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366648.870401:0:5816:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9600/0x8da3486b955f3642 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789366648.870422:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638b7216a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0ab23baa-a205-44ad-bf17-f7b47295d82b+13:2354:x1876286751418112:12345-192.168.202.23@tcp:103:ldlm_bl.0 Request processed in 168us (457us total) trans 0 rc 0/0 00000100:00100000:3.0:1789366648.870429:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 44 00000001:00080000:2.0:1789366648.871060:0:5816:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967356 00000001:00080000:2.0:1789366648.871188:0:5816:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967357 00000001:00080000:2.0:1789366648.871225:0:5816:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967358 00000100:00100000:2.0:1789366648.871316:0:5816:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9638b7352a00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5816:1876286758772864:0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1789366648.871358:0:5816:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789366648.871393:0:5816:0:(client.c:2716:ptlrpc_set_wait()) set ffff9638bf0cbd80 going to sleep for 11 seconds 00000100:00100000:1.0:1789366648.871561:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286758772864 00000100:00100000:1.0:1789366648.871566:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286758772864 00000100:00100000:1.0:1789366648.871601:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789366648.871607:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638b7353480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5816:x1876286758772864:12345-0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1789366648.871810:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638b7353480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5816:x1876286758772864:12345-0@lo:1000:mdt00_001.0 Request processed in 202us (450us total) trans 0 rc 0/0 00000100:00100000:1.0:1789366648.871818:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1789366648.872241:0:5816:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967303 gen 2 00000004:00080000:0.0:1789366648.872246:0:5816:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9638b7350380, transno 4294967303 00000100:00100000:0.0:1789366648.872293:0:5816:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9638b7352a00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5816:1876286758772864:0@lo:1000:mdt00_001.0 00000001:00080000:0.0:1789366648.873104:0:5816:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967359 00000100:00100000:0.0:1789366648.873151:0:5816:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff963890775c00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5816:1876286758772992:0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1789366648.873185:0:5816:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789366648.873221:0:5816:0:(client.c:2716:ptlrpc_set_wait()) set ffff9638b70ff9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789366648.873230:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286758772992 00000100:00100000:1.0:1789366648.873235:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286758772992 00000100:00100000:1.0:1789366648.873286:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789366648.873294:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963890776d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5816:x1876286758772992:12345-0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1789366648.873429:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963890776d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5816:x1876286758772992:12345-0@lo:1000:mdt00_001.0 Request processed in 135us (242us total) trans 4294967305 rc 0/0 00000100:00100000:1.0:1789366648.873436:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1789366648.873557:0:5816:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff963890775c00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5816:1876286758772992:0@lo:1000:mdt00_001.0 00010000:00010000:0.0:1789366648.873587:0:5816:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9600/0x8da3486b955f3642 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366648.873597:0:5816:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9600/0x8da3486b955f3642 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366648.873604:0:5816:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9600/0x8da3486b955f3642 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366648.873610:0:5816:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9638902c9600 already unused, calling callback (ffffffffc20ee4f0) 00010000:00010000:0.0:1789366648.873614:0:5816:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9600/0x8da3486b955f3642 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366648.873623:0:5816:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9600/0x8da3486b955f3642 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366648.873637:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9638a7404300) 00010000:00010000:0.0:1789366648.873640:0:5816:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1789366648.873644:0:5816:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9600/0x8da3486b955f3642 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366648.873652:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9600/0x8da3486b955f3642 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366648.873696:0:5816:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720c600/0x8da3486b955f3570 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366648.873702:0:5816:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720c600/0x8da3486b955f3570 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366648.873708:0:5816:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720c600/0x8da3486b955f3570 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366648.873713:0:5816:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9638b720c600 already unused, calling callback (ffffffffc20ee4f0) 00010000:00010000:0.0:1789366648.873808:0:5816:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720c600/0x8da3486b955f3570 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366648.873816:0:5816:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720c600/0x8da3486b955f3570 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366648.873825:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff963890797600) 00010000:00010000:0.0:1789366648.873828:0:5816:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1789366648.873831:0:5816:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720c600/0x8da3486b955f3570 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366648.873837:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720c600/0x8da3486b955f3570 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366648.873885:0:5816:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c8400/0x8da3486b955f3649 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366648.873900:0:5816:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff963880030e00/0x8da3486b955f358c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.23@tcp remote: 0xda917a494d06c061 expref: 16 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366648.873908:0:5816:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c8400/0x8da3486b955f3649 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366648.873938:0:5816:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff963880030e00/0x8da3486b955f358c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.23@tcp remote: 0xda917a494d06c061 expref: 16 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366648.873948:0:5816:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff963880030e00/0x8da3486b955f358c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.23@tcp remote: 0xda917a494d06c061 expref: 16 pid: 5817 timeout: 324 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789366648.873956:0:5816:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9638b7350380 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5816:1876286758773120:192.168.202.23@tcp:104: 00000100:00100000:2.0:1789366648.874013:0:5816:0:(client.c:2716:ptlrpc_set_wait()) set ffff963891fd2b40 going to sleep for 11 seconds 00000100:00100000:1.0:1789366648.876111:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:2.0:1789366648.876200:0:5816:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9638b7350380 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5816:1876286758773120:192.168.202.23@tcp:104: 00010000:00010000:2.0:1789366648.876225:0:5816:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c8400/0x8da3486b955f3649 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789366648.876245:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751418240 00000100:00100000:3.0:1789366648.876252:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751418240 00010000:00010000:3.0:1789366648.876295:0:5803:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff963880030e00/0x8da3486b955f358c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.23@tcp remote: 0xda917a494d06c061 expref: 17 pid: 5817 timeout: 324 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789366648.876331:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 45 00000100:00100000:3.0:1789366648.876341:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638b7217480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0ab23baa-a205-44ad-bf17-f7b47295d82b+17:2354:x1876286751418240:12345-192.168.202.23@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789366648.876353:0:5803:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789366648.876364:0:5803:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff963880030e00/0x8da3486b955f358c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.23@tcp remote: 0xda917a494d06c061 expref: 17 pid: 5817 timeout: 324 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366648.876376:0:5803:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff963880030e00/0x8da3486b955f358c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.23@tcp remote: 0xda917a494d06c061 expref: 17 pid: 5817 timeout: 324 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366648.876397:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff963880030e00/0x8da3486b955f358c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.23@tcp remote: 0xda917a494d06c061 expref: 17 pid: 5817 timeout: 324 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366648.876413:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff963890797600) 00010000:00010000:3.0:1789366648.876418:0:5803:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c8400/0x8da3486b955f3649 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366648.876444:0:5803:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c8400/0x8da3486b955f3649 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366648.876451:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c8400/0x8da3486b955f3649 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366648.876791:0:5803:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789366648.876806:0:5816:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c8400/0x8da3486b955f3649 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366648.876813:0:5816:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c8400/0x8da3486b955f3649 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366648.876824:0:5816:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c8400/0x8da3486b955f3649 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366648.876830:0:5816:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c8400/0x8da3486b955f3649 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789366648.876832:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638b7217480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0ab23baa-a205-44ad-bf17-f7b47295d82b+16:2354:x1876286751418240:12345-192.168.202.23@tcp:103:ldlm_bl.0 Request processed in 493us (728us total) trans 0 rc 0/0 00010000:00010000:2.0:1789366648.876837:0:5816:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c8400/0x8da3486b955f3649 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789366648.876839:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 45 00010000:00010000:2.0:1789366648.876843:0:5816:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9638902c8400 already unused, calling callback (ffffffffc20ee4f0) 00010000:00010000:2.0:1789366648.876847:0:5816:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c8400/0x8da3486b955f3649 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366648.876861:0:5816:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c8400/0x8da3486b955f3649 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366648.876871:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff963890797600) 00010000:00010000:2.0:1789366648.876874:0:5816:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789366648.876877:0:5816:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c8400/0x8da3486b955f3649 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366648.876881:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c8400/0x8da3486b955f3649 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366648.876888:0:5816:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9c00/0x8da3486b955f363b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366648.876891:0:5816:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9c00/0x8da3486b955f363b lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366648.876895:0:5816:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9c00/0x8da3486b955f363b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366648.876898:0:5816:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9638902c9c00 already unused, calling callback (ffffffffc20ee4f0) 00010000:00010000:2.0:1789366648.876900:0:5816:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9c00/0x8da3486b955f363b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366648.876903:0:5816:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9c00/0x8da3486b955f363b lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366648.876907:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff963890797600) 00010000:00010000:2.0:1789366648.876908:0:5816:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1789366648.876909:0:5816:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9c00/0x8da3486b955f363b lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366648.876921:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9c00/0x8da3486b955f363b lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789366648.877087:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638b7217800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0ab23baa-a205-44ad-bf17-f7b47295d82b+15:10439:x1876286751417984:12345-192.168.202.23@tcp:57:lhsmtool_posix.0 Request processed in 11990us (12209us total) trans 4294967360 rc 0/0 00000100:00100000:2.0:1789366648.877094:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 83 00000020:00080000:2.0:1789366648.877097:0:5816:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:3.0:1789366648.877163:0:11650:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1789366648.877167:0:11650:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1789366648.877193:0:11650:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:3.0:1789366648.877208:0:11650:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1789366648.878997:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:0.0:1789366648.879278:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751418496 00000100:00100000:0.0:1789366648.879288:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751418496 00000100:00100000:0.0:1789366648.879341:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 20 00000100:00100000:0.0:1789366648.879362:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638b73cc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0ab23baa-a205-44ad-bf17-f7b47295d82b+15:10439:x1876286751418496:12345-192.168.202.23@tcp:35:lhsmtool_posix.0 00000004:00080000:0.0:1789366648.879992:0:5819:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x6:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:0.0:1789366648.880096:0:5819:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967361 00010000:00010000:0.0:1789366648.880143:0:5819:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720cc00/0x8da3486b955f3650 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366648.880159:0:5819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720cc00/0x8da3486b955f3650 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366648.880170:0:5819:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720cc00/0x8da3486b955f3650 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366648.880177:0:5819:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720cc00/0x8da3486b955f3650 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366648.880180:0:5819:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720cc00/0x8da3486b955f3650 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366648.880184:0:5819:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720cc00/0x8da3486b955f3650 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366648.880199:0:5819:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789366648.880217:0:5805:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789366648.880224:0:5805:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720cc00/0x8da3486b955f3650 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366648.880230:0:5805:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9638b720cc00 already unused, calling callback (ffffffffc16df520) 00010000:00010000:3.0:1789366648.880234:0:5805:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720cc00/0x8da3486b955f3650 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366648.880241:0:5805:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720cc00/0x8da3486b955f3650 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366648.880265:0:5805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff963890797500) 00010000:00010000:3.0:1789366648.880268:0:5805:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1789366648.880274:0:5805:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720cc00/0x8da3486b955f3650 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366648.880286:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720cc00/0x8da3486b955f3650 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789366648.880302:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638b73cc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0ab23baa-a205-44ad-bf17-f7b47295d82b+17:10439:x1876286751418496:12345-192.168.202.23@tcp:35:lhsmtool_posix.0 Request processed in 941us (1320us total) trans 4294967362 rc 0/0 00010000:00010000:3.0:1789366648.880305:0:5805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789366648.880307:0:5805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789366648.880308:0:5805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789366648.880311:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 20 00000020:00080000:0.0:1789366648.880316:0:5819:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1789366648.888064:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789366649.911941:0:6675:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1789366650.106443:0:12013:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1789366650.106456:0:12013:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1789366650.106496:0:12013:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:3.0:1789366650.106501:0:12013:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1789366650.297448:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9638b7350380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3284:1876286758773248:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789366650.297682:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789366650.297772:0:6662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286758773248 00000100:00100000:0.0:1789366650.297782:0:6662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286758773248 00000100:00100000:0.0:1789366650.297850:0:6662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1789366650.297860:0:6662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638b7214000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3284:x1876286758773248:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789366650.297884:0:6662:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3856662528 00000100:00100000:0.0:1789366650.297941:0:6662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638b7214000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3284:x1876286758773248:12345-0@lo:13:osp-pre-0-0.0 Request processed in 83us (260us total) trans 0 rc 0/0 00000100:00100000:0.0:1789366650.297949:0:6662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00080000:2.0:1789366650.298156:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789366650.298361:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9638b7350380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3284:1876286758773248:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789366650.299521:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:2.0:1789366650.299571:0:7614:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751418752 00000100:00100000:2.0:1789366650.299577:0:7614:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751418752 00000100:00100000:2.0:1789366650.299646:0:7614:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 84 00000100:00100000:2.0:1789366650.299655:0:7614:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638b7215f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0ab23baa-a205-44ad-bf17-f7b47295d82b+17:10457:x1876286751418752:12345-192.168.202.23@tcp:101:lfs.0 00010000:00010000:2.0:1789366650.299681:0:7614:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789366650.299703:0:7614:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c8c00/0x8da3486b955f3657 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xda917a494d06c099 expref: -99 pid: 7614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366650.299816:0:7614:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c8600/0x8da3486b955f365e lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7614 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366650.299831:0:7614:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c8600/0x8da3486b955f365e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7614 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366650.299990:0:7614:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c8600/0x8da3486b955f365e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7614 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789366650.300004:0:7614:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:2.0:1789366650.300129:0:7614:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c8c00/0x8da3486b955f3657 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.23@tcp remote: 0xda917a494d06c099 expref: 20 pid: 7614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366650.300156:0:7614:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c8600/0x8da3486b955f365e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.23@tcp remote: 0xda917a494d06c099 expref: 19 pid: 7614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366650.300164:0:7614:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff963890797000) 00010000:00010000:2.0:1789366650.300167:0:7614:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1789366650.300181:0:7614:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9638902c8600, rc 0) 00000100:00100000:2.0:1789366650.300232:0:7614:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638b7215f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0ab23baa-a205-44ad-bf17-f7b47295d82b+19:10457:x1876286751418752:12345-192.168.202.23@tcp:101:lfs.0 Request processed in 578us (716us total) trans 4294967363 rc 0/0 00000100:00100000:2.0:1789366650.300239:0:7614:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 84 00000100:00080000:0.0:1789366650.300659:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789366650.306209:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:2.0:1789366650.307501:0:7132:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751418880 00000100:00100000:2.0:1789366650.307514:0:7132:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751418880 00000100:00100000:2.0:1789366650.307568:0:7132:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 85 00000100:00100000:2.0:1789366650.307579:0:7132:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638b7217b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0ab23baa-a205-44ad-bf17-f7b47295d82b+19:10457:x1876286751418880:12345-192.168.202.23@tcp:34:lfs.0 00010000:00010000:2.0:1789366650.307656:0:7132:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9200/0x8da3486b955f366c lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366650.307675:0:7132:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9200/0x8da3486b955f366c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366650.307687:0:7132:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9200/0x8da3486b955f366c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366650.307702:0:7132:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c8e00/0x8da3486b955f3673 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366650.307709:0:7132:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c8e00/0x8da3486b955f3673 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366650.307752:0:7132:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c8e00/0x8da3486b955f3673 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366650.308004:0:7132:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c8800/0x8da3486b955f367a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366650.308014:0:7132:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c8800/0x8da3486b955f367a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366650.308022:0:7132:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c8800/0x8da3486b955f367a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789366650.308060:0:7132:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c8800/0x8da3486b955f367a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366650.308072:0:7132:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9200/0x8da3486b955f366c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366650.308078:0:7132:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9200/0x8da3486b955f366c lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366650.308085:0:7132:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9200/0x8da3486b955f366c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366650.308090:0:7132:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9638902c9200 already unused, calling callback (ffffffffc20ee4f0) 00010000:00010000:2.0:1789366650.308095:0:7132:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9200/0x8da3486b955f366c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366650.308101:0:7132:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9200/0x8da3486b955f366c lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366650.308113:0:7132:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff963890797000) 00010000:00010000:2.0:1789366650.308121:0:7132:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789366650.308126:0:7132:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9200/0x8da3486b955f366c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366650.308132:0:7132:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9200/0x8da3486b955f366c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366650.308147:0:7132:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c8e00/0x8da3486b955f3673 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366650.308152:0:7132:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c8e00/0x8da3486b955f3673 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366650.308158:0:7132:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c8e00/0x8da3486b955f3673 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366650.308163:0:7132:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9638902c8e00 already unused, calling callback (ffffffffc20ee4f0) 00010000:00010000:2.0:1789366650.308165:0:7132:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c8e00/0x8da3486b955f3673 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366650.308170:0:7132:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c8e00/0x8da3486b955f3673 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366650.308178:0:7132:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9638a7404000) 00010000:00010000:2.0:1789366650.308180:0:7132:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789366650.308182:0:7132:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c8e00/0x8da3486b955f3673 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366650.308187:0:7132:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c8e00/0x8da3486b955f3673 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366650.308202:0:7132:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c8800/0x8da3486b955f367a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366650.308214:0:7132:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c8800/0x8da3486b955f367a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366650.308219:0:7132:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c8800/0x8da3486b955f367a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366650.308225:0:7132:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9638902c8800 already unused, calling callback (ffffffffc20ee4f0) 00010000:00010000:2.0:1789366650.308227:0:7132:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c8800/0x8da3486b955f367a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366650.308233:0:7132:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c8800/0x8da3486b955f367a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366650.308475:0:7132:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9638a7404e00) 00010000:00010000:2.0:1789366650.308479:0:7132:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789366650.308483:0:7132:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c8800/0x8da3486b955f367a lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366650.308489:0:7132:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c8800/0x8da3486b955f367a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789366650.308585:0:7132:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638b7217b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0ab23baa-a205-44ad-bf17-f7b47295d82b+19:10457:x1876286751418880:12345-192.168.202.23@tcp:34:lfs.0 Request processed in 1007us (2385us total) trans 0 rc 0/0 00000100:00100000:2.0:1789366650.308594:0:7132:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 85 00000100:00100000:1.0:1789366650.335111:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:3.0:1789366650.335171:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751419136 00000100:00100000:3.0:1789366650.335181:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751419136 00000100:00100000:3.0:1789366650.335232:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 86 00000100:00100000:3.0:1789366650.335249:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638b7215880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0ab23baa-a205-44ad-bf17-f7b47295d82b+19:10460:x1876286751419136:12345-192.168.202.23@tcp:101:lfs.0 00010000:00010000:3.0:1789366650.335268:0:5816:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789366650.335288:0:5816:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9638832d3600/0x8da3486b955f3681 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xda917a494d06c0a0 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366650.335355:0:5816:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9638832d3a00/0x8da3486b955f3688 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366650.335370:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9638832d3a00/0x8da3486b955f3688 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366650.335382:0:5816:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9638832d3a00/0x8da3486b955f3688 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366650.335406:0:5816:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9638832d3400/0x8da3486b955f368f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366650.335420:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9638832d3400/0x8da3486b955f368f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366650.335428:0:5816:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9638832d3400/0x8da3486b955f368f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366650.335647:0:5816:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9638832d3c00/0x8da3486b955f3696 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366650.335656:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9638832d3c00/0x8da3486b955f3696 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366650.335663:0:5816:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9638832d3c00/0x8da3486b955f3696 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789366650.335673:0:5816:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 9 00010000:00010000:3.0:1789366650.335783:0:5816:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9638832d3a00/0x8da3486b955f3688 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366650.335791:0:5816:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9638832d3a00/0x8da3486b955f3688 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366650.335798:0:5816:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9638832d3a00/0x8da3486b955f3688 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366650.335803:0:5816:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9638832d3a00 already unused, calling callback (ffffffffc20ee4f0) 00010000:00010000:3.0:1789366650.335808:0:5816:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9638832d3a00/0x8da3486b955f3688 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366650.335815:0:5816:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9638832d3a00/0x8da3486b955f3688 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366650.335836:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff963890797000) 00010000:00010000:3.0:1789366650.335839:0:5816:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789366650.335844:0:5816:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9638832d3a00/0x8da3486b955f3688 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366650.335850:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9638832d3a00/0x8da3486b955f3688 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366650.335860:0:5816:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9638832d3400/0x8da3486b955f368f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366650.335865:0:5816:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9638832d3400/0x8da3486b955f368f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366650.335871:0:5816:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9638832d3400/0x8da3486b955f368f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366650.335877:0:5816:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9638832d3400 already unused, calling callback (ffffffffc20ee4f0) 00010000:00010000:3.0:1789366650.335880:0:5816:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9638832d3400/0x8da3486b955f368f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366650.335886:0:5816:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9638832d3400/0x8da3486b955f368f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366650.336193:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff96388c43f500) 00010000:00010000:3.0:1789366650.336196:0:5816:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789366650.336199:0:5816:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9638832d3400/0x8da3486b955f368f lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366650.336204:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9638832d3400/0x8da3486b955f368f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366650.336266:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9638832d3600/0x8da3486b955f3681 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.23@tcp remote: 0xda917a494d06c0a0 expref: 22 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366650.336279:0:5816:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9638832d3c00/0x8da3486b955f3696 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.23@tcp remote: 0xda917a494d06c0a0 expref: 21 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366650.336286:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff96388c43f000) 00010000:00010000:3.0:1789366650.336288:0:5816:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789366650.336290:0:5816:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9638832d3c00, rc 0) 00000100:00100000:3.0:1789366650.336398:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638b7215880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0ab23baa-a205-44ad-bf17-f7b47295d82b+21:10460:x1876286751419136:12345-192.168.202.23@tcp:101:lfs.0 Request processed in 1145us (1283us total) trans 4294967364 rc 0/0 00000100:00100000:3.0:1789366650.336406:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 86 00000100:00100000:3.0:1789366650.361388:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:2.0:1789366650.361431:0:7614:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751419264 00000100:00100000:2.0:1789366650.361442:0:7614:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751419264 00000100:00100000:2.0:1789366650.361498:0:7614:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 87 00000100:00100000:2.0:1789366650.361512:0:7614:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638b73cc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0ab23baa-a205-44ad-bf17-f7b47295d82b+21:10460:x1876286751419264:12345-192.168.202.23@tcp:54:lfs.0 00010000:00010000:2.0:1789366650.361654:0:7614:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c8800/0x8da3486b955f36a4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7614 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366650.361677:0:7614:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c8800/0x8da3486b955f36a4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7614 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366650.361695:0:7614:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c8800/0x8da3486b955f36a4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7614 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366650.361744:0:7614:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c8800/0x8da3486b955f36a4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7614 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366650.361751:0:7614:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c8800/0x8da3486b955f36a4 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7614 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366650.361759:0:7614:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c8800/0x8da3486b955f36a4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7614 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366650.361765:0:7614:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9638902c8800 already unused, calling callback (ffffffffc20ee4f0) 00010000:00010000:2.0:1789366650.361770:0:7614:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c8800/0x8da3486b955f36a4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7614 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366650.361777:0:7614:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c8800/0x8da3486b955f36a4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7614 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366650.361788:0:7614:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff96388c43f000) 00010000:00010000:2.0:1789366650.361791:0:7614:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789366650.361796:0:7614:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c8800/0x8da3486b955f36a4 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7614 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366650.361803:0:7614:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c8800/0x8da3486b955f36a4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7614 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789366650.361874:0:7614:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638b73cc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0ab23baa-a205-44ad-bf17-f7b47295d82b+21:10460:x1876286751419264:12345-192.168.202.23@tcp:54:lfs.0 Request processed in 361us (496us total) trans 0 rc 0/0 00000100:00100000:2.0:1789366650.361888:0:7614:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 87 00000100:00100000:1.0:1789366650.374569:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:2.0:1789366650.374627:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751419520 00000100:00100000:2.0:1789366650.374638:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751419520 00000100:00100000:2.0:1789366650.374700:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 21 00000100:00100000:2.0:1789366650.374710:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963888cbbc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0ab23baa-a205-44ad-bf17-f7b47295d82b+21:10460:x1876286751419520:12345-192.168.202.23@tcp:35:lfs.0 00000100:00100000:2.0:1789366650.375376:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963888cbbc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0ab23baa-a205-44ad-bf17-f7b47295d82b+22:10460:x1876286751419520:12345-192.168.202.23@tcp:35:lfs.0 Request processed in 664us (814us total) trans 4294967365 rc 0/0 00000100:00100000:2.0:1789366650.375385:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 21 00000100:00100000:1.0:1789366650.395085:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:2.0:1789366650.395191:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751419776 00000100:00100000:2.0:1789366650.395202:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751419776 00000100:00100000:2.0:1789366650.395305:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 88 00000100:00100000:2.0:1789366650.395315:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638b7214700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0ab23baa-a205-44ad-bf17-f7b47295d82b+22:9980:x1876286751419776:12345-192.168.202.23@tcp:101:bash.0 00010000:00010000:2.0:1789366650.395338:0:5815:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789366650.395360:0:5815:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c8800/0x8da3486b955f36ab lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xda917a494d06c0a7 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366650.395484:0:5815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c8e00/0x8da3486b955f36b2 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366650.395498:0:5815:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9638832d3c00/0x8da3486b955f3696 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.23@tcp remote: 0xda917a494d06c0a0 expref: 23 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366650.395508:0:5815:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c8e00/0x8da3486b955f36b2 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366650.395544:0:5815:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9638832d3c00/0x8da3486b955f3696 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.23@tcp remote: 0xda917a494d06c0a0 expref: 23 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366650.395567:0:5815:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9638832d3c00/0x8da3486b955f3696 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.23@tcp remote: 0xda917a494d06c0a0 expref: 23 pid: 5816 timeout: 325 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789366650.395591:0:5815:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9638b7350380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5815:1876286758773376:192.168.202.23@tcp:104: 00000100:00100000:2.0:1789366650.399129:0:5815:0:(client.c:2716:ptlrpc_set_wait()) set ffff963882ec9c00 going to sleep for 11 seconds 00000100:00100000:3.0:1789366650.401117:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:2.0:1789366650.401216:0:5815:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9638b7350380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5815:1876286758773376:192.168.202.23@tcp:104: 00010000:00010000:2.0:1789366650.401256:0:5815:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c8e00/0x8da3486b955f36b2 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789366650.401495:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751419904 00000100:00100000:0.0:1789366650.401502:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751419904 00010000:00010000:0.0:1789366650.401534:0:5802:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9638832d3c00/0x8da3486b955f3696 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.23@tcp remote: 0xda917a494d06c0a0 expref: 24 pid: 5816 timeout: 325 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789366650.401609:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 46 00000100:00100000:0.0:1789366650.401619:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638b73ce680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0ab23baa-a205-44ad-bf17-f7b47295d82b+24:2355:x1876286751419904:12345-192.168.202.23@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789366650.401633:0:5802:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789366650.401640:0:5802:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9638832d3c00/0x8da3486b955f3696 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.23@tcp remote: 0xda917a494d06c0a0 expref: 24 pid: 5816 timeout: 325 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366650.401649:0:5802:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9638832d3c00/0x8da3486b955f3696 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.23@tcp remote: 0xda917a494d06c0a0 expref: 24 pid: 5816 timeout: 325 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366650.401680:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9638832d3c00/0x8da3486b955f3696 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.23@tcp remote: 0xda917a494d06c0a0 expref: 24 pid: 5816 timeout: 325 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366650.401696:0:5802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff96388c43f000) 00010000:00010000:0.0:1789366650.401700:0:5802:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c8e00/0x8da3486b955f36b2 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366650.401708:0:5802:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c8e00/0x8da3486b955f36b2 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366650.401713:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c8e00/0x8da3486b955f36b2 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366650.401753:0:5802:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789366650.401792:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638b73ce680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0ab23baa-a205-44ad-bf17-f7b47295d82b+23:2355:x1876286751419904:12345-192.168.202.23@tcp:103:ldlm_bl.0 Request processed in 176us (684us total) trans 0 rc 0/0 00000100:00100000:0.0:1789366650.401807:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 46 00010000:00010000:2.0:1789366650.401913:0:5815:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c8e00/0x8da3486b955f36b2 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366650.401919:0:5815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c8e00/0x8da3486b955f36b2 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789366650.401934:0:5815:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 9 00010000:00010000:2.0:1789366650.402081:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c8800/0x8da3486b955f36ab lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.23@tcp remote: 0xda917a494d06c0a7 expref: 24 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366650.402093:0:5815:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c8e00/0x8da3486b955f36b2 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.23@tcp remote: 0xda917a494d06c0a7 expref: 23 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366650.402098:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff96388c43f000) 00010000:00010000:2.0:1789366650.402100:0:5815:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1789366650.402102:0:5815:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9638902c8e00, rc 0) 00000100:00100000:2.0:1789366650.402138:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638b7214700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0ab23baa-a205-44ad-bf17-f7b47295d82b+23:9980:x1876286751419776:12345-192.168.202.23@tcp:101:bash.0 Request processed in 6825us (7064us total) trans 4294967366 rc 0/0 00000100:00100000:2.0:1789366650.402154:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 88 00000100:00100000:3.0:1789366650.404625:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:2.0:1789366650.404958:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751420160 00000100:00100000:2.0:1789366650.404968:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751420160 00000100:00100000:2.0:1789366650.405050:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 89 00000100:00100000:2.0:1789366650.405060:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638b73cc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0ab23baa-a205-44ad-bf17-f7b47295d82b+23:9980:x1876286751420160:12345-192.168.202.23@tcp:36:bash.0 00010000:00010000:2.0:1789366650.405337:0:5816:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9200/0x8da3486b955f36c0 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366650.405352:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9200/0x8da3486b955f36c0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366650.405364:0:5816:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9200/0x8da3486b955f36c0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789366650.405413:0:5816:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967367 00000004:00010000:2.0:1789366650.405430:0:5816:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000032dc58de reply state 00000000a2283e3c transno 4294967368 ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9200/0x8da3486b955f36c0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789366650.405437:0:5816:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:2.0:1789366650.405466:0:5816:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967368 00000100:00100000:2.0:1789366650.405553:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638b73cc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0ab23baa-a205-44ad-bf17-f7b47295d82b+27:9980:x1876286751420160:12345-192.168.202.23@tcp:36:bash.0 Request processed in 493us (934us total) trans 4294967369 rc 0/0 00000100:00100000:2.0:1789366650.405561:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 89 00000020:00080000:2.0:1789366650.405567:0:5816:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00010000:00010000:0.0:1789366650.407062:0:3271:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9200/0x8da3486b955f36c0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366650.407086:0:3271:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9200/0x8da3486b955f36c0 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366650.407094:0:3271:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9200/0x8da3486b955f36c0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366650.407100:0:3271:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9638902c9200 already unused, calling callback (ffffffffc20ee4f0) 00010000:00010000:0.0:1789366650.407106:0:3271:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9200/0x8da3486b955f36c0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366650.407113:0:3271:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9200/0x8da3486b955f36c0 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366650.407128:0:3271:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff96388c43f000) 00010000:00010000:0.0:1789366650.407131:0:3271:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789366650.407268:0:3271:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9200/0x8da3486b955f36c0 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366650.407278:0:3271:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9200/0x8da3486b955f36c0 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789366650.407546:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:1.0:1789366650.407587:0:7614:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751420288 00000100:00100000:1.0:1789366650.407593:0:7614:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751420288 00000100:00100000:1.0:1789366650.407640:0:7614:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 90 00000100:00100000:1.0:1789366650.407664:0:7614:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963785f28380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0ab23baa-a205-44ad-bf17-f7b47295d82b+26:9980:x1876286751420288:12345-192.168.202.23@tcp:101:bash.0 00010000:00010000:1.0:1789366650.407685:0:7614:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789366650.407710:0:7614:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9638b6ce3c00/0x8da3486b955f36c7 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xda917a494d06c0ae expref: -99 pid: 7614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366650.407786:0:7614:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9638b6ce3c00/0x8da3486b955f36c7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.23@tcp remote: 0xda917a494d06c0ae expref: 27 pid: 7614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366650.407813:0:7614:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9638b6ce3c00/0x8da3486b955f36c7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.23@tcp remote: 0xda917a494d06c0ae expref: 27 pid: 7614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366650.407830:0:7614:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff96388c43f000) 00010000:00010000:1.0:1789366650.407832:0:7614:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789366650.407834:0:7614:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9638b6ce3c00, rc 0) 00000100:00100000:1.0:1789366650.407871:0:7614:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963785f28380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0ab23baa-a205-44ad-bf17-f7b47295d82b+27:9980:x1876286751420288:12345-192.168.202.23@tcp:101:bash.0 Request processed in 212us (328us total) trans 0 rc 0/0 00000100:00100000:1.0:1789366650.407879:0:7614:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 90 00000100:00100000:1.0:1789366650.411641:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:2.0:1789366650.411695:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751420416 00000100:00100000:2.0:1789366650.411705:0:6661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751420416 00000100:00100000:2.0:1789366650.411927:0:6661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 33 00000100:00100000:2.0:1789366650.411938:0:6661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638b7216d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0ab23baa-a205-44ad-bf17-f7b47295d82b+6:9980:x1876286751420416:12345-192.168.202.23@tcp:101:bash.0 00010000:00010000:2.0:1789366650.411955:0:6661:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789366650.411987:0:6661:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000066014cc1/0x8da3486b955f36ce lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda917a494d06c0b5 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789366650.412012:0:6661:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x3:0x0] initial LVB size: 9, mtime: 0x6aa79177, atime: 0x6aa79176, ctime: 0x6aa79177, blocks: 0xb 00010000:00010000:2.0:1789366650.412041:0:6661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=225s v=(0 0) 00010000:00010000:2.0:1789366650.412046:0:6661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789366650.412054:0:6661:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000066014cc1/0x8da3486b955f36ce lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.202.23@tcp remote: 0xda917a494d06c0b5 expref: 7 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366650.412078:0:6661:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000066014cc1/0x8da3486b955f36ce lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.202.23@tcp remote: 0xda917a494d06c0b5 expref: 7 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366650.412092:0:6661:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9638902c8c00, rc 0) 00000100:00100000:2.0:1789366650.412156:0:6661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638b7216d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0ab23baa-a205-44ad-bf17-f7b47295d82b+7:9980:x1876286751420416:12345-192.168.202.23@tcp:101:bash.0 Request processed in 220us (523us total) trans 0 rc 0/0 00000100:00100000:2.0:1789366650.412165:0:6661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 33 00000100:00080000:0.0:1789366650.412401:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789366650.414180:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:0.0:1789366650.414318:0:6664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751420544 00000100:00100000:0.0:1789366650.414326:0:6664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751420544 00002000:00010000:0.0:1789366650.414360:0:6664:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/3 (0->18446744073709551615) 00002000:00100000:0.0:1789366650.414365:0:6664:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9638bfeca680 with x1876286751420544 ext(0->18446744073709551615) 00002000:00010000:0.0:1789366650.414375:0:6664:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9638bfeca680. 00000100:00100000:0.0:1789366650.414417:0:6664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 1 00000100:00100000:0.0:1789366650.414427:0:6664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638bfeca680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0ab23baa-a205-44ad-bf17-f7b47295d82b+7:2354:x1876286751420544:12345-192.168.202.23@tcp:10:bash.0 00002000:00010000:0.0:1789366650.414685:0:6664:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:0.0:1789366650.414689:0:6664:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb mtime from disk: 1789366647 -> 1789366650 00002000:00010000:0.0:1789366650.414692:0:6664:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb atime from disk: 1789366646 -> 1789366646 00002000:00010000:0.0:1789366650.414693:0:6664:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb ctime from disk: 1789366647 -> 1789366650 00002000:00010000:0.0:1789366650.414695:0:6664:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb blocks from disk: 11 -> 11 00000100:00100000:0.0:1789366650.414774:0:6664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638bfeca680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0ab23baa-a205-44ad-bf17-f7b47295d82b+8:2354:x1876286751420544:12345-192.168.202.23@tcp:10:bash.0 Request processed in 348us (600us total) trans 4294967306 rc 0/0 00000100:00100000:0.0:1789366650.414781:0:6664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 1 00002000:00010000:0.0:1789366650.414784:0:6664:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/3 (0->18446744073709551615) 00002000:00100000:0.0:1789366650.414787:0:6664:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9638bfeca680 with x1876286751420544 ext(0->18446744073709551615) 00002000:00010000:0.0:1789366650.414791:0:6664:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9638bfeca680. 00000100:00100000:3.0:1789366650.481110:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:2.0:1789366650.481183:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751420672 00000100:00100000:2.0:1789366650.481194:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751420672 00000100:00100000:2.0:1789366650.481275:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 91 00000100:00100000:2.0:1789366650.481285:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638bfec9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0ab23baa-a205-44ad-bf17-f7b47295d82b+27:10474:x1876286751420672:12345-192.168.202.23@tcp:34:lfs.0 00010000:00010000:2.0:1789366650.481358:0:5815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c8800/0x8da3486b955f36d5 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366650.481376:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c8800/0x8da3486b955f36d5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366650.481389:0:5815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c8800/0x8da3486b955f36d5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366650.481424:0:5815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c8000/0x8da3486b955f36dc lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366650.481432:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c8000/0x8da3486b955f36dc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366650.481438:0:5815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c8000/0x8da3486b955f36dc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366650.481670:0:5815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9400/0x8da3486b955f36e3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366650.481680:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9400/0x8da3486b955f36e3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366650.481688:0:5815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9400/0x8da3486b955f36e3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789366650.481764:0:5815:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9400/0x8da3486b955f36e3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366650.481777:0:5815:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c8800/0x8da3486b955f36d5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366650.481783:0:5815:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c8800/0x8da3486b955f36d5 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366650.481791:0:5815:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c8800/0x8da3486b955f36d5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366650.481797:0:5815:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9638902c8800 already unused, calling callback (ffffffffc20ee4f0) 00010000:00010000:2.0:1789366650.481801:0:5815:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c8800/0x8da3486b955f36d5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366650.481815:0:5815:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c8800/0x8da3486b955f36d5 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366650.481827:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff963890797000) 00010000:00010000:2.0:1789366650.481829:0:5815:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789366650.481834:0:5815:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c8800/0x8da3486b955f36d5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366650.481841:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c8800/0x8da3486b955f36d5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366650.481853:0:5815:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c8000/0x8da3486b955f36dc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366650.481858:0:5815:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c8000/0x8da3486b955f36dc lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366650.481863:0:5815:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c8000/0x8da3486b955f36dc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366650.481868:0:5815:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9638902c8000 already unused, calling callback (ffffffffc20ee4f0) 00010000:00010000:2.0:1789366650.481871:0:5815:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c8000/0x8da3486b955f36dc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366650.481877:0:5815:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c8000/0x8da3486b955f36dc lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366650.481884:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9638a7404600) 00010000:00010000:2.0:1789366650.481886:0:5815:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789366650.481889:0:5815:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c8000/0x8da3486b955f36dc lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366650.481904:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c8000/0x8da3486b955f36dc lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366650.481919:0:5815:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9400/0x8da3486b955f36e3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366650.481925:0:5815:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9400/0x8da3486b955f36e3 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366650.481931:0:5815:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9400/0x8da3486b955f36e3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366650.481936:0:5815:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9638902c9400 already unused, calling callback (ffffffffc20ee4f0) 00010000:00010000:2.0:1789366650.481939:0:5815:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9400/0x8da3486b955f36e3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366650.481945:0:5815:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9400/0x8da3486b955f36e3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366650.481953:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff96388c43f000) 00010000:00010000:2.0:1789366650.481955:0:5815:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789366650.481958:0:5815:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9400/0x8da3486b955f36e3 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366650.481963:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9400/0x8da3486b955f36e3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789366650.482135:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638bfec9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0ab23baa-a205-44ad-bf17-f7b47295d82b+27:10474:x1876286751420672:12345-192.168.202.23@tcp:34:lfs.0 Request processed in 850us (1033us total) trans 0 rc 0/0 00000100:00100000:2.0:1789366650.482144:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 91 00000100:00100000:1.0:1789366650.559303:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:2.0:1789366650.567831:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751420928 00000100:00100000:2.0:1789366650.567848:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751420928 00000100:00100000:2.0:1789366650.567928:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 92 00000100:00100000:2.0:1789366650.567939:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638b7214a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0ab23baa-a205-44ad-bf17-f7b47295d82b+27:10477:x1876286751420928:12345-192.168.202.23@tcp:101:lfs.0 00010000:00010000:2.0:1789366650.567960:0:5816:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789366650.567982:0:5816:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9400/0x8da3486b955f36ea lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xda917a494d06c0bc expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366650.568061:0:5816:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c8000/0x8da3486b955f36f1 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366650.568078:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c8000/0x8da3486b955f36f1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366650.568092:0:5816:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c8000/0x8da3486b955f36f1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366650.568119:0:5816:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c8800/0x8da3486b955f36f8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366650.568127:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c8800/0x8da3486b955f36f8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366650.568134:0:5816:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c8800/0x8da3486b955f36f8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366650.571019:0:5816:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9e00/0x8da3486b955f36ff lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366650.571034:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9e00/0x8da3486b955f36ff lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366650.571056:0:5816:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9e00/0x8da3486b955f36ff lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789366650.571068:0:5816:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:2.0:1789366650.571160:0:5816:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c8000/0x8da3486b955f36f1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366650.571168:0:5816:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c8000/0x8da3486b955f36f1 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366650.571175:0:5816:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c8000/0x8da3486b955f36f1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366650.571182:0:5816:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9638902c8000 already unused, calling callback (ffffffffc20ee4f0) 00010000:00010000:2.0:1789366650.571186:0:5816:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c8000/0x8da3486b955f36f1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366650.571194:0:5816:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c8000/0x8da3486b955f36f1 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366650.571206:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff963890797000) 00010000:00010000:2.0:1789366650.571209:0:5816:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789366650.571213:0:5816:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c8000/0x8da3486b955f36f1 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366650.571219:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c8000/0x8da3486b955f36f1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366650.571230:0:5816:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c8800/0x8da3486b955f36f8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366650.571236:0:5816:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c8800/0x8da3486b955f36f8 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366650.571302:0:5816:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c8800/0x8da3486b955f36f8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366650.571307:0:5816:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9638902c8800 already unused, calling callback (ffffffffc20ee4f0) 00010000:00010000:2.0:1789366650.571310:0:5816:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c8800/0x8da3486b955f36f8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366650.571317:0:5816:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c8800/0x8da3486b955f36f8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366650.571325:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9638a7404600) 00010000:00010000:2.0:1789366650.571327:0:5816:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789366650.571330:0:5816:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c8800/0x8da3486b955f36f8 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366650.571336:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c8800/0x8da3486b955f36f8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366650.571384:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9400/0x8da3486b955f36ea lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.23@tcp remote: 0xda917a494d06c0bc expref: 30 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366650.571399:0:5816:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9e00/0x8da3486b955f36ff lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.23@tcp remote: 0xda917a494d06c0bc expref: 29 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366650.571405:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff96388c43f000) 00010000:00010000:2.0:1789366650.571407:0:5816:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1789366650.571409:0:5816:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9638902c9e00, rc 0) 00000100:00100000:2.0:1789366650.571484:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638b7214a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0ab23baa-a205-44ad-bf17-f7b47295d82b+29:10477:x1876286751420928:12345-192.168.202.23@tcp:101:lfs.0 Request processed in 3547us (12193us total) trans 4294967370 rc 0/0 00000100:00100000:2.0:1789366650.571500:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 92 00000100:00100000:3.0:1789366650.578943:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:1.0:1789366650.579007:0:7614:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751421056 00000100:00100000:1.0:1789366650.579017:0:7614:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751421056 00000100:00100000:1.0:1789366650.579162:0:7614:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 93 00000100:00100000:1.0:1789366650.579173:0:7614:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638b70cdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0ab23baa-a205-44ad-bf17-f7b47295d82b+29:10477:x1876286751421056:12345-192.168.202.23@tcp:54:lfs.0 00010000:00010000:1.0:1789366650.579254:0:7614:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9638b6ce2600/0x8da3486b955f370d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7614 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366650.579272:0:7614:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c8e00/0x8da3486b955f36b2 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.23@tcp remote: 0xda917a494d06c0a7 expref: 29 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366650.579295:0:7614:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9638b6ce2600/0x8da3486b955f370d lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7614 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366650.579332:0:7614:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c8e00/0x8da3486b955f36b2 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.23@tcp remote: 0xda917a494d06c0a7 expref: 29 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366650.579347:0:7614:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c8e00/0x8da3486b955f36b2 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.23@tcp remote: 0xda917a494d06c0a7 expref: 29 pid: 5815 timeout: 326 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789366650.579361:0:7614:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9638b7216680 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:7614:1876286758773504:192.168.202.23@tcp:104: 00000100:00100000:1.0:1789366650.579451:0:7614:0:(client.c:2716:ptlrpc_set_wait()) set ffff96388a34d540 going to sleep for 11 seconds 00000100:00100000:3.0:1789366650.585402:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:0.0:1789366650.585470:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751421312 00000100:00100000:0.0:1789366650.585479:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751421312 00000100:00100000:0.0:1789366650.585604:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 22 00000100:00100000:0.0:1789366650.585623:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638b73f8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0ab23baa-a205-44ad-bf17-f7b47295d82b+30:5581:x1876286751421312:12345-192.168.202.23@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1789366650.585707:0:7614:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9638b7216680 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:7614:1876286758773504:192.168.202.23@tcp:104: 00000100:00100000:0.0:1789366650.585967:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638b73f8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0ab23baa-a205-44ad-bf17-f7b47295d82b+31:5581:x1876286751421312:12345-192.168.202.23@tcp:35:ldlm_bl.0 Request processed in 353us (575us total) trans 4294967371 rc 0/0 00000100:00100000:0.0:1789366650.585975:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 22 00010000:00010000:1.0:1789366650.586363:0:7614:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9638b6ce2600/0x8da3486b955f370d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7614 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789366650.590701:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:2.0:1789366650.590771:0:8419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751421440 00000100:00100000:2.0:1789366650.590779:0:8419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751421440 00010000:00010000:2.0:1789366650.590822:0:8419:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c8e00/0x8da3486b955f36b2 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.23@tcp remote: 0xda917a494d06c0a7 expref: 31 pid: 5815 timeout: 326 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789366650.590861:0:8419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 47 00000100:00100000:2.0:1789366650.590869:0:8419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638b73f9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0ab23baa-a205-44ad-bf17-f7b47295d82b+31:2354:x1876286751421440:12345-192.168.202.23@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789366650.590881:0:8419:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789366650.590887:0:8419:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c8e00/0x8da3486b955f36b2 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.23@tcp remote: 0xda917a494d06c0a7 expref: 31 pid: 5815 timeout: 326 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366650.590897:0:8419:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c8e00/0x8da3486b955f36b2 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.23@tcp remote: 0xda917a494d06c0a7 expref: 31 pid: 5815 timeout: 326 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366650.590914:0:8419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c8e00/0x8da3486b955f36b2 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.23@tcp remote: 0xda917a494d06c0a7 expref: 31 pid: 5815 timeout: 326 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366650.590926:0:8419:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff96388c43f000) 00010000:00010000:2.0:1789366650.590931:0:8419:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9638b6ce2600/0x8da3486b955f370d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7614 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366650.590938:0:8419:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9638b6ce2600/0x8da3486b955f370d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 7614 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366650.590943:0:8419:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9638b6ce2600/0x8da3486b955f370d lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 7614 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366650.590984:0:8419:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789366650.591026:0:8419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638b73f9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0ab23baa-a205-44ad-bf17-f7b47295d82b+30:2354:x1876286751421440:12345-192.168.202.23@tcp:103:ldlm_bl.0 Request processed in 158us (937us total) trans 0 rc 0/0 00000100:00100000:2.0:1789366650.591031:0:8419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 47 00010000:00010000:1.0:1789366650.591098:0:7614:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9638b6ce2600/0x8da3486b955f370d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7614 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366650.591107:0:7614:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9638b6ce2600/0x8da3486b955f370d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7614 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366650.591137:0:7614:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9638b6ce2600/0x8da3486b955f370d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7614 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366650.591144:0:7614:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9638b6ce2600/0x8da3486b955f370d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7614 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366650.591151:0:7614:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9638b6ce2600/0x8da3486b955f370d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7614 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366650.591163:0:7614:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9638b6ce2600 already unused, calling callback (ffffffffc20ee4f0) 00010000:00010000:1.0:1789366650.591166:0:7614:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9638b6ce2600/0x8da3486b955f370d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7614 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366650.591173:0:7614:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9638b6ce2600/0x8da3486b955f370d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7614 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366650.591182:0:7614:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff96388c43f000) 00010000:00010000:1.0:1789366650.591184:0:7614:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1789366650.591188:0:7614:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9638b6ce2600/0x8da3486b955f370d lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7614 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366650.591193:0:7614:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9638b6ce2600/0x8da3486b955f370d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7614 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789366650.591232:0:7614:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638b70cdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0ab23baa-a205-44ad-bf17-f7b47295d82b+29:10477:x1876286751421056:12345-192.168.202.23@tcp:54:lfs.0 Request processed in 12061us (12300us total) trans 0 rc 0/0 00000100:00100000:1.0:1789366650.591256:0:7614:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 93 00000100:00100000:3.0:1789366650.598871:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:2.0:1789366650.598952:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751421696 00000100:00100000:2.0:1789366650.598962:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751421696 00000100:00100000:2.0:1789366650.599024:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 23 00000100:00100000:2.0:1789366650.599032:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638b4f18a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0ab23baa-a205-44ad-bf17-f7b47295d82b+29:10477:x1876286751421696:12345-192.168.202.23@tcp:35:lfs.0 00000100:00100000:2.0:1789366650.599276:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638b4f18a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0ab23baa-a205-44ad-bf17-f7b47295d82b+30:10477:x1876286751421696:12345-192.168.202.23@tcp:35:lfs.0 Request processed in 244us (412us total) trans 4294967372 rc 0/0 00000100:00100000:2.0:1789366650.599282:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 23 00000100:00100000:3.0:1789366650.686832:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:2.0:1789366650.686925:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751421952 00000100:00100000:2.0:1789366650.686937:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751421952 00000100:00100000:2.0:1789366650.686997:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 94 00000100:00100000:2.0:1789366650.687005:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638b6cbca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0ab23baa-a205-44ad-bf17-f7b47295d82b+30:10488:x1876286751421952:12345-192.168.202.23@tcp:101:cat.0 00010000:00010000:2.0:1789366650.687026:0:5815:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789366650.687044:0:5815:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c8e00/0x8da3486b955f3714 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xda917a494d06c0c3 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366650.687120:0:5815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9400/0x8da3486b955f371b lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366650.687135:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9400/0x8da3486b955f371b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366650.687378:0:5815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9400/0x8da3486b955f371b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366650.687412:0:5815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c8800/0x8da3486b955f3722 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366650.687420:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c8800/0x8da3486b955f3722 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366650.687426:0:5815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c8800/0x8da3486b955f3722 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366650.687701:0:5815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c8000/0x8da3486b955f3729 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366650.687712:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c8000/0x8da3486b955f3729 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366650.687774:0:5815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c8000/0x8da3486b955f3729 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789366650.687786:0:5815:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 8 00010000:00010000:2.0:1789366650.687878:0:5815:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9400/0x8da3486b955f371b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366650.687886:0:5815:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9400/0x8da3486b955f371b lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366650.687893:0:5815:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9400/0x8da3486b955f371b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366650.687899:0:5815:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9638902c9400 already unused, calling callback (ffffffffc20ee4f0) 00010000:00010000:2.0:1789366650.687905:0:5815:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9400/0x8da3486b955f371b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366650.687922:0:5815:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9400/0x8da3486b955f371b lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366650.687934:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff963890797000) 00010000:00010000:2.0:1789366650.687936:0:5815:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789366650.687942:0:5815:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9400/0x8da3486b955f371b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366650.687948:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9400/0x8da3486b955f371b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366650.687961:0:5815:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c8800/0x8da3486b955f3722 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366650.688083:0:5815:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c8800/0x8da3486b955f3722 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366650.688089:0:5815:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c8800/0x8da3486b955f3722 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366650.688094:0:5815:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9638902c8800 already unused, calling callback (ffffffffc20ee4f0) 00010000:00010000:2.0:1789366650.688268:0:5815:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c8800/0x8da3486b955f3722 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366650.688276:0:5815:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c8800/0x8da3486b955f3722 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366650.688285:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9638a7404600) 00010000:00010000:2.0:1789366650.688287:0:5815:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789366650.688291:0:5815:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c8800/0x8da3486b955f3722 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366650.688306:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c8800/0x8da3486b955f3722 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366650.688351:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c8e00/0x8da3486b955f3714 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.23@tcp remote: 0xda917a494d06c0c3 expref: 33 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366650.688364:0:5815:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c8000/0x8da3486b955f3729 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.23@tcp remote: 0xda917a494d06c0c3 expref: 32 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366650.688371:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff96388c43f000) 00010000:00010000:2.0:1789366650.688373:0:5815:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789366650.688375:0:5815:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9638902c8000, rc 0) 00000100:00100000:2.0:1789366650.688496:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638b6cbca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0ab23baa-a205-44ad-bf17-f7b47295d82b+32:10488:x1876286751421952:12345-192.168.202.23@tcp:101:cat.0 Request processed in 1489us (1673us total) trans 4294967373 rc 0/0 00000100:00100000:2.0:1789366650.688504:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 94 00000100:00100000:3.0:1789366650.692955:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:0.0:1789366650.697945:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751422208 00000100:00100000:0.0:1789366650.697960:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751422208 00000100:00100000:0.0:1789366650.698026:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 24 00000100:00100000:0.0:1789366650.698037:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638b6cbe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0ab23baa-a205-44ad-bf17-f7b47295d82b+32:10488:x1876286751422208:12345-192.168.202.23@tcp:35:cat.0 00000100:00100000:0.0:1789366650.698934:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638b6cbe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0ab23baa-a205-44ad-bf17-f7b47295d82b+33:10488:x1876286751422208:12345-192.168.202.23@tcp:35:cat.0 Request processed in 898us (5985us total) trans 4294967374 rc 0/0 00000100:00100000:0.0:1789366650.698957:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 24 00000100:00100000:3.0:1789366650.738645:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:2.0:1789366650.746487:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751422464 00000100:00100000:2.0:1789366650.746504:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751422464 00000100:00100000:2.0:1789366650.746777:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 95 00000100:00100000:2.0:1789366650.746803:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638b6cbf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0ab23baa-a205-44ad-bf17-f7b47295d82b+33:10489:x1876286751422464:12345-192.168.202.23@tcp:36:rm.0 00010000:00010000:2.0:1789366650.746871:0:5816:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1789366650.746897:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c8000/0x8da3486b955f3729 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.23@tcp remote: 0xda917a494d06c0c3 expref: 33 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366650.746921:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9e00/0x8da3486b955f36ff lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.23@tcp remote: 0xda917a494d06c0bc expref: 32 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366650.746957:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9638b6ce3c00/0x8da3486b955f36c7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.23@tcp remote: 0xda917a494d06c0ae expref: 31 pid: 7614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366650.746978:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff96388c43f000) 00010000:00010000:2.0:1789366650.746990:0:5816:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789366650.747010:0:5816:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c8e00/0x8da3486b955f3737 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366650.747023:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c8e00/0x8da3486b955f3737 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366650.747033:0:5816:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c8e00/0x8da3486b955f3737 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366650.747047:0:5816:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c8800/0x8da3486b955f373e lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366650.747053:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c8800/0x8da3486b955f373e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366650.747059:0:5816:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c8800/0x8da3486b955f373e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366650.747314:0:5816:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9400/0x8da3486b955f3745 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366650.747323:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9400/0x8da3486b955f3745 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366650.747329:0:5816:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9400/0x8da3486b955f3745 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1789366650.749270:0:5816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].4, 64 off8472 00000004:00080000:2.0:1789366650.749484:0:5816:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 226213764992ns, next at 227213760727ns, rc = 0 00010000:00010000:2.0:1789366650.749560:0:5816:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9200/0x8da3486b955f374c lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366650.749574:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9200/0x8da3486b955f374c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366650.749651:0:5816:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9200/0x8da3486b955f374c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366650.749749:0:5816:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9200/0x8da3486b955f374c lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366650.749756:0:5816:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9200/0x8da3486b955f374c lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366650.749763:0:5816:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9200/0x8da3486b955f374c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366650.749783:0:5816:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789366650.749865:0:5816:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9400/0x8da3486b955f3745 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366650.749873:0:5816:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9400/0x8da3486b955f3745 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366650.749879:0:5816:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9400/0x8da3486b955f3745 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366650.749884:0:5816:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9638902c9400 already unused, calling callback (ffffffffc20ee4f0) 00010000:00010000:2.0:1789366650.749896:0:5816:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9400/0x8da3486b955f3745 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366650.749905:0:5816:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9400/0x8da3486b955f3745 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366650.749916:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9638a7404700) 00010000:00010000:2.0:1789366650.749918:0:5816:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1789366650.749923:0:5816:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9400/0x8da3486b955f3745 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366650.749930:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9400/0x8da3486b955f3745 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366650.749950:0:5816:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c8e00/0x8da3486b955f3737 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366650.749957:0:5816:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c8e00/0x8da3486b955f3737 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366650.749962:0:5816:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c8e00/0x8da3486b955f3737 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366650.750117:0:5816:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9638902c8e00 already unused, calling callback (ffffffffc20ee4f0) 00010000:00010000:2.0:1789366650.750120:0:5816:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c8e00/0x8da3486b955f3737 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366650.750126:0:5816:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c8e00/0x8da3486b955f3737 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366650.750134:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff963890797000) 00010000:00010000:2.0:1789366650.750136:0:5816:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789366650.750146:0:5816:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c8e00/0x8da3486b955f3737 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366650.750152:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c8e00/0x8da3486b955f3737 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789366650.750162:0:5816:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000056c7fe82 reply state 0000000084910624 transno 4294967375 ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c8800/0x8da3486b955f373e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789366650.750170:0:5816:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1789366650.750330:0:5805:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789366650.750337:0:5805:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9200/0x8da3486b955f374c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366650.750344:0:5805:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9638902c9200 already unused, calling callback (ffffffffc16df520) 00010000:00010000:1.0:1789366650.750347:0:5805:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9200/0x8da3486b955f374c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366650.750353:0:5805:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9200/0x8da3486b955f374c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366650.750362:0:5805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9638a7404700) 00010000:00010000:1.0:1789366650.750371:0:5805:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1789366650.750376:0:5805:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9200/0x8da3486b955f374c lrc: 1/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366650.750382:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9200/0x8da3486b955f374c lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366650.750416:0:5805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789366650.750418:0:5805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789366650.750420:0:5805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789366650.750485:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638b6cbf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0ab23baa-a205-44ad-bf17-f7b47295d82b+32:10489:x1876286751422464:12345-192.168.202.23@tcp:36:rm.0 Request processed in 3694us (11847us total) trans 4294967375 rc 0/0 00000100:00100000:2.0:1789366650.750493:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 95 00010000:00010000:1.0:1789366650.754656:0:3270:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c8800/0x8da3486b955f373e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366650.754675:0:3270:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c8800/0x8da3486b955f373e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366650.754683:0:3270:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c8800/0x8da3486b955f373e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366650.754689:0:3270:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9638902c8800 already unused, calling callback (ffffffffc20ee4f0) 00010000:00010000:1.0:1789366650.754694:0:3270:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c8800/0x8da3486b955f373e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366650.754703:0:3270:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c8800/0x8da3486b955f373e lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366650.754818:0:3270:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9638a7404600) 00010000:00010000:1.0:1789366650.754822:0:3270:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789366650.754827:0:3270:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c8800/0x8da3486b955f373e lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366650.754835:0:3270:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c8800/0x8da3486b955f373e lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789366650.813235:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:1.0:1789366650.813834:0:7614:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751422720 00000100:00100000:1.0:1789366650.813846:0:7614:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751422720 00000100:00100000:1.0:1789366650.813908:0:7614:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 96 00000100:00100000:1.0:1789366650.813918:0:7614:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638b6cbf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0ab23baa-a205-44ad-bf17-f7b47295d82b+31:10495:x1876286751422720:12345-192.168.202.23@tcp:101:bash.0 00010000:00010000:1.0:1789366650.813944:0:7614:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789366650.813975:0:7614:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9638b6ce2600/0x8da3486b955f3753 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xda917a494d06c0ca expref: -99 pid: 7614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366650.814096:0:7614:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9638b6ce3600/0x8da3486b955f375a lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7614 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366650.814113:0:7614:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9638b6ce3600/0x8da3486b955f375a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7614 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366650.814125:0:7614:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9638b6ce3600/0x8da3486b955f375a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7614 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366650.814140:0:7614:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9638b6ce2a00/0x8da3486b955f3761 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7614 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366650.814148:0:7614:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9638b6ce2a00/0x8da3486b955f3761 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7614 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366650.814154:0:7614:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9638b6ce2a00/0x8da3486b955f3761 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7614 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1789366650.815169:0:7614:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x3:0x0], index 1: 0 00010000:00010000:1.0:1789366650.815353:0:7614:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9638b6ce3800/0x8da3486b955f3768 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7614 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366650.815374:0:7614:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9638b6ce3800/0x8da3486b955f3768 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7614 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366650.815384:0:7614:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9638b6ce3800/0x8da3486b955f3768 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7614 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366650.815682:0:7614:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9638b6ce3600/0x8da3486b955f375a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7614 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366650.815690:0:7614:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9638b6ce3600/0x8da3486b955f375a lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7614 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366650.815697:0:7614:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9638b6ce3600/0x8da3486b955f375a lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7614 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366650.815703:0:7614:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9638b6ce3600 already unused, calling callback (ffffffffc20ee4f0) 00010000:00010000:1.0:1789366650.815707:0:7614:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9638b6ce3600/0x8da3486b955f375a lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7614 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366650.815715:0:7614:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9638b6ce3600/0x8da3486b955f375a lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7614 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366650.815752:0:7614:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff963890797000) 00010000:00010000:1.0:1789366650.815755:0:7614:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789366650.815760:0:7614:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9638b6ce3600/0x8da3486b955f375a lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7614 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366650.815767:0:7614:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9638b6ce3600/0x8da3486b955f375a lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7614 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789366650.815781:0:7614:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000003703c84d reply state 000000000a35dea5 transno 4294967376 ns: mdt-lustre-MDT0000_UUID lock: ffff9638b6ce2a00/0x8da3486b955f3761 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7614 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789366650.816037:0:7614:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1789366650.816071:0:7614:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9638b6ce2600/0x8da3486b955f3753 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.23@tcp remote: 0xda917a494d06c0ca expref: 34 pid: 7614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366650.816087:0:7614:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9638b6ce3800/0x8da3486b955f3768 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.23@tcp remote: 0xda917a494d06c0ca expref: 33 pid: 7614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366650.816094:0:7614:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff963887f88100) 00010000:00010000:1.0:1789366650.816096:0:7614:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789366650.816098:0:7614:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9638b6ce3800, rc 0) 00000100:00100000:1.0:1789366650.816175:0:7614:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638b6cbf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0ab23baa-a205-44ad-bf17-f7b47295d82b+34:10495:x1876286751422720:12345-192.168.202.23@tcp:101:bash.0 Request processed in 2259us (2950us total) trans 4294967376 rc 0/0 00000100:00100000:1.0:1789366650.816184:0:7614:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 96 00010000:00010000:0.0:1789366650.818704:0:3271:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9638b6ce2a00/0x8da3486b955f3761 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7614 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366650.818750:0:3271:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9638b6ce2a00/0x8da3486b955f3761 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7614 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366650.818759:0:3271:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9638b6ce2a00/0x8da3486b955f3761 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7614 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366650.818765:0:3271:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9638b6ce2a00 already unused, calling callback (ffffffffc20ee4f0) 00010000:00010000:0.0:1789366650.818769:0:3271:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9638b6ce2a00/0x8da3486b955f3761 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7614 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366650.818777:0:3271:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9638b6ce2a00/0x8da3486b955f3761 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7614 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366650.818803:0:3271:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff963887f88800) 00010000:00010000:0.0:1789366650.818806:0:3271:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789366650.818811:0:3271:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9638b6ce2a00/0x8da3486b955f3761 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7614 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366650.818817:0:3271:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9638b6ce2a00/0x8da3486b955f3761 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7614 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789366650.822482:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:2.0:1789366650.822834:0:8065:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751422848 00000100:00100000:2.0:1789366650.822845:0:8065:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751422848 00000100:00100000:2.0:1789366650.822917:0:8065:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 34 00000100:00100000:2.0:1789366650.822928:0:8065:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638b7216680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0ab23baa-a205-44ad-bf17-f7b47295d82b+7:2356:x1876286751422848:12345-192.168.202.23@tcp:101:bash.0 00010000:00010000:2.0:1789366650.822946:0:8065:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789366650.822980:0:8065:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000057441913/0x8da3486b955f3776 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda917a494d06c0d1 expref: -99 pid: 8065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789366650.823010:0:8065:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789366650.823032:0:8065:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=226s v=(0 0) 00010000:00010000:2.0:1789366650.823036:0:8065:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789366650.823046:0:8065:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000057441913/0x8da3486b955f3776 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.23@tcp remote: 0xda917a494d06c0d1 expref: 8 pid: 8065 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366650.823069:0:8065:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000057441913/0x8da3486b955f3776 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.23@tcp remote: 0xda917a494d06c0d1 expref: 8 pid: 8065 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366650.823104:0:8065:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9638902c8e00, rc 0) 00000100:00100000:2.0:1789366650.823166:0:8065:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638b7216680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0ab23baa-a205-44ad-bf17-f7b47295d82b+8:2356:x1876286751422848:12345-192.168.202.23@tcp:101:bash.0 Request processed in 240us (695us total) trans 0 rc 0/0 00000100:00100000:2.0:1789366650.823174:0:8065:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 34 00000100:00080000:0.0:1789366650.824160:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789366650.831588:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:1.0:1789366650.831681:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751422976 00000100:00100000:1.0:1789366650.831690:0:6659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751422976 00000100:00100000:1.0:1789366650.831773:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 35 00000100:00100000:1.0:1789366650.831784:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638b6cbea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0ab23baa-a205-44ad-bf17-f7b47295d82b+8:10495:x1876286751422976:12345-192.168.202.23@tcp:101:bash.0 00010000:00010000:1.0:1789366650.831812:0:6659:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789366650.831831:0:6659:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000096f5b236/0x8da3486b955f377d lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda917a494d06c0d8 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366650.831863:0:6659:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000057441913/0x8da3486b955f3776 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.23@tcp remote: 0xda917a494d06c0d1 expref: 9 pid: 8065 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366650.831873:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789366650.831889:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789366650.831896:0:6659:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000096f5b236/0x8da3486b955f377d lrc: 4/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.23@tcp remote: 0xda917a494d06c0d8 expref: 9 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366650.831929:0:6659:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000057441913/0x8da3486b955f3776 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.23@tcp remote: 0xda917a494d06c0d1 expref: 9 pid: 8065 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366650.831944:0:6659:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000057441913/0x8da3486b955f3776 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.23@tcp remote: 0xda917a494d06c0d1 expref: 9 pid: 8065 timeout: 326 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789366650.831959:0:6659:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9638b7215c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6659:1876286758773632:192.168.202.23@tcp:104: 00000100:00100000:1.0:1789366650.832304:0:6659:0:(client.c:2716:ptlrpc_set_wait()) set ffff96388a34d540 going to sleep for 11 seconds 00000100:00100000:3.0:1789366650.836772:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:1.0:1789366650.837284:0:6659:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9638b7215c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6659:1876286758773632:192.168.202.23@tcp:104: 00010000:00010000:1.0:1789366650.837321:0:6659:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000096f5b236/0x8da3486b955f377d lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.23@tcp remote: 0xda917a494d06c0d8 expref: 9 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366650.837346:0:6659:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9638b6ce2600, rc 0) 00000100:00100000:1.0:1789366650.837423:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638b6cbea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0ab23baa-a205-44ad-bf17-f7b47295d82b+9:10495:x1876286751422976:12345-192.168.202.23@tcp:101:bash.0 Request processed in 5640us (5854us total) trans 0 rc 0/0 00000100:00100000:1.0:1789366650.837432:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 35 00000100:00100000:0.0:1789366650.840951:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751423104 00000100:00100000:0.0:1789366650.840979:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751423104 00010000:00010000:0.0:1789366650.841031:0:5801:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000057441913/0x8da3486b955f3776 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.23@tcp remote: 0xda917a494d06c0d1 expref: 9 pid: 8065 timeout: 326 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789366650.841172:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 48 00000100:00100000:0.0:1789366650.841185:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638c1e6f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0ab23baa-a205-44ad-bf17-f7b47295d82b+9:2354:x1876286751423104:12345-192.168.202.23@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789366650.841203:0:5801:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789366650.841229:0:5801:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000057441913/0x8da3486b955f3776 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.23@tcp remote: 0xda917a494d06c0d1 expref: 9 pid: 8065 timeout: 326 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366650.841253:0:5801:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000057441913/0x8da3486b955f3776 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.23@tcp remote: 0xda917a494d06c0d1 expref: 9 pid: 8065 timeout: 326 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366650.841279:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000057441913/0x8da3486b955f3776 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.23@tcp remote: 0xda917a494d06c0d1 expref: 9 pid: 8065 timeout: 326 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366650.841297:0:5801:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789366650.841302:0:5801:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789366650.841310:0:5801:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000096f5b236/0x8da3486b955f377d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.23@tcp remote: 0xda917a494d06c0d8 expref: 8 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366650.841320:0:5801:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000096f5b236/0x8da3486b955f377d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.23@tcp remote: 0xda917a494d06c0d8 expref: 8 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366650.841376:0:5801:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 0000000096f5b236/0x8da3486b955f377d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.23@tcp remote: 0xda917a494d06c0d8 expref: 8 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789366650.841403:0:5801:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9638a74c8700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5801:1876286758773760:192.168.202.23@tcp:105: 00000100:00100000:0.0:1789366650.841502:0:5801:0:(client.c:2716:ptlrpc_set_wait()) set ffff9638b70ff900 going to sleep for 11 seconds 00000100:00100000:0.0:1789366650.847222:0:5801:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9638a74c8700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5801:1876286758773760:192.168.202.23@tcp:105: 00010000:00010000:0.0:1789366650.847259:0:5801:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789366650.847317:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638c1e6f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0ab23baa-a205-44ad-bf17-f7b47295d82b+8:2354:x1876286751423104:12345-192.168.202.23@tcp:103:ldlm_bl.0 Request processed in 6134us (10554us total) trans 0 rc 0/0 00000100:00100000:0.0:1789366650.847329:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 48 00000100:00100000:3.0:1789366650.850703:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:0.0:1789366650.852524:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751423360 00000100:00100000:0.0:1789366650.852537:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751423360 00000100:00100000:0.0:1789366650.852650:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 25 00000100:00100000:0.0:1789366650.852661:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638c1e6ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0ab23baa-a205-44ad-bf17-f7b47295d82b+33:10495:x1876286751423360:12345-192.168.202.23@tcp:35:bash.0 00000100:00100000:2.0:1789366650.855198:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638c1e6ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0ab23baa-a205-44ad-bf17-f7b47295d82b+34:10495:x1876286751423360:12345-192.168.202.23@tcp:35:bash.0 Request processed in 2529us (4493us total) trans 4294967377 rc 0/0 00000100:00100000:2.0:1789366650.855211:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 25 00010000:00010000:3.0:1789366650.935897:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789366651.019812:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:2.0:1789366651.020212:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751423488 00000100:00100000:2.0:1789366651.020223:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751423488 00000100:00100000:2.0:1789366651.020315:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 97 00000100:00100000:2.0:1789366651.020326:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638c1e6dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0ab23baa-a205-44ad-bf17-f7b47295d82b+34:10511:x1876286751423488:12345-192.168.202.23@tcp:101:lfs.0 00010000:00010000:2.0:1789366651.020349:0:5815:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789366651.020370:0:5815:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9400/0x8da3486b955f3784 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xda917a494d06c0df expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366651.020438:0:5815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9e00/0x8da3486b955f378b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366651.020453:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9e00/0x8da3486b955f378b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366651.020464:0:5815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9e00/0x8da3486b955f378b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789366651.020498:0:5815:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00000004:00200000:2.0:1789366651.020502:0:5815:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1789366651.020539:0:5815:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9e00/0x8da3486b955f378b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366651.020565:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9400/0x8da3486b955f3784 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.23@tcp remote: 0xda917a494d06c0df expref: 36 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366651.020584:0:5815:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9e00/0x8da3486b955f378b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.23@tcp remote: 0xda917a494d06c0df expref: 35 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366651.020593:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff963890797000) 00010000:00010000:2.0:1789366651.020595:0:5815:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789366651.020599:0:5815:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9638902c9e00, rc 0) 00000100:00100000:2.0:1789366651.020808:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638c1e6dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0ab23baa-a205-44ad-bf17-f7b47295d82b+35:10511:x1876286751423488:12345-192.168.202.23@tcp:101:lfs.0 Request processed in 331us (853us total) trans 0 rc 0/0 00000100:00100000:2.0:1789366651.020816:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 97 00000100:00100000:0.0:1789366651.024694:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:2.0:1789366651.024795:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751423744 00000100:00100000:2.0:1789366651.024804:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751423744 00000100:00100000:2.0:1789366651.024860:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 98 00000100:00100000:2.0:1789366651.024870:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638a74c8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0ab23baa-a205-44ad-bf17-f7b47295d82b+35:10511:x1876286751423744:12345-192.168.202.23@tcp:101:lfs.0 00010000:00010000:2.0:1789366651.024889:0:5816:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789366651.024910:0:5816:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c8000/0x8da3486b955f3792 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xda917a494d06c0e6 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366651.025016:0:5816:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c8400/0x8da3486b955f3799 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366651.025029:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c8400/0x8da3486b955f3799 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366651.025060:0:5816:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c8400/0x8da3486b955f3799 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789366651.025071:0:5816:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:2.0:1789366651.025189:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c8000/0x8da3486b955f3792 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.23@tcp remote: 0xda917a494d06c0e6 expref: 38 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366651.025207:0:5816:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c8400/0x8da3486b955f3799 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.23@tcp remote: 0xda917a494d06c0e6 expref: 37 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366651.025216:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff963887f88100) 00010000:00010000:2.0:1789366651.025219:0:5816:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789366651.025223:0:5816:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9638902c8400, rc 0) 00000100:00100000:2.0:1789366651.025287:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638a74c8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0ab23baa-a205-44ad-bf17-f7b47295d82b+37:10511:x1876286751423744:12345-192.168.202.23@tcp:101:lfs.0 Request processed in 420us (602us total) trans 4294967378 rc 0/0 00000100:00100000:2.0:1789366651.025293:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 98 00000100:00100000:3.0:1789366651.028002:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:1.0:1789366651.028112:0:7614:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751424000 00000100:00100000:1.0:1789366651.028120:0:7614:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751424000 00000100:00100000:1.0:1789366651.028164:0:7614:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 99 00000100:00100000:1.0:1789366651.028171:0:7614:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638c1e6e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0ab23baa-a205-44ad-bf17-f7b47295d82b+37:10511:x1876286751424000:12345-192.168.202.23@tcp:101:lfs.0 00010000:00010000:1.0:1789366651.028195:0:7614:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789366651.028218:0:7614:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9638b6ce2200/0x8da3486b955f37a7 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xda917a494d06c0ed expref: -99 pid: 7614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366651.028332:0:7614:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9638b6ce3000/0x8da3486b955f37ae lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7614 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366651.028344:0:7614:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9638b6ce3000/0x8da3486b955f37ae lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7614 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366651.028353:0:7614:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9638b6ce3000/0x8da3486b955f37ae lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7614 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789366651.028362:0:7614:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:1.0:1789366651.028465:0:7614:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9638b6ce2200/0x8da3486b955f37a7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.23@tcp remote: 0xda917a494d06c0ed expref: 40 pid: 7614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366651.028479:0:7614:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9638b6ce3000/0x8da3486b955f37ae lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.23@tcp remote: 0xda917a494d06c0ed expref: 39 pid: 7614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366651.028485:0:7614:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff963887f88100) 00010000:00010000:1.0:1789366651.028488:0:7614:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1789366651.028490:0:7614:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9638b6ce3000, rc 0) 00000100:00100000:1.0:1789366651.028563:0:7614:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638c1e6e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0ab23baa-a205-44ad-bf17-f7b47295d82b+39:10511:x1876286751424000:12345-192.168.202.23@tcp:101:lfs.0 Request processed in 391us (565us total) trans 4294967379 rc 0/0 00000100:00100000:1.0:1789366651.028569:0:7614:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 99 00000100:00100000:1.0:1789366651.032312:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:3.0:1789366651.032390:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751424128 00000100:00100000:3.0:1789366651.032399:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751424128 00000100:00100000:3.0:1789366651.032461:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 6 00000100:00100000:3.0:1789366651.032470:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96389861c450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0ab23baa-a205-44ad-bf17-f7b47295d82b+39:2354:x1876286751424128:12345-192.168.202.23@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789366651.032484:0:5803:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789366651.032507:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c8400/0x8da3486b955f3799 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.23@tcp remote: 0xda917a494d06c0e6 expref: 39 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366651.032525:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff963887f88100) 00010000:00010000:3.0:1789366651.032529:0:5803:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789366651.032586:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96389861c450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0ab23baa-a205-44ad-bf17-f7b47295d82b+38:2354:x1876286751424128:12345-192.168.202.23@tcp:103:ldlm_bl.0 Request processed in 117us (284us total) trans 0 rc 0/0 00000100:00100000:3.0:1789366651.032594:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 6 00000100:00100000:3.0:1789366651.037046:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:2.0:1789366651.037117:0:8065:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751424256 00000100:00100000:2.0:1789366651.037127:0:8065:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751424256 00000100:00100000:2.0:1789366651.037186:0:8065:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 36 00000100:00100000:2.0:1789366651.037197:0:8065:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638c1e6f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0ab23baa-a205-44ad-bf17-f7b47295d82b+8:2355:x1876286751424256:12345-192.168.202.23@tcp:1:lfs.0 00010000:00010000:2.0:1789366651.037252:0:8065:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000059097f2a/0x8da3486b955f37bc lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366651.037272:0:8065:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000096f5b236/0x8da3486b955f377d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.23@tcp remote: 0xda917a494d06c0d8 expref: 8 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366651.037280:0:8065:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789366651.037296:0:8065:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789366651.037301:0:8065:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000059097f2a/0x8da3486b955f37bc lrc: 4/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366651.037335:0:8065:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000096f5b236/0x8da3486b955f377d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.23@tcp remote: 0xda917a494d06c0d8 expref: 8 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366651.037350:0:8065:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000096f5b236/0x8da3486b955f377d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.23@tcp remote: 0xda917a494d06c0d8 expref: 8 pid: 6659 timeout: 326 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789366651.037363:0:8065:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9638b7350380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8065:1876286758773888:192.168.202.23@tcp:104: 00000100:00100000:2.0:1789366651.037451:0:8065:0:(client.c:2716:ptlrpc_set_wait()) set ffff963882ec99c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789366651.039923:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:3.0:1789366651.040004:0:6665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751424384 00000100:00100000:3.0:1789366651.040011:0:6665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751424384 00002000:00100000:3.0:1789366651.040057:0:6665:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x3:0x0] (0->8) req@ffff9638b7215c00 x1876286751424384/t0(0) o4->0ab23baa-a205-44ad-bf17-f7b47295d82b@192.168.202.23@tcp:52/0 lens 504/0 e 0 to 0 dl 1789366662 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789366651.040068:0:6665:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9638b7215c00 with x1876286751424384 ext(0->8) 00010000:00010000:3.0:1789366651.040077:0:6665:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000096f5b236/0x8da3486b955f377d lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.23@tcp remote: 0xda917a494d06c0d8 expref: 9 pid: 6659 timeout: 326 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366651.040111:0:6665:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000096f5b236/0x8da3486b955f377d lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.23@tcp remote: 0xda917a494d06c0d8 expref: 9 pid: 6659 timeout: 326 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789366651.040118:0:6665:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9638b7215c00 00000100:00100000:3.0:1789366651.040149:0:6665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 1 00000100:00100000:3.0:1789366651.040158:0:6665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638b7215c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0ab23baa-a205-44ad-bf17-f7b47295d82b+9:2355:x1876286751424384:12345-192.168.202.23@tcp:4:lfs.0 00000100:00100000:3.0:1789366651.040649:0:6665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638b7215c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0ab23baa-a205-44ad-bf17-f7b47295d82b+11:2355:x1876286751424384:12345-192.168.202.23@tcp:4:lfs.0 Request processed in 486us (728us total) trans 4294967302 rc 0/0 00000100:00100000:3.0:1789366651.040658:0:6665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 1 00002000:00100000:3.0:1789366651.040667:0:6665:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x3:0x0] (0->8) req@ffff9638b7215c00 x1876286751424384/t4294967302(0) o4->0ab23baa-a205-44ad-bf17-f7b47295d82b@192.168.202.23@tcp:52/0 lens 504/448 e 0 to 0 dl 1789366662 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789366651.040675:0:6665:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9638b7215c00 with x1876286751424384 ext(0->8) 00010000:00010000:3.0:1789366651.040682:0:6665:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000096f5b236/0x8da3486b955f377d lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.23@tcp remote: 0xda917a494d06c0d8 expref: 11 pid: 6659 timeout: 326 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366651.040695:0:6665:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000096f5b236/0x8da3486b955f377d lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.23@tcp remote: 0xda917a494d06c0d8 expref: 11 pid: 6659 timeout: 326 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789366651.040703:0:6665:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9638b7215c00 00000100:00100000:2.0:1789366651.041201:0:8065:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9638b7350380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8065:1876286758773888:192.168.202.23@tcp:104: 00010000:00010000:2.0:1789366651.041227:0:8065:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000059097f2a/0x8da3486b955f37bc lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789366651.047476:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:2.0:1789366651.047692:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751424512 00000100:00100000:2.0:1789366651.047702:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751424512 00010000:00010000:2.0:1789366651.047978:0:5802:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000096f5b236/0x8da3486b955f377d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.23@tcp remote: 0xda917a494d06c0d8 expref: 11 pid: 6659 timeout: 326 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789366651.048059:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 49 00000100:00100000:2.0:1789366651.048070:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638c1e6d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0ab23baa-a205-44ad-bf17-f7b47295d82b+11:2354:x1876286751424512:12345-192.168.202.23@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789366651.048085:0:5802:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1789366651.048104:0:5802:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:2.0:1789366651.048107:0:5802:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb mtime from disk: 0 -> 1789366651 00002000:00010000:2.0:1789366651.048121:0:5802:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb atime from disk: 0 -> 1789366651 00002000:00010000:2.0:1789366651.048123:0:5802:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb ctime from disk: 0 -> 1789366651 00010000:00010000:2.0:1789366651.048130:0:5802:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000096f5b236/0x8da3486b955f377d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.23@tcp remote: 0xda917a494d06c0d8 expref: 11 pid: 6659 timeout: 326 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366651.048145:0:5802:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000096f5b236/0x8da3486b955f377d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.23@tcp remote: 0xda917a494d06c0d8 expref: 11 pid: 6659 timeout: 326 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366651.048168:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000096f5b236/0x8da3486b955f377d lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.23@tcp remote: 0xda917a494d06c0d8 expref: 11 pid: 6659 timeout: 326 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366651.048184:0:5802:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789366651.048189:0:5802:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789366651.048195:0:5802:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000059097f2a/0x8da3486b955f37bc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366651.048205:0:5802:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000059097f2a/0x8da3486b955f37bc lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366651.048250:0:5802:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789366651.048303:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638c1e6d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0ab23baa-a205-44ad-bf17-f7b47295d82b+10:2354:x1876286751424512:12345-192.168.202.23@tcp:103:ldlm_bl.0 Request processed in 234us (922us total) trans 0 rc 0/0 00000100:00100000:2.0:1789366651.048310:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 49 00010000:00010000:3.0:1789366651.048374:0:8065:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000059097f2a/0x8da3486b955f37bc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366651.048384:0:8065:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000059097f2a/0x8da3486b955f37bc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366651.048428:0:8065:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000059097f2a/0x8da3486b955f37bc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366651.048437:0:8065:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000059097f2a/0x8da3486b955f37bc lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366651.048444:0:8065:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000059097f2a/0x8da3486b955f37bc lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366651.048451:0:8065:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9638902c9400 already unused, calling callback (ffffffffc16df520) 00010000:00010000:3.0:1789366651.048455:0:8065:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000059097f2a/0x8da3486b955f37bc lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366651.048464:0:8065:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000059097f2a/0x8da3486b955f37bc lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366651.048476:0:8065:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000059097f2a/0x8da3486b955f37bc lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366651.048484:0:8065:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000059097f2a/0x8da3486b955f37bc lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789366651.048539:0:8065:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638c1e6f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0ab23baa-a205-44ad-bf17-f7b47295d82b+9:2355:x1876286751424256:12345-192.168.202.23@tcp:1:lfs.0 Request processed in 11346us (11502us total) trans 0 rc 0/0 00000100:00100000:3.0:1789366651.048545:0:8065:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 36 00000100:00100000:3.0:1789366651.050415:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:1.0:1789366651.050477:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751424768 00000100:00100000:1.0:1789366651.050487:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751424768 00000100:00100000:1.0:1789366651.050538:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 26 00000100:00100000:1.0:1789366651.050545:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963888cbac50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0ab23baa-a205-44ad-bf17-f7b47295d82b+38:10511:x1876286751424768:12345-192.168.202.23@tcp:35:lfs.0 00000004:00010000:1.0:1789366651.050698:0:5819:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0x7:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9638b6ce3000/0x8da3486b955f37ae lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.23@tcp remote: 0xda917a494d06c0ed expref: 38 pid: 7614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789366651.050967:0:5819:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967380 00000001:00080000:1.0:1789366651.050997:0:5819:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967381 00000001:00080000:1.0:1789366651.051299:0:5819:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967382 00010000:00010000:1.0:1789366651.051349:0:5819:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9638b6ce2000/0x8da3486b955f37c3 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366651.051363:0:5819:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9638b6ce3800/0x8da3486b955f3768 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.23@tcp remote: 0xda917a494d06c0ca expref: 42 pid: 7614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366651.051370:0:5819:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9638b6ce2000/0x8da3486b955f37c3 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366651.051399:0:5819:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9638b6ce3800/0x8da3486b955f3768 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.23@tcp remote: 0xda917a494d06c0ca expref: 42 pid: 7614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366651.051413:0:5819:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9638b6ce3800/0x8da3486b955f3768 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.23@tcp remote: 0xda917a494d06c0ca expref: 42 pid: 7614 timeout: 326 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789366651.051427:0:5819:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9638b7214380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5819:1876286758774016:192.168.202.23@tcp:104: 00000100:00100000:1.0:1789366651.051540:0:5819:0:(client.c:2716:ptlrpc_set_wait()) set ffff96388a34d540 going to sleep for 11 seconds 00000100:00100000:0.0:1789366651.055776:0:5819:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9638b7214380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5819:1876286758774016:192.168.202.23@tcp:104: 00000100:00100000:3.0:1789366651.055802:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00010000:00010000:0.0:1789366651.055804:0:5819:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9638b6ce2000/0x8da3486b955f37c3 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789366651.055989:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751424896 00000100:00100000:2.0:1789366651.055995:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751424896 00010000:00010000:2.0:1789366651.056031:0:5803:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9638b6ce3800/0x8da3486b955f3768 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.23@tcp remote: 0xda917a494d06c0ca expref: 43 pid: 7614 timeout: 326 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789366651.056077:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 50 00000100:00100000:2.0:1789366651.056087:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638c1e6df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0ab23baa-a205-44ad-bf17-f7b47295d82b+43:2354:x1876286751424896:12345-192.168.202.23@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789366651.056101:0:5803:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789366651.056108:0:5803:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9638b6ce3800/0x8da3486b955f3768 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.23@tcp remote: 0xda917a494d06c0ca expref: 43 pid: 7614 timeout: 326 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366651.056118:0:5803:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9638b6ce3800/0x8da3486b955f3768 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.23@tcp remote: 0xda917a494d06c0ca expref: 43 pid: 7614 timeout: 326 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366651.056136:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9638b6ce3800/0x8da3486b955f3768 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.23@tcp remote: 0xda917a494d06c0ca expref: 43 pid: 7614 timeout: 326 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366651.056147:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff963887f88100) 00010000:00010000:2.0:1789366651.056150:0:5803:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9638b6ce2000/0x8da3486b955f37c3 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366651.056157:0:5803:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9638b6ce2000/0x8da3486b955f37c3 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366651.056162:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9638b6ce2000/0x8da3486b955f37c3 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366651.056179:0:5803:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789366651.056196:0:5819:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9638b6ce2000/0x8da3486b955f37c3 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366651.056202:0:5819:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9638b6ce2000/0x8da3486b955f37c3 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789366651.056222:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638c1e6df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0ab23baa-a205-44ad-bf17-f7b47295d82b+42:2354:x1876286751424896:12345-192.168.202.23@tcp:103:ldlm_bl.0 Request processed in 137us (421us total) trans 0 rc 0/0 00000100:00100000:2.0:1789366651.056228:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 50 00000001:00080000:0.0:1789366651.056336:0:5819:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967383 00000001:00080000:0.0:1789366651.057253:0:5819:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967384 00000100:00100000:0.0:1789366651.057381:0:5819:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9638a74cad80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5819:1876286758774144:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1789366651.057428:0:5819:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789366651.057467:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286758774144 00000100:00100000:0.0:1789366651.057472:0:5819:0:(client.c:2716:ptlrpc_set_wait()) set ffff9638b70ffa80 going to sleep for 11 seconds 00000100:00100000:1.0:1789366651.057473:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286758774144 00000100:00080000:0.0:1789366651.057506:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789366651.057513:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1789366651.057520:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638a74c8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:5819:x1876286758774144:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1789366651.057594:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638a74c8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:5819:x1876286758774144:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 74us (166us total) trans 0 rc 0/0 00000100:00100000:1.0:1789366651.057606:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1789366651.057675:0:5819:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9638a74cad80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5819:1876286758774144:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:0.0:1789366651.058751:0:5819:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967385 00000100:00100000:0.0:1789366651.058824:0:5819:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9638a74cad80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5819:1876286758774272:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1789366651.058862:0:5819:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789366651.058886:0:5819:0:(client.c:2716:ptlrpc_set_wait()) set ffff9638b70ff840 going to sleep for 11 seconds 00000100:00100000:2.0:1789366651.058978:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286758774272 00000100:00100000:2.0:1789366651.058990:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286758774272 00000100:00100000:2.0:1789366651.059018:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1789366651.059026:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638a74ca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:5819:x1876286758774272:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1789366651.059158:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638a74ca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+8:5819:x1876286758774272:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 133us (296us total) trans 4294967303 rc 0/0 00000100:00100000:2.0:1789366651.059166:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1789366651.059192:0:5819:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9638a74cad80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5819:1876286758774272:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:0.0:1789366651.059246:0:5819:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967386 00010000:00010000:0.0:1789366651.059282:0:5819:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9638b6ce2000/0x8da3486b955f37c3 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366651.059291:0:5819:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9638b6ce2000/0x8da3486b955f37c3 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366651.059298:0:5819:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9638b6ce2000/0x8da3486b955f37c3 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366651.059303:0:5819:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9638b6ce2000 already unused, calling callback (ffffffffc20ee4f0) 00010000:00010000:0.0:1789366651.059308:0:5819:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9638b6ce2000/0x8da3486b955f37c3 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366651.059315:0:5819:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9638b6ce2000/0x8da3486b955f37c3 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366651.059331:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff963887f88100) 00010000:00010000:0.0:1789366651.059334:0:5819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:0.0:1789366651.059338:0:5819:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9638b6ce2000/0x8da3486b955f37c3 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366651.059345:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9638b6ce2000/0x8da3486b955f37c3 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1789366651.059513:0:5819:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x8:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:0.0:1789366651.059612:0:5819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].3, 64 off8384 00000004:00080000:0.0:1789366651.059623:0:5819:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 226523904557ns, next at 227523902023ns, rc = 0 00000001:00080000:0.0:1789366651.059630:0:5819:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967387 00010000:00010000:0.0:1789366651.059658:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff963887f88100) 00010000:00010000:0.0:1789366651.059661:0:5819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1789366651.059667:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9638b6ce3000/0x8da3486b955f37ae lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.23@tcp remote: 0xda917a494d06c0ed expref: 46 pid: 7614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789366651.059780:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963888cbac50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0ab23baa-a205-44ad-bf17-f7b47295d82b+45:10511:x1876286751424768:12345-192.168.202.23@tcp:35:lfs.0 Request processed in 9235us (9371us total) trans 4294967388 rc 0/0 00000100:00100000:0.0:1789366651.059789:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 26 00000020:00080000:0.0:1789366651.059794:0:5819:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:0.0:1789366651.061705:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:2.0:1789366651.061809:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751425024 00000100:00100000:2.0:1789366651.061817:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751425024 00000100:00100000:2.0:1789366651.061877:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 100 00000100:00100000:2.0:1789366651.061887:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638a74c9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0ab23baa-a205-44ad-bf17-f7b47295d82b+45:10511:x1876286751425024:12345-192.168.202.23@tcp:101:lfs.0 00010000:00010000:2.0:1789366651.061907:0:5815:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789366651.061929:0:5815:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c8000/0x8da3486b955f37ca lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xda917a494d06c0f4 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366651.061979:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c8000/0x8da3486b955f37ca lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.23@tcp remote: 0xda917a494d06c0f4 expref: 46 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366651.061993:0:5815:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c8000/0x8da3486b955f37ca lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.23@tcp remote: 0xda917a494d06c0f4 expref: 46 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366651.062012:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9638a7404a00) 00010000:00010000:2.0:1789366651.062014:0:5815:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789366651.062017:0:5815:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9638902c8000, rc 0) 00000100:00100000:2.0:1789366651.062061:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638a74c9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0ab23baa-a205-44ad-bf17-f7b47295d82b+46:10511:x1876286751425024:12345-192.168.202.23@tcp:101:lfs.0 Request processed in 176us (360us total) trans 0 rc 0/0 00000100:00100000:2.0:1789366651.062068:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 100 00000100:00100000:3.0:1789366651.063781:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:1.0:1789366651.063958:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751425280 00000100:00100000:1.0:1789366651.063966:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751425280 00000100:00100000:1.0:1789366651.064021:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 27 00000100:00100000:1.0:1789366651.064030:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638c1e6ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0ab23baa-a205-44ad-bf17-f7b47295d82b+46:10511:x1876286751425280:12345-192.168.202.23@tcp:35:lfs.0 00000100:00100000:1.0:1789366651.064249:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638c1e6ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0ab23baa-a205-44ad-bf17-f7b47295d82b+47:10511:x1876286751425280:12345-192.168.202.23@tcp:35:lfs.0 Request processed in 219us (476us total) trans 4294967389 rc 0/0 00000100:00100000:1.0:1789366651.064257:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 27 00000100:00100000:3.0:1789366651.120676:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:1.0:1789366651.120819:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751425408 00000100:00100000:1.0:1789366651.120827:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751425408 00000100:00100000:1.0:1789366651.120879:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 101 00000100:00100000:1.0:1789366651.120886:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638b73ce680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0ab23baa-a205-44ad-bf17-f7b47295d82b+47:10521:x1876286751425408:12345-192.168.202.23@tcp:34:lfs.0 00010000:00010000:1.0:1789366651.120949:0:5817:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9638b6ce2800/0x8da3486b955f37d1 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366651.120963:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9638b6ce2800/0x8da3486b955f37d1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366651.120971:0:5817:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9638b6ce2800/0x8da3486b955f37d1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366651.120980:0:5817:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9638b6ce2e00/0x8da3486b955f37d8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366651.120986:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9638b6ce2e00/0x8da3486b955f37d8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366651.120992:0:5817:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9638b6ce2e00/0x8da3486b955f37d8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366651.121099:0:5817:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9638b6ce3000/0x8da3486b955f37df lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366651.121109:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9638b6ce3000/0x8da3486b955f37df lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366651.121116:0:5817:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9638b6ce3000/0x8da3486b955f37df lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789366651.121157:0:5817:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9638b6ce3000/0x8da3486b955f37df lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366651.121172:0:5817:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9638b6ce2800/0x8da3486b955f37d1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366651.121178:0:5817:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9638b6ce2800/0x8da3486b955f37d1 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366651.121186:0:5817:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9638b6ce2800/0x8da3486b955f37d1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366651.121193:0:5817:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9638b6ce2800 already unused, calling callback (ffffffffc20ee4f0) 00010000:00010000:1.0:1789366651.121197:0:5817:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9638b6ce2800/0x8da3486b955f37d1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366651.121205:0:5817:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9638b6ce2800/0x8da3486b955f37d1 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366651.121217:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff963890797000) 00010000:00010000:1.0:1789366651.121220:0:5817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789366651.121224:0:5817:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9638b6ce2800/0x8da3486b955f37d1 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366651.121280:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9638b6ce2800/0x8da3486b955f37d1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366651.121295:0:5817:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9638b6ce2e00/0x8da3486b955f37d8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366651.121301:0:5817:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9638b6ce2e00/0x8da3486b955f37d8 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366651.121308:0:5817:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9638b6ce2e00/0x8da3486b955f37d8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366651.121313:0:5817:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9638b6ce2e00 already unused, calling callback (ffffffffc20ee4f0) 00010000:00010000:1.0:1789366651.121317:0:5817:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9638b6ce2e00/0x8da3486b955f37d8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366651.121323:0:5817:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9638b6ce2e00/0x8da3486b955f37d8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366651.121331:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff963887f88b00) 00010000:00010000:1.0:1789366651.121334:0:5817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789366651.121336:0:5817:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9638b6ce2e00/0x8da3486b955f37d8 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366651.121342:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9638b6ce2e00/0x8da3486b955f37d8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366651.121355:0:5817:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9638b6ce3000/0x8da3486b955f37df lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366651.121361:0:5817:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9638b6ce3000/0x8da3486b955f37df lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366651.121373:0:5817:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9638b6ce3000/0x8da3486b955f37df lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366651.121378:0:5817:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9638b6ce3000 already unused, calling callback (ffffffffc20ee4f0) 00010000:00010000:1.0:1789366651.121381:0:5817:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9638b6ce3000/0x8da3486b955f37df lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366651.121387:0:5817:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9638b6ce3000/0x8da3486b955f37df lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366651.121396:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9638a7404a00) 00010000:00010000:1.0:1789366651.121399:0:5817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789366651.121402:0:5817:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9638b6ce3000/0x8da3486b955f37df lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366651.121408:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9638b6ce3000/0x8da3486b955f37df lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789366651.121475:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638b73ce680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0ab23baa-a205-44ad-bf17-f7b47295d82b+47:10521:x1876286751425408:12345-192.168.202.23@tcp:34:lfs.0 Request processed in 587us (808us total) trans 0 rc 0/0 00000100:00100000:1.0:1789366651.121483:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 101 00000100:00100000:2.0:1789366651.150372:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:0.0:1789366651.150484:0:7132:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751425664 00000100:00100000:0.0:1789366651.150494:0:7132:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751425664 00000100:00100000:0.0:1789366651.150593:0:7132:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 102 00000100:00100000:0.0:1789366651.150606:0:7132:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638b7350380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0ab23baa-a205-44ad-bf17-f7b47295d82b+47:10524:x1876286751425664:12345-192.168.202.23@tcp:101:lfs.0 00010000:00010000:0.0:1789366651.150627:0:7132:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789366651.150649:0:7132:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720c800/0x8da3486b955f37e6 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xda917a494d06c0fb expref: -99 pid: 7132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366651.152418:0:7132:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720ca00/0x8da3486b955f37ed lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366651.152440:0:7132:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720ca00/0x8da3486b955f37ed lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366651.152470:0:7132:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720ca00/0x8da3486b955f37ed lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366651.152492:0:7132:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720d600/0x8da3486b955f37f4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366651.152500:0:7132:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720d600/0x8da3486b955f37f4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366651.152506:0:7132:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720d600/0x8da3486b955f37f4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366651.152635:0:7132:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720dc00/0x8da3486b955f37fb lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366651.152644:0:7132:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720dc00/0x8da3486b955f37fb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366651.152651:0:7132:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720dc00/0x8da3486b955f37fb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789366651.152663:0:7132:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:0.0:1789366651.152846:0:7132:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720ca00/0x8da3486b955f37ed lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366651.152855:0:7132:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720ca00/0x8da3486b955f37ed lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366651.152862:0:7132:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720ca00/0x8da3486b955f37ed lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366651.152869:0:7132:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9638b720ca00 already unused, calling callback (ffffffffc20ee4f0) 00010000:00010000:0.0:1789366651.152879:0:7132:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720ca00/0x8da3486b955f37ed lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366651.152888:0:7132:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720ca00/0x8da3486b955f37ed lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366651.152900:0:7132:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff963890797000) 00010000:00010000:0.0:1789366651.152904:0:7132:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789366651.152909:0:7132:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720ca00/0x8da3486b955f37ed lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366651.152916:0:7132:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720ca00/0x8da3486b955f37ed lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366651.152930:0:7132:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720d600/0x8da3486b955f37f4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366651.152936:0:7132:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720d600/0x8da3486b955f37f4 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366651.152942:0:7132:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720d600/0x8da3486b955f37f4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366651.152947:0:7132:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9638b720d600 already unused, calling callback (ffffffffc20ee4f0) 00010000:00010000:0.0:1789366651.152950:0:7132:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720d600/0x8da3486b955f37f4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366651.152956:0:7132:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720d600/0x8da3486b955f37f4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366651.152962:0:7132:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff963890797300) 00010000:00010000:0.0:1789366651.152965:0:7132:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789366651.152974:0:7132:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720d600/0x8da3486b955f37f4 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366651.152980:0:7132:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720d600/0x8da3486b955f37f4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366651.153025:0:7132:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720c800/0x8da3486b955f37e6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.23@tcp remote: 0xda917a494d06c0fb expref: 50 pid: 7132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366651.153041:0:7132:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720dc00/0x8da3486b955f37fb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.23@tcp remote: 0xda917a494d06c0fb expref: 49 pid: 7132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366651.153048:0:7132:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9638a7404a00) 00010000:00010000:0.0:1789366651.153051:0:7132:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789366651.153053:0:7132:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9638b720dc00, rc 0) 00000100:00100000:0.0:1789366651.153185:0:7132:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638b7350380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0ab23baa-a205-44ad-bf17-f7b47295d82b+49:10524:x1876286751425664:12345-192.168.202.23@tcp:101:lfs.0 Request processed in 2581us (2821us total) trans 4294967390 rc 0/0 00000100:00100000:0.0:1789366651.153194:0:7132:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 102 00000100:00100000:0.0:1789366651.159416:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:2.0:1789366651.159531:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751425792 00000100:00100000:2.0:1789366651.159542:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751425792 00000100:00100000:2.0:1789366651.159702:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 103 00000100:00100000:2.0:1789366651.159714:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638a74c9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0ab23baa-a205-44ad-bf17-f7b47295d82b+49:10524:x1876286751425792:12345-192.168.202.23@tcp:54:lfs.0 00010000:00010000:2.0:1789366651.162865:0:5815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9c00/0x8da3486b955f3809 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366651.162884:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9c00/0x8da3486b955f3809 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366651.162907:0:5815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9c00/0x8da3486b955f3809 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366651.162936:0:5815:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9c00/0x8da3486b955f3809 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366651.162944:0:5815:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9c00/0x8da3486b955f3809 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366651.162951:0:5815:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9c00/0x8da3486b955f3809 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366651.162958:0:5815:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9638902c9c00 already unused, calling callback (ffffffffc20ee4f0) 00010000:00010000:2.0:1789366651.162962:0:5815:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9c00/0x8da3486b955f3809 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366651.162970:0:5815:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9c00/0x8da3486b955f3809 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366651.162982:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9638a7404a00) 00010000:00010000:2.0:1789366651.162985:0:5815:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789366651.163005:0:5815:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9c00/0x8da3486b955f3809 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366651.163012:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9c00/0x8da3486b955f3809 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789366651.163110:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638a74c9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0ab23baa-a205-44ad-bf17-f7b47295d82b+49:10524:x1876286751425792:12345-192.168.202.23@tcp:54:lfs.0 Request processed in 3395us (3702us total) trans 0 rc 0/0 00000100:00100000:2.0:1789366651.163120:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 103 00000100:00100000:1.0:1789366651.165605:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:2.0:1789366651.165654:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751426048 00000100:00100000:2.0:1789366651.165663:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751426048 00000100:00100000:2.0:1789366651.165746:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 28 00000100:00100000:2.0:1789366651.165765:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638b7216a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0ab23baa-a205-44ad-bf17-f7b47295d82b+49:10524:x1876286751426048:12345-192.168.202.23@tcp:35:lfs.0 00000100:00100000:2.0:1789366651.165981:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638b7216a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0ab23baa-a205-44ad-bf17-f7b47295d82b+50:10524:x1876286751426048:12345-192.168.202.23@tcp:35:lfs.0 Request processed in 225us (379us total) trans 4294967391 rc 0/0 00000100:00100000:2.0:1789366651.165988:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 28 00000100:00100000:3.0:1789366651.221113:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:2.0:1789366651.221291:0:7614:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751426304 00000100:00100000:2.0:1789366651.221303:0:7614:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751426304 00000100:00100000:2.0:1789366651.221369:0:7614:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 104 00000100:00100000:2.0:1789366651.221380:0:7614:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638b73f8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0ab23baa-a205-44ad-bf17-f7b47295d82b+50:10534:x1876286751426304:12345-192.168.202.23@tcp:101:bash.0 00010000:00010000:2.0:1789366651.221405:0:7614:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789366651.221409:0:7614:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1789366651.221435:0:7614:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9e00/0x8da3486b955f378b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.23@tcp remote: 0xda917a494d06c0df expref: 50 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366651.221456:0:7614:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff963890797000) 00010000:00010000:2.0:1789366651.221462:0:7614:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789366651.221476:0:7614:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9c00/0x8da3486b955f3810 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xda917a494d06c102 expref: -99 pid: 7614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366651.221589:0:7614:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9600/0x8da3486b955f3817 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7614 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366651.221604:0:7614:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720dc00/0x8da3486b955f37fb lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.23@tcp remote: 0xda917a494d06c0fb expref: 50 pid: 7132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366651.221613:0:7614:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9600/0x8da3486b955f3817 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7614 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366651.221647:0:7614:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720dc00/0x8da3486b955f37fb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.23@tcp remote: 0xda917a494d06c0fb expref: 50 pid: 7132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366651.221661:0:7614:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720dc00/0x8da3486b955f37fb lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.23@tcp remote: 0xda917a494d06c0fb expref: 50 pid: 7132 timeout: 326 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789366651.221674:0:7614:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9638b7352a00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:7614:1876286758774400:192.168.202.23@tcp:104: 00000100:00100000:2.0:1789366651.225570:0:7614:0:(client.c:2716:ptlrpc_set_wait()) set ffff963882ec99c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789366651.231018:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:2.0:1789366651.231209:0:7614:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9638b7352a00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:7614:1876286758774400:192.168.202.23@tcp:104: 00010000:00010000:2.0:1789366651.231247:0:7614:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9600/0x8da3486b955f3817 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7614 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789366651.231405:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751426432 00000100:00100000:3.0:1789366651.231413:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751426432 00010000:00010000:3.0:1789366651.231450:0:5801:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720dc00/0x8da3486b955f37fb lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.23@tcp remote: 0xda917a494d06c0fb expref: 51 pid: 7132 timeout: 326 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789366651.231501:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 51 00000100:00100000:3.0:1789366651.231512:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638a74c9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0ab23baa-a205-44ad-bf17-f7b47295d82b+51:2354:x1876286751426432:12345-192.168.202.23@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789366651.231527:0:5801:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789366651.231534:0:5801:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720dc00/0x8da3486b955f37fb lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.23@tcp remote: 0xda917a494d06c0fb expref: 51 pid: 7132 timeout: 326 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366651.231547:0:5801:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720dc00/0x8da3486b955f37fb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.23@tcp remote: 0xda917a494d06c0fb expref: 51 pid: 7132 timeout: 326 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366651.231570:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720dc00/0x8da3486b955f37fb lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.23@tcp remote: 0xda917a494d06c0fb expref: 51 pid: 7132 timeout: 326 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366651.231597:0:5801:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9638a7404a00) 00010000:00010000:3.0:1789366651.231603:0:5801:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9600/0x8da3486b955f3817 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7614 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366651.231612:0:5801:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9600/0x8da3486b955f3817 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7614 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366651.231639:0:5801:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9600/0x8da3486b955f3817 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7614 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366651.231668:0:5801:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789366651.231753:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638a74c9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0ab23baa-a205-44ad-bf17-f7b47295d82b+50:2354:x1876286751426432:12345-192.168.202.23@tcp:103:ldlm_bl.0 Request processed in 243us (744us total) trans 0 rc 0/0 00000100:00100000:3.0:1789366651.231761:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 51 00010000:00010000:1.0:1789366651.231978:0:7614:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9600/0x8da3486b955f3817 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7614 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366651.231988:0:7614:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9600/0x8da3486b955f3817 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7614 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789366651.232068:0:7614:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:1.0:1789366651.232206:0:7614:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9c00/0x8da3486b955f3810 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.23@tcp remote: 0xda917a494d06c102 expref: 51 pid: 7614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366651.232229:0:7614:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9600/0x8da3486b955f3817 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.23@tcp remote: 0xda917a494d06c102 expref: 50 pid: 7614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366651.232247:0:7614:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9638a7404a00) 00010000:00010000:1.0:1789366651.232251:0:7614:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1789366651.232253:0:7614:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9638902c9600, rc 0) 00000100:00100000:1.0:1789366651.232286:0:7614:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638b73f8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0ab23baa-a205-44ad-bf17-f7b47295d82b+50:10534:x1876286751426304:12345-192.168.202.23@tcp:101:bash.0 Request processed in 10909us (11185us total) trans 4294967392 rc 0/0 00000100:00100000:1.0:1789366651.232293:0:7614:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 104 00000100:00100000:0.0:1789366651.234068:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:2.0:1789366651.234372:0:7132:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751426688 00000100:00100000:2.0:1789366651.234383:0:7132:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751426688 00000100:00100000:2.0:1789366651.234440:0:7132:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 105 00000100:00100000:2.0:1789366651.234451:0:7132:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638a74c8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0ab23baa-a205-44ad-bf17-f7b47295d82b+50:10534:x1876286751426688:12345-192.168.202.23@tcp:36:bash.0 00010000:00010000:2.0:1789366651.234757:0:7132:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9e00/0x8da3486b955f3825 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366651.234781:0:7132:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9e00/0x8da3486b955f3825 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366651.234796:0:7132:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9e00/0x8da3486b955f3825 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789366651.234852:0:7132:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967393 00000004:00010000:2.0:1789366651.234878:0:7132:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000e7dfad19 reply state 00000000dd07e37a transno 4294967394 ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9e00/0x8da3486b955f3825 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789366651.234887:0:7132:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789366651.234965:0:7132:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638a74c8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0ab23baa-a205-44ad-bf17-f7b47295d82b+53:10534:x1876286751426688:12345-192.168.202.23@tcp:36:bash.0 Request processed in 515us (902us total) trans 4294967394 rc 0/0 00000100:00100000:2.0:1789366651.234973:0:7132:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 105 00000020:00080000:2.0:1789366651.234978:0:7132:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1789366651.236570:0:3270:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9e00/0x8da3486b955f3825 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366651.236593:0:3270:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9e00/0x8da3486b955f3825 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366651.236601:0:3270:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9e00/0x8da3486b955f3825 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366651.236608:0:3270:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9638902c9e00 already unused, calling callback (ffffffffc20ee4f0) 00010000:00010000:1.0:1789366651.236612:0:3270:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9e00/0x8da3486b955f3825 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366651.236621:0:3270:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9e00/0x8da3486b955f3825 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366651.236636:0:3270:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9638a7404a00) 00010000:00010000:1.0:1789366651.236639:0:3270:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789366651.236644:0:3270:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9e00/0x8da3486b955f3825 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366651.236662:0:3270:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9e00/0x8da3486b955f3825 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789366651.241893:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:2.0:1789366651.242059:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751426816 00000100:00100000:2.0:1789366651.242070:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751426816 00000100:00100000:2.0:1789366651.242138:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 106 00000100:00100000:2.0:1789366651.242148:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638a74ca300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0ab23baa-a205-44ad-bf17-f7b47295d82b+52:10534:x1876286751426816:12345-192.168.202.23@tcp:101:bash.0 00010000:00010000:2.0:1789366651.242173:0:5815:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789366651.242195:0:5815:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c8200/0x8da3486b955f382c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xda917a494d06c109 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366651.242303:0:5815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9800/0x8da3486b955f3833 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366651.242318:0:5815:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9600/0x8da3486b955f3817 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.23@tcp remote: 0xda917a494d06c102 expref: 53 pid: 7614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366651.242343:0:5815:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9800/0x8da3486b955f3833 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366651.242375:0:5815:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9600/0x8da3486b955f3817 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.23@tcp remote: 0xda917a494d06c102 expref: 53 pid: 7614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366651.242388:0:5815:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9600/0x8da3486b955f3817 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.23@tcp remote: 0xda917a494d06c102 expref: 53 pid: 7614 timeout: 326 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789366651.242403:0:5815:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9638b7352a00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5815:1876286758774528:192.168.202.23@tcp:104: 00000100:00100000:2.0:1789366651.242539:0:5815:0:(client.c:2716:ptlrpc_set_wait()) set ffff963882ec9d80 going to sleep for 11 seconds 00000100:00100000:3.0:1789366651.244736:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:2.0:1789366651.244787:0:5815:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9638b7352a00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5815:1876286758774528:192.168.202.23@tcp:104: 00010000:00010000:2.0:1789366651.244813:0:5815:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9800/0x8da3486b955f3833 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789366651.244894:0:8419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751426944 00000100:00100000:0.0:1789366651.244901:0:8419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751426944 00010000:00010000:0.0:1789366651.244934:0:8419:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9600/0x8da3486b955f3817 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.23@tcp remote: 0xda917a494d06c102 expref: 54 pid: 7614 timeout: 326 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789366651.244970:0:8419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 52 00000100:00100000:0.0:1789366651.244980:0:8419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638b73f9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0ab23baa-a205-44ad-bf17-f7b47295d82b+54:2355:x1876286751426944:12345-192.168.202.23@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789366651.245001:0:8419:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789366651.245008:0:8419:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9600/0x8da3486b955f3817 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.23@tcp remote: 0xda917a494d06c102 expref: 54 pid: 7614 timeout: 326 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366651.245019:0:8419:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9600/0x8da3486b955f3817 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.23@tcp remote: 0xda917a494d06c102 expref: 54 pid: 7614 timeout: 326 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366651.245040:0:8419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9600/0x8da3486b955f3817 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.23@tcp remote: 0xda917a494d06c102 expref: 54 pid: 7614 timeout: 326 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366651.245055:0:8419:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9638a7404a00) 00010000:00010000:0.0:1789366651.245059:0:8419:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9800/0x8da3486b955f3833 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366651.245068:0:8419:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9800/0x8da3486b955f3833 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366651.245075:0:8419:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9800/0x8da3486b955f3833 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366651.245207:0:8419:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789366651.245283:0:8419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638b73f9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0ab23baa-a205-44ad-bf17-f7b47295d82b+53:2355:x1876286751426944:12345-192.168.202.23@tcp:103:ldlm_bl.0 Request processed in 304us (568us total) trans 0 rc 0/0 00000100:00100000:0.0:1789366651.245292:0:8419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 52 00010000:00010000:1.0:1789366651.246277:0:5815:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9800/0x8da3486b955f3833 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366651.246288:0:5815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9800/0x8da3486b955f3833 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789366651.246335:0:5815:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:1.0:1789366651.246340:0:5815:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1789366651.246361:0:5815:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9800/0x8da3486b955f3833 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366651.246394:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c8200/0x8da3486b955f382c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.23@tcp remote: 0xda917a494d06c109 expref: 53 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366651.246411:0:5815:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9800/0x8da3486b955f3833 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.23@tcp remote: 0xda917a494d06c109 expref: 52 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366651.246420:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9638a7404a00) 00010000:00010000:1.0:1789366651.246422:0:5815:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789366651.246425:0:5815:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9638902c9800, rc 0) 00000100:00100000:1.0:1789366651.246824:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638a74ca300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0ab23baa-a205-44ad-bf17-f7b47295d82b+52:10534:x1876286751426816:12345-192.168.202.23@tcp:101:bash.0 Request processed in 4325us (4590us total) trans 0 rc 0/0 00000100:00100000:1.0:1789366651.246833:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 106 00000100:00100000:3.0:1789366651.248167:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:0.0:1789366651.248269:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751427200 00000100:00100000:0.0:1789366651.248279:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751427200 00000100:00100000:0.0:1789366651.248383:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 29 00000100:00100000:0.0:1789366651.248392:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638af2d4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0ab23baa-a205-44ad-bf17-f7b47295d82b+52:10534:x1876286751427200:12345-192.168.202.23@tcp:35:bash.0 00000100:00100000:0.0:1789366651.248592:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638af2d4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0ab23baa-a205-44ad-bf17-f7b47295d82b+53:10534:x1876286751427200:12345-192.168.202.23@tcp:35:bash.0 Request processed in 201us (427us total) trans 4294967395 rc 0/0 00000100:00100000:0.0:1789366651.248608:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 29 00000100:00100000:0.0:1789366651.295174:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:1.0:1789366651.295268:0:7614:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751427328 00000100:00100000:1.0:1789366651.295280:0:7614:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751427328 00000100:00100000:1.0:1789366651.295401:0:7614:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 107 00000100:00100000:1.0:1789366651.295424:0:7614:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638a74cb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0ab23baa-a205-44ad-bf17-f7b47295d82b+53:10540:x1876286751427328:12345-192.168.202.23@tcp:101:lfs.0 00010000:00010000:1.0:1789366651.295449:0:7614:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789366651.295471:0:7614:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9638b6ce2000/0x8da3486b955f383a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xda917a494d06c110 expref: -99 pid: 7614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366651.295538:0:7614:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9638b6ce3800/0x8da3486b955f3841 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7614 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366651.295554:0:7614:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9638b6ce3800/0x8da3486b955f3841 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7614 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366651.295567:0:7614:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9638b6ce3800/0x8da3486b955f3841 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7614 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789366651.295612:0:7614:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00000004:00200000:1.0:1789366651.295616:0:7614:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1789366651.295634:0:7614:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9638b6ce3800/0x8da3486b955f3841 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7614 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366651.295658:0:7614:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9638b6ce2000/0x8da3486b955f383a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.23@tcp remote: 0xda917a494d06c110 expref: 55 pid: 7614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366651.295675:0:7614:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9638b6ce3800/0x8da3486b955f3841 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.23@tcp remote: 0xda917a494d06c110 expref: 54 pid: 7614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366651.295685:0:7614:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff963890797000) 00010000:00010000:1.0:1789366651.295688:0:7614:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789366651.295692:0:7614:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9638b6ce3800, rc 0) 00000100:00100000:1.0:1789366651.295852:0:7614:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638a74cb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0ab23baa-a205-44ad-bf17-f7b47295d82b+54:10540:x1876286751427328:12345-192.168.202.23@tcp:101:lfs.0 Request processed in 429us (686us total) trans 0 rc 0/0 00000100:00100000:1.0:1789366651.295870:0:7614:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 107 00000100:00100000:1.0:1789366651.299632:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:3.0:1789366651.300579:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751427456 00000100:00100000:3.0:1789366651.300589:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751427456 00000100:00100000:3.0:1789366651.300650:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 108 00000100:00100000:3.0:1789366651.300661:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638b7217480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0ab23baa-a205-44ad-bf17-f7b47295d82b+54:10540:x1876286751427456:12345-192.168.202.23@tcp:101:lfs.0 00010000:00010000:3.0:1789366651.300682:0:5817:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789366651.300703:0:5817:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9638832d3600/0x8da3486b955f3848 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xda917a494d06c117 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366651.300788:0:5817:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9638832d3400/0x8da3486b955f384f lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366651.300805:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9638832d3400/0x8da3486b955f384f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366651.300814:0:5817:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9638832d3400/0x8da3486b955f384f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366651.300828:0:5817:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9638832d3a00/0x8da3486b955f3856 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366651.300853:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9638832d3a00/0x8da3486b955f3856 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366651.300861:0:5817:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9638832d3a00/0x8da3486b955f3856 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366651.300969:0:5817:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9638832d3c00/0x8da3486b955f385d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366651.300977:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9638832d3c00/0x8da3486b955f385d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366651.300982:0:5817:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9638832d3c00/0x8da3486b955f385d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789366651.301015:0:5817:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:3.0:1789366651.301018:0:5817:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1789366651.301034:0:5817:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9638832d3c00/0x8da3486b955f385d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366651.301044:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9638832d3c00/0x8da3486b955f385d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366651.301050:0:5817:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9638832d3400/0x8da3486b955f384f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366651.301055:0:5817:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9638832d3400/0x8da3486b955f384f lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366651.301060:0:5817:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9638832d3400/0x8da3486b955f384f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366651.301072:0:5817:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9638832d3400 already unused, calling callback (ffffffffc20ee4f0) 00010000:00010000:3.0:1789366651.301076:0:5817:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9638832d3400/0x8da3486b955f384f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366651.301082:0:5817:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9638832d3400/0x8da3486b955f384f lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366651.301094:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff963890797000) 00010000:00010000:3.0:1789366651.301096:0:5817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789366651.301102:0:5817:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9638832d3400/0x8da3486b955f384f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366651.301109:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9638832d3400/0x8da3486b955f384f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366651.301127:0:5817:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9638832d3a00/0x8da3486b955f3856 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366651.301132:0:5817:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9638832d3a00/0x8da3486b955f3856 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366651.301138:0:5817:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9638832d3a00/0x8da3486b955f3856 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366651.301143:0:5817:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9638832d3a00 already unused, calling callback (ffffffffc20ee4f0) 00010000:00010000:3.0:1789366651.301146:0:5817:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9638832d3a00/0x8da3486b955f3856 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366651.301152:0:5817:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9638832d3a00/0x8da3486b955f3856 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366651.301170:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff96388c43f500) 00010000:00010000:3.0:1789366651.301172:0:5817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789366651.301177:0:5817:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9638832d3a00/0x8da3486b955f3856 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366651.301182:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9638832d3a00/0x8da3486b955f3856 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366651.301220:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9638832d3600/0x8da3486b955f3848 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.23@tcp remote: 0xda917a494d06c117 expref: 56 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366651.301252:0:5817:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9638832d3c00/0x8da3486b955f385d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.23@tcp remote: 0xda917a494d06c117 expref: 55 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366651.301259:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9638a7404a00) 00010000:00010000:3.0:1789366651.301261:0:5817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789366651.301264:0:5817:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9638832d3c00, rc 0) 00000100:00100000:3.0:1789366651.301343:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638b7217480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0ab23baa-a205-44ad-bf17-f7b47295d82b+55:10540:x1876286751427456:12345-192.168.202.23@tcp:101:lfs.0 Request processed in 683us (1719us total) trans 0 rc 0/0 00000100:00100000:3.0:1789366651.301350:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 108 00000100:00100000:0.0:1789366651.308140:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:0.0:1789366651.308244:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:3.0:1789366651.308308:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751427840 00000100:00100000:3.0:1789366651.308318:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751427840 00000100:00100000:3.0:1789366651.308387:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 7 00000100:00100000:3.0:1789366651.308398:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638a74cb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0ab23baa-a205-44ad-bf17-f7b47295d82b+55:2355:x1876286751427840:12345-192.168.202.23@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789366651.308414:0:5801:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789366651.308440:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9638832d3c00/0x8da3486b955f385d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.23@tcp remote: 0xda917a494d06c117 expref: 55 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366651.308480:0:5801:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9638a7404a00) 00010000:00010000:3.0:1789366651.308486:0:5801:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789366651.308543:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638a74cb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0ab23baa-a205-44ad-bf17-f7b47295d82b+54:2355:x1876286751427840:12345-192.168.202.23@tcp:103:ldlm_bl.0 Request processed in 146us (316us total) trans 0 rc 0/0 00000100:00100000:3.0:1789366651.308551:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 7 00000100:00100000:1.0:1789366651.309141:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751427712 00000100:00100000:1.0:1789366651.309147:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751427712 00000100:00100000:1.0:1789366651.309192:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 109 00000100:00100000:1.0:1789366651.309201:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638a74c8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0ab23baa-a205-44ad-bf17-f7b47295d82b+54:10540:x1876286751427712:12345-192.168.202.23@tcp:101:lfs.0 00010000:00010000:1.0:1789366651.309218:0:5815:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789366651.309424:0:5815:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9638b6ce3200/0x8da3486b955f3864 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xda917a494d06c11e expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366651.309520:0:5815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9638b6ce2600/0x8da3486b955f386b lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366651.309534:0:5815:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9800/0x8da3486b955f3833 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.23@tcp remote: 0xda917a494d06c109 expref: 55 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366651.309543:0:5815:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9638b6ce2600/0x8da3486b955f386b lrc: 4/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366651.309578:0:5815:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9800/0x8da3486b955f3833 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.23@tcp remote: 0xda917a494d06c109 expref: 55 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366651.309591:0:5815:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9800/0x8da3486b955f3833 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.23@tcp remote: 0xda917a494d06c109 expref: 55 pid: 5815 timeout: 326 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789366651.309604:0:5815:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9638b7214380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5815:1876286758774656:192.168.202.23@tcp:104: 00000100:00100000:1.0:1789366651.309756:0:5815:0:(client.c:2716:ptlrpc_set_wait()) set ffff96388a34d3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789366651.314109:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:2.0:1789366651.314293:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751427968 00000100:00100000:2.0:1789366651.314301:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751427968 00000100:00100000:1.0:1789366651.314309:0:5815:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9638b7214380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5815:1876286758774656:192.168.202.23@tcp:104: 00010000:00010000:1.0:1789366651.314339:0:5815:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9638b6ce2600/0x8da3486b955f386b lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366651.314361:0:5803:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9800/0x8da3486b955f3833 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.23@tcp remote: 0xda917a494d06c109 expref: 56 pid: 5815 timeout: 326 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789366651.314408:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 53 00000100:00100000:2.0:1789366651.314419:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638af2d5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0ab23baa-a205-44ad-bf17-f7b47295d82b+56:2354:x1876286751427968:12345-192.168.202.23@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789366651.314434:0:5803:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789366651.314441:0:5803:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9800/0x8da3486b955f3833 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.23@tcp remote: 0xda917a494d06c109 expref: 56 pid: 5815 timeout: 326 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366651.314485:0:5803:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9800/0x8da3486b955f3833 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.23@tcp remote: 0xda917a494d06c109 expref: 56 pid: 5815 timeout: 326 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366651.314512:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9800/0x8da3486b955f3833 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.23@tcp remote: 0xda917a494d06c109 expref: 56 pid: 5815 timeout: 326 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366651.314532:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9638a7404a00) 00010000:00010000:2.0:1789366651.314537:0:5803:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9638b6ce2600/0x8da3486b955f386b lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366651.314547:0:5803:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9638b6ce2600/0x8da3486b955f386b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366651.314554:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9638b6ce2600/0x8da3486b955f386b lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366651.314580:0:5803:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789366651.314617:0:5815:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9638b6ce2600/0x8da3486b955f386b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366651.314626:0:5815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9638b6ce2600/0x8da3486b955f386b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789366651.314635:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638af2d5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0ab23baa-a205-44ad-bf17-f7b47295d82b+55:2354:x1876286751427968:12345-192.168.202.23@tcp:103:ldlm_bl.0 Request processed in 216us (540us total) trans 0 rc 0/0 00000100:00100000:2.0:1789366651.314643:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 53 00000004:00200000:1.0:1789366651.314649:0:5815:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:1.0:1789366651.314857:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9638b6ce3200/0x8da3486b955f3864 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.23@tcp remote: 0xda917a494d06c11e expref: 56 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366651.314874:0:5815:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9638b6ce2600/0x8da3486b955f386b lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.23@tcp remote: 0xda917a494d06c11e expref: 55 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366651.314883:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9638a7404a00) 00010000:00010000:1.0:1789366651.314885:0:5815:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1789366651.314888:0:5815:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9638b6ce2600, rc 0) 00000100:00100000:1.0:1789366651.314931:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638a74c8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0ab23baa-a205-44ad-bf17-f7b47295d82b+55:10540:x1876286751427712:12345-192.168.202.23@tcp:101:lfs.0 Request processed in 5731us (6801us total) trans 4294967396 rc 0/0 00000100:00100000:1.0:1789366651.314939:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 109 00000100:00100000:3.0:1789366651.318980:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:2.0:1789366651.319116:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751428224 00000100:00100000:2.0:1789366651.319127:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751428224 00000100:00100000:2.0:1789366651.319402:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 8 00000100:00100000:2.0:1789366651.319414:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96389861f050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0ab23baa-a205-44ad-bf17-f7b47295d82b+55:10540:x1876286751428224:12345-192.168.202.23@tcp:103:lfs.0 00010000:00010000:2.0:1789366651.319429:0:5802:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789366651.319468:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c8000/0x8da3486b955f37ca lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.23@tcp remote: 0xda917a494d06c0f4 expref: 55 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366651.319525:0:5802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9638a7404a00) 00010000:00010000:2.0:1789366651.319531:0:5802:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789366651.319604:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96389861f050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0ab23baa-a205-44ad-bf17-f7b47295d82b+54:10540:x1876286751428224:12345-192.168.202.23@tcp:103:lfs.0 Request processed in 194us (644us total) trans 0 rc 0/0 00000100:00100000:2.0:1789366651.319612:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 8 00000100:00100000:3.0:1789366651.323641:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:1.0:1789366651.326381:0:7614:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751428352 00000100:00100000:1.0:1789366651.326397:0:7614:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751428352 00000100:00100000:1.0:1789366651.326591:0:7614:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 110 00000100:00100000:1.0:1789366651.326605:0:7614:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638af2d5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0ab23baa-a205-44ad-bf17-f7b47295d82b+54:10540:x1876286751428352:12345-192.168.202.23@tcp:58:lfs.0 00010000:00010000:1.0:1789366651.326752:0:7614:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9638b6ce3a00/0x8da3486b955f3879 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7614 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366651.326777:0:7614:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9638b6ce3a00/0x8da3486b955f3879 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7614 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366651.326790:0:7614:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9638b6ce3a00/0x8da3486b955f3879 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7614 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1789366651.326990:0:7614:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].2, 136 off8464 00000100:00100000:1.0:1789366651.327085:0:7614:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638af2d5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0ab23baa-a205-44ad-bf17-f7b47295d82b+54:10540:x1876286751428352:12345-192.168.202.23@tcp:58:lfs.0 Request processed in 483us (3453us total) trans 0 rc 0/0 00000100:00100000:1.0:1789366651.327094:0:7614:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 110 00000100:00100000:0.0:1789366651.333144:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:0.0:1789366651.333180:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751428480 00000100:00100000:0.0:1789366651.335482:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751428480 00000100:00100000:0.0:1789366651.335593:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 111 00000100:00100000:0.0:1789366651.335606:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638a74caa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0ab23baa-a205-44ad-bf17-f7b47295d82b+54:10540:x1876286751428480:12345-192.168.202.23@tcp:101:lfs.0 00010000:00010000:0.0:1789366651.335636:0:5817:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789366651.335662:0:5817:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720ce00/0x8da3486b955f3880 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xda917a494d06c125 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366651.335752:0:5817:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9638b6ce3a00/0x8da3486b955f3879 lrc: 2/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7614 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366651.335765:0:5817:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720ce00/0x8da3486b955f3880 lrc: 4/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.23@tcp remote: 0xda917a494d06c125 expref: 55 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366651.335789:0:5817:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff9638b6ce3a00/0x8da3486b955f3879 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 7614 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366651.335803:0:5817:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720ce00/0x8da3486b955f3880 lrc: 3/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.23@tcp remote: 0xda917a494d06c125 expref: 55 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366651.335818:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9638a7404a00) 00010000:00010000:0.0:1789366651.335829:0:5817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1789366651.335834:0:5817:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720ce00/0x8da3486b955f3880 lrc: 3/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.23@tcp remote: 0xda917a494d06c125 expref: 55 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366651.335843:0:5817:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9638b720ce00, rc 0) 00000100:00100000:0.0:1789366651.335911:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638a74caa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0ab23baa-a205-44ad-bf17-f7b47295d82b+55:10540:x1876286751428480:12345-192.168.202.23@tcp:101:lfs.0 Request processed in 308us (2777us total) trans 0 rc 0/0 00000100:00100000:0.0:1789366651.335918:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 111 00000001:00080000:0.0:1789366651.393526:0:7617:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967301 is committed 00000001:00080000:0.0:1789366651.393542:0:7617:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967299 is committed 00000001:00080000:0.0:1789366651.393552:0:7617:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967303 is committed 00000001:00080000:0.0:1789366651.393558:0:7617:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967302 is committed 00010000:00010000:1.0:1789366651.959915:0:6675:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1789366651.959957:0:11650:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1789366651.959963:0:11650:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1789366651.959997:0:11650:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 3 count 3 00000040:00080000:2.0:1789366651.960003:0:11650:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1789366651.960105:0:11650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9638b7352a00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11650:1876286758774784:192.168.202.23@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1789366651.960198:0:11650:0:(client.c:2716:ptlrpc_set_wait()) set ffff963882ec93c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789366651.964546:0:11650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9638b7352a00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11650:1876286758774784:192.168.202.23@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1789366651.964548:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:1.0:1789366651.964644:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751428608 00000100:00100000:1.0:1789366651.964653:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751428608 00000100:00100000:1.0:1789366651.964753:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 112 00000100:00100000:1.0:1789366651.964764:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638a74cb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0ab23baa-a205-44ad-bf17-f7b47295d82b+55:10541:x1876286751428608:12345-192.168.202.23@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1789366651.964794:0:5815:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1789366651.964884:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638a74cb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0ab23baa-a205-44ad-bf17-f7b47295d82b+55:10541:x1876286751428608:12345-192.168.202.23@tcp:53:lhsmtool_posix.0 Request processed in 122us (345us total) trans 0 rc 0/0 00000100:00100000:1.0:1789366651.964891:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 112 00000100:00100000:1.0:1789366651.966699:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:0.0:1789366651.967417:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751428736 00000100:00100000:0.0:1789366651.967425:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751428736 00000100:00100000:0.0:1789366651.967767:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 113 00000100:00100000:0.0:1789366651.967926:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638b7214380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0ab23baa-a205-44ad-bf17-f7b47295d82b+55:10541:x1876286751428736:12345-192.168.202.23@tcp:34:lhsmtool_posix.0 00010000:00010000:0.0:1789366651.968188:0:5816:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720de00/0x8da3486b955f3887 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366651.968205:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720de00/0x8da3486b955f3887 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366651.968217:0:5816:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720de00/0x8da3486b955f3887 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366651.968243:0:5816:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720c000/0x8da3486b955f388e lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366651.968251:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720c000/0x8da3486b955f388e lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366651.968272:0:5816:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720c000/0x8da3486b955f388e lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366651.968297:0:5816:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720c200/0x8da3486b955f3895 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366651.968306:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720c200/0x8da3486b955f3895 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366651.968313:0:5816:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720c200/0x8da3486b955f3895 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789366651.968349:0:5816:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:0.0:1789366651.968353:0:5816:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1789366651.968366:0:5816:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720c200/0x8da3486b955f3895 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366651.968377:0:5816:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720de00/0x8da3486b955f3887 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366651.968384:0:5816:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720de00/0x8da3486b955f3887 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366651.968392:0:5816:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720de00/0x8da3486b955f3887 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366651.968399:0:5816:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9638b720de00 already unused, calling callback (ffffffffc20ee4f0) 00010000:00010000:0.0:1789366651.968404:0:5816:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720de00/0x8da3486b955f3887 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366651.968412:0:5816:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720de00/0x8da3486b955f3887 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366651.968431:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9638a7404100) 00010000:00010000:0.0:1789366651.968434:0:5816:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789366651.968439:0:5816:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720de00/0x8da3486b955f3887 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366651.968446:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720de00/0x8da3486b955f3887 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366651.968460:0:5816:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720c000/0x8da3486b955f388e lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366651.968587:0:5816:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720c000/0x8da3486b955f388e lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366651.968594:0:5816:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720c000/0x8da3486b955f388e lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366651.968599:0:5816:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9638b720c000 already unused, calling callback (ffffffffc20ee4f0) 00010000:00010000:0.0:1789366651.968602:0:5816:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720c000/0x8da3486b955f388e lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366651.968608:0:5816:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720c000/0x8da3486b955f388e lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366651.968616:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x77a79f1b (ffff963890797300) 00010000:00010000:0.0:1789366651.968619:0:5816:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789366651.968622:0:5816:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720c000/0x8da3486b955f388e lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366651.968627:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720c000/0x8da3486b955f388e lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366651.968654:0:5816:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720c200/0x8da3486b955f3895 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366651.968660:0:5816:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720c200/0x8da3486b955f3895 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366651.968667:0:5816:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720c200/0x8da3486b955f3895 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366651.968672:0:5816:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9638b720c200 already unused, calling callback (ffffffffc20ee4f0) 00010000:00010000:0.0:1789366651.968675:0:5816:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720c200/0x8da3486b955f3895 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366651.968682:0:5816:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720c200/0x8da3486b955f3895 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366651.968690:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9638a7404a00) 00010000:00010000:0.0:1789366651.968693:0:5816:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789366651.968696:0:5816:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720c200/0x8da3486b955f3895 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366651.968703:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720c200/0x8da3486b955f3895 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789366651.968869:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638b7214380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0ab23baa-a205-44ad-bf17-f7b47295d82b+55:10541:x1876286751428736:12345-192.168.202.23@tcp:34:lhsmtool_posix.0 Request processed in 958us (2171us total) trans 0 rc 0/0 00000100:00100000:0.0:1789366651.968877:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 113 00000100:00100000:0.0:1789366651.970651:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:2.0:1789366651.972128:0:7132:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751428992 00000100:00100000:2.0:1789366651.972140:0:7132:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751428992 00000100:00100000:2.0:1789366651.972184:0:7132:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 114 00000100:00100000:2.0:1789366651.972192:0:7132:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638a74c8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0ab23baa-a205-44ad-bf17-f7b47295d82b+55:10541:x1876286751428992:12345-192.168.202.23@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789366651.972208:0:7132:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789366651.972223:0:7132:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c8000/0x8da3486b955f389c lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xda917a494d06c12c expref: -99 pid: 7132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366651.972307:0:7132:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9800/0x8da3486b955f38a3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366651.972320:0:7132:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9800/0x8da3486b955f38a3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366651.972347:0:7132:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9800/0x8da3486b955f38a3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789366651.972356:0:7132:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:2.0:1789366651.972433:0:7132:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9800/0x8da3486b955f38a3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366651.972438:0:7132:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9800/0x8da3486b955f38a3 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366651.972442:0:7132:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9800/0x8da3486b955f38a3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366651.972445:0:7132:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9638902c9800 already unused, calling callback (ffffffffc20ee4f0) 00010000:00010000:2.0:1789366651.972448:0:7132:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9800/0x8da3486b955f38a3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366651.972453:0:7132:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9800/0x8da3486b955f38a3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366651.972460:0:7132:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9638a7404a00) 00010000:00010000:2.0:1789366651.972462:0:7132:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1789366651.972465:0:7132:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9800/0x8da3486b955f38a3 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366651.972469:0:7132:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9800/0x8da3486b955f38a3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366651.972500:0:7132:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c8000/0x8da3486b955f389c lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.23@tcp remote: 0xda917a494d06c12c expref: 57 pid: 7132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366651.972519:0:7132:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9638a7404100) 00010000:00010000:2.0:1789366651.972522:0:7132:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789366651.972527:0:7132:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c8000/0x8da3486b955f389c lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.23@tcp remote: 0xda917a494d06c12c expref: 57 pid: 7132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366651.972537:0:7132:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9638902c8000, rc 0) 00000100:00100000:2.0:1789366651.972586:0:7132:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638a74c8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0ab23baa-a205-44ad-bf17-f7b47295d82b+56:10541:x1876286751428992:12345-192.168.202.23@tcp:101:lhsmtool_posix.0 Request processed in 395us (1940us total) trans 4294967397 rc 301/301 00000100:00100000:2.0:1789366651.972594:0:7132:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 114 00000100:00100000:3.0:1789366651.976923:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:1.0:1789366651.976973:0:7614:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751429120 00000100:00100000:1.0:1789366651.976983:0:7614:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751429120 00000100:00100000:1.0:1789366651.977028:0:7614:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 115 00000100:00100000:1.0:1789366651.977036:0:7614:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638af2d4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0ab23baa-a205-44ad-bf17-f7b47295d82b+56:10541:x1876286751429120:12345-192.168.202.23@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1789366651.977080:0:7614:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1789366651.977176:0:7614:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638af2d4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0ab23baa-a205-44ad-bf17-f7b47295d82b+56:10541:x1876286751429120:12345-192.168.202.23@tcp:53:lhsmtool_posix.0 Request processed in 139us (261us total) trans 0 rc 0/0 00000100:00100000:1.0:1789366651.977190:0:7614:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 115 00000100:00100000:1.0:1789366651.979976:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:0.0:1789366651.980033:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751429376 00000100:00100000:0.0:1789366651.980043:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751429376 00000100:00100000:0.0:1789366651.980101:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 116 00000100:00100000:0.0:1789366651.980111:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963882ee3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0ab23baa-a205-44ad-bf17-f7b47295d82b+56:10541:x1876286751429376:12345-192.168.202.23@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789366651.980131:0:5816:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789366651.980134:0:5816:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1789366651.980161:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9638b6ce3800/0x8da3486b955f3841 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.23@tcp remote: 0xda917a494d06c110 expref: 56 pid: 7614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366651.980181:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff963890797000) 00010000:00010000:0.0:1789366651.980186:0:5816:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789366651.980199:0:5816:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720c000/0x8da3486b955f38b1 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xda917a494d06c133 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1789366651.980744:0:5816:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x4:0x0], index 0: 0 00010000:00010000:0.0:1789366651.980956:0:5816:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720de00/0x8da3486b955f38b8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366651.980970:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720de00/0x8da3486b955f38b8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366651.980979:0:5816:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720de00/0x8da3486b955f38b8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366651.981026:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720c000/0x8da3486b955f38b1 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.23@tcp remote: 0xda917a494d06c133 expref: 58 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366651.981042:0:5816:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720de00/0x8da3486b955f38b8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.23@tcp remote: 0xda917a494d06c133 expref: 57 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366651.981050:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff963890797300) 00010000:00010000:0.0:1789366651.981059:0:5816:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789366651.981062:0:5816:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9638b720de00, rc 0) 00000100:00100000:0.0:1789366651.981121:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963882ee3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0ab23baa-a205-44ad-bf17-f7b47295d82b+57:10541:x1876286751429376:12345-192.168.202.23@tcp:101:lhsmtool_posix.0 Request processed in 1011us (1152us total) trans 4294967398 rc 0/0 00000100:00100000:0.0:1789366651.981129:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 116 00000100:00100000:0.0:1789366651.986869:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:2.0:1789366651.986963:0:7132:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751429632 00000100:00100000:2.0:1789366651.986973:0:7132:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751429632 00000100:00100000:2.0:1789366651.987023:0:7132:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 117 00000100:00100000:2.0:1789366651.987033:0:7132:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638a74c9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0ab23baa-a205-44ad-bf17-f7b47295d82b+57:10541:x1876286751429632:12345-192.168.202.23@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1789366651.987092:0:7132:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789366651.987116:0:7132:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720de00/0x8da3486b955f38b8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.23@tcp remote: 0xda917a494d06c133 expref: 57 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366651.987136:0:7132:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff963890797300) 00010000:00010000:2.0:1789366651.987146:0:7132:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789366651.987165:0:7132:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c8000/0x8da3486b955f38c6 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366651.987178:0:7132:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c8000/0x8da3486b955f38c6 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366651.987187:0:7132:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c8000/0x8da3486b955f38c6 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366651.987212:0:7132:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9800/0x8da3486b955f38cd lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0xe1916000 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366651.987219:0:7132:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9800/0x8da3486b955f38cd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0xe1916000 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366651.987240:0:7132:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9800/0x8da3486b955f38cd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0xe1916000 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366651.987296:0:7132:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c8000/0x8da3486b955f38c6 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366651.987303:0:7132:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c8000/0x8da3486b955f38c6 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366651.987323:0:7132:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c8000/0x8da3486b955f38c6 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366651.987329:0:7132:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9638902c8000 already unused, calling callback (ffffffffc20ee4f0) 00010000:00010000:2.0:1789366651.987333:0:7132:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c8000/0x8da3486b955f38c6 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366651.987341:0:7132:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c8000/0x8da3486b955f38c6 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366651.987350:0:7132:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff963890797000) 00010000:00010000:2.0:1789366651.987353:0:7132:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789366651.987357:0:7132:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c8000/0x8da3486b955f38c6 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366651.987364:0:7132:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c8000/0x8da3486b955f38c6 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366651.987379:0:7132:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9800/0x8da3486b955f38cd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0xe1916000 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366651.987385:0:7132:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9800/0x8da3486b955f38cd lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xe1916000 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366651.987391:0:7132:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9800/0x8da3486b955f38cd lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xe1916000 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366651.987396:0:7132:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9638902c9800 already unused, calling callback (ffffffffc20ee4f0) 00010000:00010000:2.0:1789366651.987398:0:7132:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9800/0x8da3486b955f38cd lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xe1916000 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366651.987403:0:7132:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9800/0x8da3486b955f38cd lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xe1916000 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366651.987413:0:7132:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0xe1916000 (ffff9638a7404800) 00010000:00010000:2.0:1789366651.987416:0:7132:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789366651.987418:0:7132:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9800/0x8da3486b955f38cd lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0xe1916000 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366651.987424:0:7132:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9800/0x8da3486b955f38cd lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0xe1916000 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789366651.987498:0:7132:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638a74c9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0ab23baa-a205-44ad-bf17-f7b47295d82b+56:10541:x1876286751429632:12345-192.168.202.23@tcp:36:lhsmtool_posix.0 Request processed in 467us (638us total) trans 0 rc -2/-2 00000100:00100000:2.0:1789366651.987506:0:7132:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 117 00000100:00100000:3.0:1789366651.989289:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:1.0:1789366651.989349:0:7614:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751429760 00000100:00100000:1.0:1789366651.989357:0:7614:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751429760 00000100:00100000:1.0:1789366651.989398:0:7614:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 118 00000100:00100000:1.0:1789366651.989404:0:7614:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638af2d4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0ab23baa-a205-44ad-bf17-f7b47295d82b+56:10541:x1876286751429760:12345-192.168.202.23@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789366651.989416:0:7614:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789366651.989430:0:7614:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9638b6ce3600/0x8da3486b955f38d4 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xda917a494d06c13a expref: -99 pid: 7614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366651.989454:0:7614:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9638b6ce2a00/0x8da3486b955f38db lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7614 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366651.989463:0:7614:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9638b6ce2a00/0x8da3486b955f38db lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7614 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366651.989473:0:7614:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9638b6ce2a00/0x8da3486b955f38db lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7614 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366651.989554:0:7614:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9638b6ce3600/0x8da3486b955f38d4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.23@tcp remote: 0xda917a494d06c13a expref: 58 pid: 7614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366651.989570:0:7614:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9638b6ce2a00/0x8da3486b955f38db lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.23@tcp remote: 0xda917a494d06c13a expref: 57 pid: 7614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366651.989578:0:7614:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff963887f88600) 00010000:00010000:1.0:1789366651.989580:0:7614:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1789366651.989583:0:7614:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9638b6ce2a00, rc 0) 00000100:00100000:1.0:1789366651.989676:0:7614:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638af2d4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0ab23baa-a205-44ad-bf17-f7b47295d82b+57:10541:x1876286751429760:12345-192.168.202.23@tcp:101:lhsmtool_posix.0 Request processed in 271us (391us total) trans 0 rc 0/0 00000100:00100000:1.0:1789366651.989683:0:7614:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 118 00000100:00100000:1.0:1789366651.991045:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:0.0:1789366651.991142:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751430016 00000100:00100000:0.0:1789366651.991149:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751430016 00000100:00100000:0.0:1789366651.991213:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 119 00000100:00100000:0.0:1789366651.991222:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963882ee1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0ab23baa-a205-44ad-bf17-f7b47295d82b+57:10541:x1876286751430016:12345-192.168.202.23@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1789366651.991305:0:5816:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720c000/0x8da3486b955f38e2 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366651.991329:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720c000/0x8da3486b955f38e2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366651.991338:0:5816:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720c000/0x8da3486b955f38e2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1789366651.991554:0:5816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].5, 88 off8560 00000004:00080000:0.0:1789366651.991564:0:5816:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 227455845075ns, next at 228455842959ns, rc = 0 00000004:00010000:0.0:1789366651.991643:0:5816:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000033d90060 reply state 00000000ed6fe41a transno 4294967399 ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720c000/0x8da3486b955f38e2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789366651.991653:0:5816:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789366651.991746:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963882ee1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0ab23baa-a205-44ad-bf17-f7b47295d82b+59:10541:x1876286751430016:12345-192.168.202.23@tcp:36:lhsmtool_posix.0 Request processed in 525us (703us total) trans 4294967399 rc 0/0 00000100:00100000:0.0:1789366651.991754:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 119 00010000:00010000:2.0:1789366651.992648:0:3271:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720c000/0x8da3486b955f38e2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366651.992671:0:3271:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720c000/0x8da3486b955f38e2 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366651.992678:0:3271:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720c000/0x8da3486b955f38e2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366651.992684:0:3271:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9638b720c000 already unused, calling callback (ffffffffc20ee4f0) 00010000:00010000:2.0:1789366651.992689:0:3271:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720c000/0x8da3486b955f38e2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366651.992697:0:3271:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720c000/0x8da3486b955f38e2 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366651.992711:0:3271:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff963887f88600) 00010000:00010000:2.0:1789366651.992714:0:3271:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1789366651.992805:0:3271:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720c000/0x8da3486b955f38e2 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366651.992812:0:3271:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720c000/0x8da3486b955f38e2 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789366651.993919:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:2.0:1789366651.993953:0:7132:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751430144 00000100:00100000:2.0:1789366651.993961:0:7132:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751430144 00000100:00100000:2.0:1789366651.994018:0:7132:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 120 00000100:00100000:2.0:1789366651.994028:0:7132:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963882ee0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0ab23baa-a205-44ad-bf17-f7b47295d82b+58:10541:x1876286751430144:12345-192.168.202.23@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789366651.994048:0:7132:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789366651.994061:0:7132:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9a00/0x8da3486b955f38e9 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xda917a494d06c141 expref: -99 pid: 7132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366651.994102:0:7132:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9a00/0x8da3486b955f38e9 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.23@tcp remote: 0xda917a494d06c141 expref: 59 pid: 7132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366651.994253:0:7132:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9a00/0x8da3486b955f38e9 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.23@tcp remote: 0xda917a494d06c141 expref: 59 pid: 7132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366651.994284:0:7132:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff963887f88600) 00010000:00010000:2.0:1789366651.994288:0:7132:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789366651.994291:0:7132:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9638902c9a00, rc 0) 00000100:00100000:2.0:1789366651.994350:0:7132:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963882ee0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0ab23baa-a205-44ad-bf17-f7b47295d82b+59:10541:x1876286751430144:12345-192.168.202.23@tcp:101:lhsmtool_posix.0 Request processed in 323us (432us total) trans 0 rc 0/0 00000100:00100000:2.0:1789366651.994357:0:7132:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 120 00000100:00100000:0.0:1789366651.997073:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:2.0:1789366651.997177:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751430272 00000100:00100000:2.0:1789366651.997186:0:6661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751430272 00000100:00100000:2.0:1789366651.997243:0:6661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 37 00000100:00100000:2.0:1789366651.997253:0:6661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638a74cbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0ab23baa-a205-44ad-bf17-f7b47295d82b+8:2354:x1876286751430272:12345-192.168.202.23@tcp:2:lhsmtool_posix.0 00000100:00100000:2.0:1789366651.997508:0:6661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638a74cbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0ab23baa-a205-44ad-bf17-f7b47295d82b+9:2354:x1876286751430272:12345-192.168.202.23@tcp:2:lhsmtool_posix.0 Request processed in 256us (441us total) trans 4294967307 rc 0/0 00000100:00100000:2.0:1789366651.997517:0:6661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 37 00000100:00100000:1.0:1789366651.999462:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:2.0:1789366651.999510:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751430528 00000100:00100000:2.0:1789366651.999517:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751430528 00000100:00100000:2.0:1789366651.999562:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 30 00000100:00100000:2.0:1789366651.999572:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963882ee2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0ab23baa-a205-44ad-bf17-f7b47295d82b+59:10541:x1876286751430528:12345-192.168.202.23@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1789366651.999832:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963882ee2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0ab23baa-a205-44ad-bf17-f7b47295d82b+60:10541:x1876286751430528:12345-192.168.202.23@tcp:35:lhsmtool_posix.0 Request processed in 261us (373us total) trans 4294967400 rc 0/0 00000100:00100000:2.0:1789366651.999841:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 30 00000100:00100000:1.0:1789366652.001411:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:2.0:1789366652.001461:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751430784 00000100:00100000:2.0:1789366652.001482:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751430784 00000100:00080000:0.0:1789366652.001536:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789366652.001542:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 121 00000100:00100000:2.0:1789366652.001551:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963882ee0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0ab23baa-a205-44ad-bf17-f7b47295d82b+60:10541:x1876286751430784:12345-192.168.202.23@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1789366652.001633:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963882ee0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0ab23baa-a205-44ad-bf17-f7b47295d82b+60:10541:x1876286751430784:12345-192.168.202.23@tcp:57:lhsmtool_posix.0 Request processed in 84us (226us total) trans 0 rc 0/0 00000100:00100000:2.0:1789366652.001638:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 121 00000100:00100000:0.0:1789366652.002791:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:2.0:1789366652.002839:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751430912 00000100:00100000:2.0:1789366652.002846:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751430912 00000100:00100000:2.0:1789366652.002892:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 122 00000100:00100000:2.0:1789366652.002901:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638a74c9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0ab23baa-a205-44ad-bf17-f7b47295d82b+60:10541:x1876286751430912:12345-192.168.202.23@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789366652.002914:0:5816:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789366652.002939:0:5816:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9800/0x8da3486b955f38f0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xda917a494d06c148 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366652.002996:0:5816:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c8000/0x8da3486b955f38f7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366652.003021:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c8000/0x8da3486b955f38f7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366652.003033:0:5816:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c8000/0x8da3486b955f38f7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789366652.003066:0:5816:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1789366652.003082:0:5816:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c8000/0x8da3486b955f38f7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366652.003104:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9800/0x8da3486b955f38f0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.23@tcp remote: 0xda917a494d06c148 expref: 62 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366652.003145:0:5816:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c8000/0x8da3486b955f38f7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.23@tcp remote: 0xda917a494d06c148 expref: 61 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366652.003154:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff963887f88600) 00010000:00010000:2.0:1789366652.003157:0:5816:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1789366652.003160:0:5816:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9638902c8000, rc 0) 00000100:00100000:2.0:1789366652.003197:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638a74c9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0ab23baa-a205-44ad-bf17-f7b47295d82b+61:10541:x1876286751430912:12345-192.168.202.23@tcp:101:lhsmtool_posix.0 Request processed in 297us (409us total) trans 0 rc 0/0 00000100:00100000:2.0:1789366652.003217:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 122 00000100:00100000:1.0:1789366652.007929:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:0.0:1789366652.008011:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751431040 00000100:00100000:0.0:1789366652.008019:0:6660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751431040 00000100:00100000:0.0:1789366652.008068:0:6660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 38 00000100:00100000:0.0:1789366652.008077:0:6660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963882ee2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0ab23baa-a205-44ad-bf17-f7b47295d82b+9:2355:x1876286751431040:12345-192.168.202.23@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789366652.008093:0:6660:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789366652.008108:0:6660:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000087a2e4dd/0x8da3486b955f38fe lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda917a494d06c14f expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789366652.008135:0:6660:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6aa7917c, blocks: 0x1 00010000:00010000:0.0:1789366652.008167:0:6660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=227s v=(0 0) 00010000:00010000:0.0:1789366652.008172:0:6660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789366652.008182:0:6660:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000087a2e4dd/0x8da3486b955f38fe lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.23@tcp remote: 0xda917a494d06c14f expref: 10 pid: 6660 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366652.008197:0:6660:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000087a2e4dd/0x8da3486b955f38fe lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.23@tcp remote: 0xda917a494d06c14f expref: 10 pid: 6660 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366652.008207:0:6660:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9638b720cc00, rc 0) 00000100:00100000:0.0:1789366652.008269:0:6660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963882ee2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0ab23baa-a205-44ad-bf17-f7b47295d82b+10:2355:x1876286751431040:12345-192.168.202.23@tcp:101:lhsmtool_posix.0 Request processed in 194us (351us total) trans 0 rc 0/0 00000100:00100000:0.0:1789366652.008274:0:6660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 38 00000100:00080000:2.0:1789366652.009524:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789366652.014876:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:2.0:1789366652.014914:0:7132:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751431296 00000100:00100000:2.0:1789366652.014923:0:7132:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751431296 00000100:00100000:2.0:1789366652.014969:0:7132:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 123 00000100:00100000:2.0:1789366652.014975:0:7132:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638af2d5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0ab23baa-a205-44ad-bf17-f7b47295d82b+61:10541:x1876286751431296:12345-192.168.202.23@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1789366652.015080:0:7132:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638af2d5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0ab23baa-a205-44ad-bf17-f7b47295d82b+61:10541:x1876286751431296:12345-192.168.202.23@tcp:57:lhsmtool_posix.0 Request processed in 104us (211us total) trans 0 rc 0/0 00000100:00100000:2.0:1789366652.015088:0:7132:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 123 00000100:00100000:1.0:1789366652.016173:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:0.0:1789366652.016244:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751431424 00000100:00100000:0.0:1789366652.016251:0:6659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751431424 00000100:00100000:0.0:1789366652.016294:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 39 00000100:00100000:0.0:1789366652.016304:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963882ee1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0ab23baa-a205-44ad-bf17-f7b47295d82b+10:10541:x1876286751431424:12345-192.168.202.23@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789366652.016325:0:6659:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789366652.016344:0:6659:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000013c60a53/0x8da3486b955f3905 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda917a494d06c156 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366652.016380:0:6659:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000087a2e4dd/0x8da3486b955f38fe lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.23@tcp remote: 0xda917a494d06c14f expref: 11 pid: 6660 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366652.016387:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789366652.016390:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789366652.016395:0:6659:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000013c60a53/0x8da3486b955f3905 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.23@tcp remote: 0xda917a494d06c156 expref: 11 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366652.016429:0:6659:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000087a2e4dd/0x8da3486b955f38fe lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.23@tcp remote: 0xda917a494d06c14f expref: 11 pid: 6660 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366652.016442:0:6659:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000087a2e4dd/0x8da3486b955f38fe lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.23@tcp remote: 0xda917a494d06c14f expref: 11 pid: 6660 timeout: 327 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789366652.016455:0:6659:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9638a74c9500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6659:1876286758774912:192.168.202.23@tcp:104: 00000100:00100000:0.0:1789366652.016525:0:6659:0:(client.c:2716:ptlrpc_set_wait()) set ffff9638b70ff000 going to sleep for 11 seconds 00000100:00100000:0.0:1789366652.017551:0:6659:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9638a74c9500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6659:1876286758774912:192.168.202.23@tcp:104: 00010000:00010000:0.0:1789366652.017578:0:6659:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000013c60a53/0x8da3486b955f3905 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.23@tcp remote: 0xda917a494d06c156 expref: 11 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366652.017594:0:6659:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9638b720ca00, rc 0) 00000100:00100000:0.0:1789366652.017651:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963882ee1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0ab23baa-a205-44ad-bf17-f7b47295d82b+11:10541:x1876286751431424:12345-192.168.202.23@tcp:101:lhsmtool_posix.0 Request processed in 1349us (1478us total) trans 0 rc 0/0 00000100:00100000:0.0:1789366652.017658:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 39 00000100:00100000:3.0:1789366652.017937:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:0.0:1789366652.017982:0:8419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751431552 00000100:00100000:0.0:1789366652.017988:0:8419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751431552 00010000:00010000:0.0:1789366652.018009:0:8419:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000087a2e4dd/0x8da3486b955f38fe lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.23@tcp remote: 0xda917a494d06c14f expref: 11 pid: 6660 timeout: 327 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789366652.018041:0:8419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 54 00000100:00100000:0.0:1789366652.018049:0:8419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638bfef8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0ab23baa-a205-44ad-bf17-f7b47295d82b+11:2354:x1876286751431552:12345-192.168.202.23@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789366652.018059:0:8419:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789366652.018080:0:8419:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000087a2e4dd/0x8da3486b955f38fe lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.23@tcp remote: 0xda917a494d06c14f expref: 11 pid: 6660 timeout: 327 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366652.018092:0:8419:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000087a2e4dd/0x8da3486b955f38fe lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.23@tcp remote: 0xda917a494d06c14f expref: 11 pid: 6660 timeout: 327 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366652.018112:0:8419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000087a2e4dd/0x8da3486b955f38fe lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.23@tcp remote: 0xda917a494d06c14f expref: 11 pid: 6660 timeout: 327 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366652.018133:0:8419:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789366652.018137:0:8419:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789366652.018144:0:8419:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000013c60a53/0x8da3486b955f3905 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.23@tcp remote: 0xda917a494d06c156 expref: 10 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366652.018153:0:8419:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000013c60a53/0x8da3486b955f3905 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.23@tcp remote: 0xda917a494d06c156 expref: 10 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366652.018186:0:8419:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 0000000013c60a53/0x8da3486b955f3905 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.23@tcp remote: 0xda917a494d06c156 expref: 10 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789366652.018197:0:8419:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9638a74c9500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8419:1876286758775040:192.168.202.23@tcp:105: 00000100:00100000:0.0:1789366652.018255:0:8419:0:(client.c:2716:ptlrpc_set_wait()) set ffff9638b70ff000 going to sleep for 11 seconds 00000100:00100000:0.0:1789366652.019247:0:8419:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9638a74c9500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8419:1876286758775040:192.168.202.23@tcp:105: 00010000:00010000:0.0:1789366652.019261:0:8419:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789366652.019296:0:8419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638bfef8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0ab23baa-a205-44ad-bf17-f7b47295d82b+10:2354:x1876286751431552:12345-192.168.202.23@tcp:103:ldlm_bl.0 Request processed in 1246us (1359us total) trans 0 rc 0/0 00000100:00100000:0.0:1789366652.019305:0:8419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 54 00000100:00100000:1.0:1789366652.020084:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:3.0:1789366652.020133:0:6666:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751431680 00000100:00100000:3.0:1789366652.020140:0:6666:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751431680 00002000:00100000:3.0:1789366652.020175:0:6666:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x4:0x0] (0->12) req@ffff963882ee1180 x1876286751431680/t0(0) o4->0ab23baa-a205-44ad-bf17-f7b47295d82b@192.168.202.23@tcp:53/0 lens 504/0 e 0 to 0 dl 1789366663 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789366652.020185:0:6666:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff963882ee1180 with x1876286751431680 ext(0->12) 00002000:00010000:3.0:1789366652.020189:0:6666:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff963882ee1180 00000100:00100000:3.0:1789366652.020212:0:6666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 2 00000100:00100000:3.0:1789366652.020245:0:6666:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963882ee1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0ab23baa-a205-44ad-bf17-f7b47295d82b+10:2355:x1876286751431680:12345-192.168.202.23@tcp:4:lhsmtool_posix.0 00000100:00100000:3.0:1789366652.021006:0:6666:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963882ee1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0ab23baa-a205-44ad-bf17-f7b47295d82b+12:2355:x1876286751431680:12345-192.168.202.23@tcp:4:lhsmtool_posix.0 Request processed in 777us (914us total) trans 4294967308 rc 0/0 00000100:00100000:3.0:1789366652.021014:0:6666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 2 00002000:00100000:3.0:1789366652.021021:0:6666:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x4:0x0] (0->12) req@ffff963882ee1180 x1876286751431680/t4294967308(0) o4->0ab23baa-a205-44ad-bf17-f7b47295d82b@192.168.202.23@tcp:53/0 lens 504/448 e 0 to 0 dl 1789366663 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789366652.021035:0:6666:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff963882ee1180 with x1876286751431680 ext(0->12) 00002000:00010000:3.0:1789366652.021038:0:6666:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff963882ee1180 00000100:00100000:3.0:1789366652.023200:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:2.0:1789366652.023254:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751431808 00000100:00100000:2.0:1789366652.023262:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751431808 00000100:00100000:2.0:1789366652.023320:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 124 00000100:00100000:2.0:1789366652.023330:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638bfef9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0ab23baa-a205-44ad-bf17-f7b47295d82b+61:10541:x1876286751431808:12345-192.168.202.23@tcp:44:lhsmtool_posix.0 00000001:00080000:0.0:1789366652.044564:0:5837:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967399 is committed 00000004:00080000:0.0:1789366652.044575:0:5837:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 6 committed 00000004:00080000:0.0:1789366652.044600:0:5837:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 4 committed 00000020:00080000:0.0:1789366652.044623:0:5837:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9638b70ffa80 refcount 2 committed 0 result 0 batchid 3 00000020:00080000:0.0:1789366652.044628:0:5837:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9638906b0300 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9638b70ffe40 00000020:00080000:0.0:1789366652.044632:0:5837:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9638906b0400 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9638852b7c00 00000020:00080000:0.0:1789366652.044662:0:5837:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9638b70fff00 refcount 2 committed 0 result 0 batchid 2 00000020:00080000:0.0:1789366652.044666:0:5837:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9638906b0900 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9638b70ffc00 00000020:00080000:0.0:1789366652.044668:0:5837:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9638906b0500 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9638aeee8c00 00000001:00080000:0.0:1789366652.044692:0:5837:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967400 is committed 00000004:00080000:0.0:1789366652.044710:0:5837:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 5 committed 00000100:00100000:3.0:1789366652.044712:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638bfef9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0ab23baa-a205-44ad-bf17-f7b47295d82b+31:10541:x1876286751431808:12345-192.168.202.23@tcp:44:lhsmtool_posix.0 Request processed in 21377us (21510us total) trans 0 rc 0/0 00000100:00100000:3.0:1789366652.044750:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 124 00000100:00100000:1.0:1789366652.044809:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff963882ee1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3285:1876286758775168:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1789366652.044870:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789366652.044924:0:8065:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286758775168 00000100:00100000:0.0:1789366652.044932:0:8065:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286758775168 00000100:00100000:0.0:1789366652.044989:0:8065:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1789366652.045054:0:8065:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963882ee0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3285:x1876286758775168:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1789366652.045075:0:8065:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:3 count 1 00000100:00100000:2.0:1789366652.045087:0:3286:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9638b7352a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3286:1876286758775296:0@lo:6:osp-syn-0-0.0 00002000:00010000:0.0:1789366652.045103:0:8065:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3:0x0] initial LVB size: 9, mtime: 0x6aa7917b, atime: 0x6aa7917b, ctime: 0x6aa7917b, blocks: 0xb 00010000:00010000:0.0:1789366652.045110:0:8065:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000087a2e4dd/0x8da3486b955f390c lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789366652.045121:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789366652.045125:0:8065:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=227s v=(0 0) 00010000:00010000:0.0:1789366652.045131:0:8065:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789366652.045138:0:8065:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000087a2e4dd/0x8da3486b955f390c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789366652.045151:0:3286:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00010000:00010000:0.0:1789366652.045156:0:8065:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000087a2e4dd/0x8da3486b955f390c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789366652.045165:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286758775296 00000100:00100000:2.0:1789366652.045167:0:3286:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9638b7352680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3286:1876286758775424:0@lo:2:osp-syn-0-0.0 00010000:00010000:0.0:1789366652.045171:0:8065:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000087a2e4dd/0x8da3486b955f390c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789366652.045172:0:6661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286758775296 00010000:00010000:0.0:1789366652.045181:0:8065:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000087a2e4dd/0x8da3486b955f390c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789366652.045195:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789366652.045197:0:8065:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1789366652.045220:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286758775424 00000100:00100000:1.0:1789366652.045241:0:6661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286758775424 00000100:00080000:2.0:1789366652.045243:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789366652.045264:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000020:00080000:3.0:1789366652.045510:0:5848:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 3 committed batchid 1 00000100:00100000:0.0:1789366652.045772:0:8065:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963882ee0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3285:x1876286758775168:12345-0@lo:6:osp-syn-1-0.0 Request processed in 776us (902us total) trans 4294967304 rc 0/0 00000100:00100000:0.0:1789366652.045781:0:8065:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1789366652.045796:0:8065:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1789366652.045802:0:8065:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638b7351500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3286:x1876286758775424:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1789366652.045884:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638b7350a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3286:x1876286758775296:12345-0@lo:6:osp-syn-0-0.0 00002000:00010000:0.0:1789366652.045910:0:8065:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:0.0:1789366652.045914:0:8065:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb mtime from disk: 0 -> 1789366652 00002000:00010000:0.0:1789366652.045917:0:8065:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1789366652.045919:0:8065:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb ctime from disk: 1789366652 -> 1789366652 00002000:00010000:0.0:1789366652.045921:0:8065:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:0.0:1789366652.045954:0:8065:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638b7351500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+8:3286:x1876286758775424:12345-0@lo:2:osp-syn-0-0.0 Request processed in 152us (759us total) trans 4294967309 rc 0/0 00000100:00100000:0.0:1789366652.045961:0:8065:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00010000:00010000:0.0:1789366652.045979:0:5805:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789366652.045986:0:5805:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000087a2e4dd/0x8da3486b955f390c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366652.046007:0:5805:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9638b720cc00 already unused, calling callback (ffffffffc16df520) 00010000:00010000:0.0:1789366652.046011:0:5805:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000087a2e4dd/0x8da3486b955f390c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366652.046020:0:5805:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000087a2e4dd/0x8da3486b955f390c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366652.046039:0:5805:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000087a2e4dd/0x8da3486b955f390c lrc: 1/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366652.046047:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000087a2e4dd/0x8da3486b955f390c lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789366652.046060:0:3285:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967303 gen 2 00000004:00080000:1.0:1789366652.046066:0:3285:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967300 committed transno 4294967303 00010000:00010000:0.0:1789366652.046068:0:5805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789366652.046071:0:5805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789366652.046081:0:5805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1789366652.046085:0:3285:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9638b702c700, transno 4294967301 00000004:00080000:1.0:1789366652.046098:0:3285:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967303 committed transno 4294967303 00000100:00100000:1.0:1789366652.046111:0:3285:0:(client.c:3170:ptlrpc_free_committed()) @@@ stopping search req@ffff963882ee1500 x1876286758775168/t4294967304(4294967304) o6->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1789366668 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:1.0:1789366652.046123:0:3285:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff963882ee1500/2, rc 0, transno 4294967304 00000100:00100000:1.0:1789366652.046129:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff963882ee1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3285:1876286758775168:0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1789366652.046175:0:6659:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:3 count 1 00010000:00010000:2.0:1789366652.046191:0:6659:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c9ac16d1/0x8da3486b955f3913 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366652.046206:0:6659:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000066014cc1/0x8da3486b955f36ce lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.202.23@tcp remote: 0xda917a494d06c0b5 expref: 11 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366652.046216:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x3:0x0].0x0 since=2s v=(0 0) 00010000:00010000:2.0:1789366652.046220:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789366652.046236:0:6659:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c9ac16d1/0x8da3486b955f3913 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366652.046264:0:6659:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000066014cc1/0x8da3486b955f36ce lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.202.23@tcp remote: 0xda917a494d06c0b5 expref: 11 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366652.046279:0:6659:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000066014cc1/0x8da3486b955f36ce lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.202.23@tcp remote: 0xda917a494d06c0b5 expref: 11 pid: 6661 timeout: 327 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789366652.046291:0:6659:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9638b7351180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6659:1876286758775552:192.168.202.23@tcp:104: 00000100:00100000:2.0:1789366652.046341:0:6659:0:(client.c:2716:ptlrpc_set_wait()) set ffff963891fac0c0 going to sleep for 11 seconds 00000004:00080000:2.0:1789366652.046360:0:3286:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9638b7352680/2, rc 0, transno 4294967309 00000100:00100000:2.0:1789366652.046370:0:3286:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9638b7352680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3286:1876286758775424:0@lo:2:osp-syn-0-0.0 00000020:00080000:3.0:1789366652.046439:0:5848:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000100:00100000:1.0:1789366652.052128:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:3.0:1789366652.052373:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751431936 00000100:00100000:3.0:1789366652.052383:0:6661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751431936 00000100:00100000:3.0:1789366652.052437:0:6661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 43 00000100:00100000:3.0:1789366652.052447:0:6661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963882ee2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0ab23baa-a205-44ad-bf17-f7b47295d82b+12:2354:x1876286751431936:12345-192.168.202.23@tcp:16:lhsmtool_posix.0 00000100:00100000:0.0:1789366652.052456:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:0.0:1789366652.052480:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751432064 00000100:00100000:0.0:1789366652.052484:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751432064 00010000:00010000:0.0:1789366652.052504:0:5802:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000066014cc1/0x8da3486b955f36ce lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.202.23@tcp remote: 0xda917a494d06c0b5 expref: 13 pid: 6661 timeout: 327 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789366652.052528:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 55 00000100:00100000:0.0:1789366652.052535:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638a74c9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0ab23baa-a205-44ad-bf17-f7b47295d82b+13:2354:x1876286751432064:12345-192.168.202.23@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789366652.052543:0:5802:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789366652.052548:0:5802:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000066014cc1/0x8da3486b955f36ce lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.202.23@tcp remote: 0xda917a494d06c0b5 expref: 13 pid: 6661 timeout: 327 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366652.052559:0:5802:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000066014cc1/0x8da3486b955f36ce lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.202.23@tcp remote: 0xda917a494d06c0b5 expref: 13 pid: 6661 timeout: 327 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366652.052581:0:5802:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789366652.052585:0:5802:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789366652.052590:0:5802:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000c9ac16d1/0x8da3486b955f3913 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366652.052608:0:5802:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c9ac16d1/0x8da3486b955f3913 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366652.052626:0:5802:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789366652.052667:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638a74c9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0ab23baa-a205-44ad-bf17-f7b47295d82b+13:2354:x1876286751432064:12345-192.168.202.23@tcp:103:ldlm_bl.0 Request processed in 133us (216us total) trans 0 rc 0/0 00000100:00100000:0.0:1789366652.052686:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 55 00010000:00010000:2.0:1789366652.053694:0:6659:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000066014cc1/0x8da3486b955f36ce lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.202.23@tcp remote: 0xda917a494d06c0b5 expref: 12 pid: 6661 timeout: 327 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789366652.053713:0:6659:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9638b7351180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6659:1876286758775552:192.168.202.23@tcp:104: 00010000:00010000:2.0:1789366652.053771:0:6659:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000c9ac16d1/0x8da3486b955f3913 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366652.053782:0:6659:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000c9ac16d1/0x8da3486b955f3913 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366652.053789:0:6659:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c9ac16d1/0x8da3486b955f3913 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366652.053801:0:6659:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c9ac16d1/0x8da3486b955f3913 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366652.053810:0:6659:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c9ac16d1/0x8da3486b955f3913 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366652.053826:0:6659:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1789366652.054280:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638b7350a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+8:3286:x1876286758775296:12345-0@lo:6:osp-syn-0-0.0 Request processed in 9007us (9159us total) trans 4294967310 rc 0/0 00000100:00100000:2.0:1789366652.054288:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000004:00080000:2.0:1789366652.054325:0:3286:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9638b7352a00/2, rc 0, transno 4294967310 00000100:00100000:2.0:1789366652.054331:0:3286:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9638b7352a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3286:1876286758775296:0@lo:6:osp-syn-0-0.0 00010000:00010000:3.0:1789366652.056611:0:5804:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789366652.056623:0:5804:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c9ac16d1/0x8da3486b955f3913 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366652.056637:0:5804:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9638902c9800 already unused, calling callback (ffffffffc16df520) 00010000:00010000:3.0:1789366652.056642:0:5804:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c9ac16d1/0x8da3486b955f3913 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366652.056662:0:5804:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c9ac16d1/0x8da3486b955f3913 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366652.056681:0:5804:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c9ac16d1/0x8da3486b955f3913 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366652.056701:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c9ac16d1/0x8da3486b955f3913 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366652.056751:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789366652.056753:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789366652.056754:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1789366652.081209:0:6685:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967309 is committed 00000001:00080000:2.0:1789366652.081241:0:6685:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967306 is committed 00000001:00080000:2.0:1789366652.081253:0:6685:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967307 is committed 00000001:00080000:2.0:1789366652.081258:0:6685:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967308 is committed 00000100:00100000:3.0:1789366652.081383:0:6661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963882ee2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0ab23baa-a205-44ad-bf17-f7b47295d82b+6:2354:x1876286751431936:12345-192.168.202.23@tcp:16:lhsmtool_posix.0 Request processed in 28931us (29258us total) trans 0 rc 0/0 00000100:00100000:3.0:1789366652.081394:0:6661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 43 00000100:00100000:0.0:1789366652.085930:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:2.0:1789366652.087652:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751432320 00000100:00100000:2.0:1789366652.087664:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751432320 00000100:00100000:3.0:1789366652.087760:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 125 00000100:00100000:3.0:1789366652.087773:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638a74cb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0ab23baa-a205-44ad-bf17-f7b47295d82b+15:10541:x1876286751432320:12345-192.168.202.23@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1789366652.087826:0:5817:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789366652.087853:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c8000/0x8da3486b955f38f7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.23@tcp remote: 0xda917a494d06c148 expref: 15 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366652.087874:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff963887f88600) 00010000:00010000:3.0:1789366652.087880:0:5817:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789366652.087910:0:5817:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9638832d3c00/0x8da3486b955f391a lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366652.087924:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9638832d3c00/0x8da3486b955f391a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366652.087933:0:5817:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9638832d3c00/0x8da3486b955f391a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789366652.088127:0:5817:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000009a6e60f5 reply state 00000000f91bd02b transno 4294967401 ns: mdt-lustre-MDT0000_UUID lock: ffff9638832d3c00/0x8da3486b955f391a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789366652.088144:0:5817:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789366652.088245:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638a74cb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0ab23baa-a205-44ad-bf17-f7b47295d82b+16:10541:x1876286751432320:12345-192.168.202.23@tcp:36:lhsmtool_posix.0 Request processed in 457us (2306us total) trans 4294967401 rc 0/0 00000100:00100000:3.0:1789366652.088252:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 125 00010000:00010000:3.0:1789366652.089741:0:3270:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9638832d3c00/0x8da3486b955f391a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366652.089756:0:3270:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9638832d3c00/0x8da3486b955f391a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366652.089764:0:3270:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9638832d3c00/0x8da3486b955f391a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366652.089770:0:3270:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9638832d3c00 already unused, calling callback (ffffffffc20ee4f0) 00010000:00010000:3.0:1789366652.089775:0:3270:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9638832d3c00/0x8da3486b955f391a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366652.089783:0:3270:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9638832d3c00/0x8da3486b955f391a lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366652.089796:0:3270:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff963887f88600) 00010000:00010000:3.0:1789366652.089799:0:3270:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789366652.089804:0:3270:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9638832d3c00/0x8da3486b955f391a lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366652.089811:0:3270:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9638832d3c00/0x8da3486b955f391a lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789366652.093300:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:3.0:1789366652.093390:0:8065:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751432448 00000100:00100000:3.0:1789366652.093440:0:8065:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751432448 00000100:00100000:3.0:1789366652.093500:0:8065:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 44 00000100:00100000:3.0:1789366652.093507:0:8065:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638a74cad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0ab23baa-a205-44ad-bf17-f7b47295d82b+6:2355:x1876286751432448:12345-192.168.202.23@tcp:2:lhsmtool_posix.0 00002000:00010000:3.0:1789366652.093691:0:8065:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:3.0:1789366652.093695:0:8065:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb mtime from disk: 1789366652 -> 1789366651 00002000:00010000:3.0:1789366652.093698:0:8065:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb atime from disk: 0 -> 1789366651 00002000:00010000:3.0:1789366652.093700:0:8065:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb ctime from disk: 1789366652 -> 1789366651 00002000:00010000:3.0:1789366652.093702:0:8065:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:3.0:1789366652.093789:0:8065:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638a74cad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0ab23baa-a205-44ad-bf17-f7b47295d82b+7:2355:x1876286751432448:12345-192.168.202.23@tcp:2:lhsmtool_posix.0 Request processed in 281us (499us total) trans 4294967311 rc 0/0 00000100:00100000:3.0:1789366652.093797:0:8065:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 44 00000100:00100000:1.0:1789366652.099031:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:2.0:1789366652.099097:0:7132:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751432704 00000100:00100000:2.0:1789366652.099108:0:7132:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751432704 00000100:00100000:2.0:1789366652.099158:0:7132:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 126 00000100:00100000:2.0:1789366652.099168:0:7132:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963882ee3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0ab23baa-a205-44ad-bf17-f7b47295d82b+15:10541:x1876286751432704:12345-192.168.202.23@tcp:55:lhsmtool_posix.0 00010000:00010000:2.0:1789366652.099243:0:7132:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c8c00/0x8da3486b955f3921 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366652.099260:0:7132:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9638b6ce2a00/0x8da3486b955f38db lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.23@tcp remote: 0xda917a494d06c13a expref: 15 pid: 7614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366652.099270:0:7132:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c8c00/0x8da3486b955f3921 lrc: 4/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366652.099304:0:7132:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9638b6ce2a00/0x8da3486b955f38db lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.23@tcp remote: 0xda917a494d06c13a expref: 15 pid: 7614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366652.099314:0:7132:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9638b6ce2a00/0x8da3486b955f38db lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.23@tcp remote: 0xda917a494d06c13a expref: 15 pid: 7614 timeout: 327 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789366652.099324:0:7132:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9638b7351180 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7132:1876286758775680:192.168.202.23@tcp:104: 00000100:00100000:2.0:1789366652.099434:0:7132:0:(client.c:2716:ptlrpc_set_wait()) set ffff963891fac300 going to sleep for 11 seconds 00000100:00100000:2.0:1789366652.101791:0:7132:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9638b7351180 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7132:1876286758775680:192.168.202.23@tcp:104: 00010000:00010000:2.0:1789366652.101832:0:7132:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c8c00/0x8da3486b955f3921 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789366652.102602:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:2.0:1789366652.102668:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751432832 00000100:00100000:2.0:1789366652.102674:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751432832 00010000:00010000:2.0:1789366652.102702:0:5803:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9638b6ce2a00/0x8da3486b955f38db lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.23@tcp remote: 0xda917a494d06c13a expref: 16 pid: 7614 timeout: 327 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789366652.102775:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 56 00000100:00100000:2.0:1789366652.102785:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963882ee0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0ab23baa-a205-44ad-bf17-f7b47295d82b+16:2354:x1876286751432832:12345-192.168.202.23@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789366652.102798:0:5803:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789366652.102804:0:5803:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9638b6ce2a00/0x8da3486b955f38db lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.23@tcp remote: 0xda917a494d06c13a expref: 16 pid: 7614 timeout: 327 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366652.102817:0:5803:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9638b6ce2a00/0x8da3486b955f38db lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.23@tcp remote: 0xda917a494d06c13a expref: 16 pid: 7614 timeout: 327 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366652.102839:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9638b6ce2a00/0x8da3486b955f38db lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.23@tcp remote: 0xda917a494d06c13a expref: 16 pid: 7614 timeout: 327 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366652.102855:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff963887f88600) 00010000:00010000:2.0:1789366652.102859:0:5803:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c8c00/0x8da3486b955f3921 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366652.102867:0:5803:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c8c00/0x8da3486b955f3921 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366652.102875:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c8c00/0x8da3486b955f3921 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366652.102917:0:5803:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789366652.102959:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963882ee0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0ab23baa-a205-44ad-bf17-f7b47295d82b+15:2354:x1876286751432832:12345-192.168.202.23@tcp:103:ldlm_bl.0 Request processed in 175us (358us total) trans 0 rc 0/0 00000100:00100000:2.0:1789366652.102967:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 56 00010000:00010000:3.0:1789366652.103128:0:7132:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c8c00/0x8da3486b955f3921 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366652.103182:0:7132:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c8c00/0x8da3486b955f3921 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366652.103210:0:7132:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c8c00/0x8da3486b955f3921 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366652.103217:0:7132:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c8c00/0x8da3486b955f3921 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366652.103239:0:7132:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c8c00/0x8da3486b955f3921 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366652.103244:0:7132:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9638902c8c00 already unused, calling callback (ffffffffc20ee4f0) 00010000:00010000:3.0:1789366652.103248:0:7132:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c8c00/0x8da3486b955f3921 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366652.103255:0:7132:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c8c00/0x8da3486b955f3921 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366652.103277:0:7132:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff963887f88600) 00010000:00010000:3.0:1789366652.103280:0:7132:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:3.0:1789366652.103284:0:7132:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c8c00/0x8da3486b955f3921 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366652.103290:0:7132:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c8c00/0x8da3486b955f3921 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789366652.103341:0:7132:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963882ee3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0ab23baa-a205-44ad-bf17-f7b47295d82b+14:10541:x1876286751432704:12345-192.168.202.23@tcp:55:lhsmtool_posix.0 Request processed in 4170us (4314us total) trans 0 rc -22/-22 00000100:00100000:3.0:1789366652.103349:0:7132:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 126 00000100:00100000:1.0:1789366652.105210:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:2.0:1789366652.105376:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751432960 00000100:00100000:2.0:1789366652.105385:0:6659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751432960 00000100:00100000:2.0:1789366652.105442:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 45 00000100:00100000:2.0:1789366652.105452:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963882ee3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0ab23baa-a205-44ad-bf17-f7b47295d82b+7:2355:x1876286751432960:12345-192.168.202.23@tcp:1:lhsmtool_posix.0 00010000:00010000:2.0:1789366652.105494:0:6659:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000dce0b69e/0x8da3486b955f3928 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366652.105514:0:6659:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000013c60a53/0x8da3486b955f3905 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.23@tcp remote: 0xda917a494d06c156 expref: 7 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366652.105522:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789366652.105526:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789366652.105531:0:6659:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000dce0b69e/0x8da3486b955f3928 lrc: 4/1,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366652.105564:0:6659:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000013c60a53/0x8da3486b955f3905 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.23@tcp remote: 0xda917a494d06c156 expref: 7 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366652.105578:0:6659:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000013c60a53/0x8da3486b955f3905 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.23@tcp remote: 0xda917a494d06c156 expref: 7 pid: 6659 timeout: 327 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789366652.105593:0:6659:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9638b7351180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6659:1876286758775808:192.168.202.23@tcp:104: 00000100:00100000:2.0:1789366652.105675:0:6659:0:(client.c:2716:ptlrpc_set_wait()) set ffff963891fac300 going to sleep for 11 seconds 00000100:00100000:2.0:1789366652.109843:0:6659:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9638b7351180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6659:1876286758775808:192.168.202.23@tcp:104: 00010000:00010000:2.0:1789366652.109872:0:6659:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000dce0b69e/0x8da3486b955f3928 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789366652.112283:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:3.0:1789366652.112411:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751433088 00000100:00100000:3.0:1789366652.112421:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751433088 00010000:00010000:3.0:1789366652.112464:0:5801:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000013c60a53/0x8da3486b955f3905 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.23@tcp remote: 0xda917a494d06c156 expref: 8 pid: 6659 timeout: 327 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789366652.112513:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 57 00000100:00100000:3.0:1789366652.112526:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963882ee2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0ab23baa-a205-44ad-bf17-f7b47295d82b+8:2355:x1876286751433088:12345-192.168.202.23@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789366652.112544:0:5801:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789366652.112567:0:5801:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000013c60a53/0x8da3486b955f3905 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.23@tcp remote: 0xda917a494d06c156 expref: 8 pid: 6659 timeout: 327 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366652.112582:0:5801:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000013c60a53/0x8da3486b955f3905 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.23@tcp remote: 0xda917a494d06c156 expref: 8 pid: 6659 timeout: 327 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366652.112604:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000013c60a53/0x8da3486b955f3905 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.23@tcp remote: 0xda917a494d06c156 expref: 8 pid: 6659 timeout: 327 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366652.112643:0:5801:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789366652.112648:0:5801:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789366652.112654:0:5801:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000dce0b69e/0x8da3486b955f3928 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366652.112663:0:5801:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000dce0b69e/0x8da3486b955f3928 lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366652.112698:0:5801:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789366652.112792:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963882ee2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0ab23baa-a205-44ad-bf17-f7b47295d82b+7:2355:x1876286751433088:12345-192.168.202.23@tcp:103:ldlm_bl.0 Request processed in 267us (516us total) trans 0 rc 0/0 00000100:00100000:3.0:1789366652.112801:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 57 00010000:00010000:2.0:1789366652.112944:0:6659:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000dce0b69e/0x8da3486b955f3928 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366652.112954:0:6659:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000dce0b69e/0x8da3486b955f3928 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366652.112978:0:6659:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000dce0b69e/0x8da3486b955f3928 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366652.112986:0:6659:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000dce0b69e/0x8da3486b955f3928 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366652.112994:0:6659:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000dce0b69e/0x8da3486b955f3928 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366652.113000:0:6659:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9638902c8a00 already unused, calling callback (ffffffffc16df520) 00010000:00010000:2.0:1789366652.113010:0:6659:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000dce0b69e/0x8da3486b955f3928 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366652.113020:0:6659:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000dce0b69e/0x8da3486b955f3928 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366652.113043:0:6659:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000dce0b69e/0x8da3486b955f3928 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366652.113051:0:6659:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000dce0b69e/0x8da3486b955f3928 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789366652.113100:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963882ee3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0ab23baa-a205-44ad-bf17-f7b47295d82b+6:2355:x1876286751432960:12345-192.168.202.23@tcp:1:lhsmtool_posix.0 Request processed in 7650us (7897us total) trans 0 rc 0/0 00000100:00100000:2.0:1789366652.113108:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 45 00000100:00100000:1.0:1789366652.116932:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:3.0:1789366652.116985:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751433344 00000100:00100000:3.0:1789366652.116995:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751433344 00000100:00100000:3.0:1789366652.117046:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 127 00000100:00100000:3.0:1789366652.117057:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963882ee3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0ab23baa-a205-44ad-bf17-f7b47295d82b+14:10541:x1876286751433344:12345-192.168.202.23@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1789366652.117129:0:5815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9638832d3c00/0x8da3486b955f392f lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366652.117144:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9638832d3c00/0x8da3486b955f392f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366652.117157:0:5815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9638832d3c00/0x8da3486b955f392f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366652.117376:0:5815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9638832d3600/0x8da3486b955f3936 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366652.117409:0:5815:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9a00/0x8da3486b955f38e9 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.23@tcp remote: 0xda917a494d06c141 expref: 15 pid: 7132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366652.117418:0:5815:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9638832d3600/0x8da3486b955f3936 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366652.117447:0:5815:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9a00/0x8da3486b955f38e9 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.23@tcp remote: 0xda917a494d06c141 expref: 15 pid: 7132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366652.117458:0:5815:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9a00/0x8da3486b955f38e9 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.23@tcp remote: 0xda917a494d06c141 expref: 15 pid: 7132 timeout: 327 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789366652.117470:0:5815:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9638bfefbb80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5815:1876286758775936:192.168.202.23@tcp:104: 00000100:00100000:3.0:1789366652.117564:0:5815:0:(client.c:2716:ptlrpc_set_wait()) set ffff9638aef8cc00 going to sleep for 11 seconds 00000100:00100000:0.0:1789366652.119971:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:2.0:1789366652.120021:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751433472 00000100:00100000:2.0:1789366652.120029:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751433472 00010000:00010000:2.0:1789366652.120064:0:5803:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9a00/0x8da3486b955f38e9 lrc: 5/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.23@tcp remote: 0xda917a494d06c141 expref: 16 pid: 7132 timeout: 327 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789366652.120119:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 58 00000100:00100000:2.0:1789366652.120131:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638b4f18a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0ab23baa-a205-44ad-bf17-f7b47295d82b+16:2354:x1876286751433472:12345-192.168.202.23@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789366652.120144:0:5803:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789366652.120151:0:5803:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9a00/0x8da3486b955f38e9 lrc: 5/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.23@tcp remote: 0xda917a494d06c141 expref: 16 pid: 7132 timeout: 327 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366652.120164:0:5803:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9a00/0x8da3486b955f38e9 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.23@tcp remote: 0xda917a494d06c141 expref: 16 pid: 7132 timeout: 327 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366652.120185:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff963887f88600) 00010000:00010000:2.0:1789366652.120189:0:5803:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9638832d3600/0x8da3486b955f3936 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366652.120210:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9a00/0x8da3486b955f38e9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.23@tcp remote: 0xda917a494d06c141 expref: 16 pid: 7132 timeout: 327 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366652.120214:0:5803:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9638832d3600/0x8da3486b955f3936 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789366652.120253:0:5815:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9638bfefbb80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5815:1876286758775936:192.168.202.23@tcp:104: 00010000:00010000:2.0:1789366652.120344:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9638832d3600/0x8da3486b955f3936 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50290000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366652.120358:0:5815:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9638832d3600/0x8da3486b955f3936 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366652.120363:0:5803:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789366652.120371:0:5815:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9638832d3600/0x8da3486b955f3936 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366652.120378:0:5815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9638832d3600/0x8da3486b955f3936 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789366652.120415:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638b4f18a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0ab23baa-a205-44ad-bf17-f7b47295d82b+15:2354:x1876286751433472:12345-192.168.202.23@tcp:103:ldlm_bl.0 Request processed in 286us (447us total) trans 0 rc 0/0 00000100:00100000:2.0:1789366652.120423:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 58 00000001:00080000:3.0:1789366652.120541:0:5815:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967402 00000001:00080000:3.0:1789366652.121071:0:5815:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967403 00000001:00080000:3.0:1789366652.121120:0:5815:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967404 00000100:00100000:3.0:1789366652.121207:0:5815:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9638bfefbb80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5815:1876286758776064:0@lo:1000:mdt00_000.0 00000100:00100000:3.0:1789366652.121264:0:5815:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789366652.121298:0:5815:0:(client.c:2716:ptlrpc_set_wait()) set ffff9638aef8c540 going to sleep for 11 seconds 00000100:00100000:2.0:1789366652.121470:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286758776064 00000100:00100000:2.0:1789366652.121475:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286758776064 00000100:00100000:2.0:1789366652.121513:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1789366652.121520:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638bfef9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5815:x1876286758776064:12345-0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1789366652.121592:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638bfef9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5815:x1876286758776064:12345-0@lo:1000:mdt00_000.0 Request processed in 73us (328us total) trans 0 rc 0/0 00000100:00100000:2.0:1789366652.121599:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1789366652.121801:0:5815:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967309 gen 2 00000004:00080000:3.0:1789366652.121807:0:5815:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967305 committed transno 4294967309 00000004:00080000:3.0:1789366652.121825:0:5815:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9638b7352680, transno 4294967309 00000100:00100000:3.0:1789366652.121839:0:5815:0:(client.c:3170:ptlrpc_free_committed()) @@@ stopping search req@ffff9638b7352a00 x1876286758775296/t4294967310(4294967310) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1789366668 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789366652.121850:0:5815:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9638bfefbb80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5815:1876286758776064:0@lo:1000:mdt00_000.0 00000001:00080000:0.0:1789366652.122919:0:5815:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967405 00000100:00100000:0.0:1789366652.122977:0:5815:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9638b6cbe300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5815:1876286758776192:0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1789366652.123022:0:5815:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789366652.123057:0:5815:0:(client.c:2716:ptlrpc_set_wait()) set ffff9638b70ff240 going to sleep for 11 seconds 00000100:00100000:1.0:1789366652.123104:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286758776192 00000100:00100000:1.0:1789366652.123109:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286758776192 00000100:00100000:1.0:1789366652.123144:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1789366652.123153:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638af283480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5815:x1876286758776192:12345-0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1789366652.123323:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638af283480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:5815:x1876286758776192:12345-0@lo:1000:mdt00_000.0 Request processed in 171us (299us total) trans 4294967312 rc 0/0 00000100:00100000:1.0:1789366652.123330:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1789366652.123451:0:5815:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9638b6cbe300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5815:1876286758776192:0@lo:1000:mdt00_000.0 00010000:00010000:0.0:1789366652.123478:0:5815:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9638832d3600/0x8da3486b955f3936 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366652.123487:0:5815:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9638832d3600/0x8da3486b955f3936 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366652.123495:0:5815:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9638832d3600/0x8da3486b955f3936 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366652.123502:0:5815:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9638832d3600 already unused, calling callback (ffffffffc20ee4f0) 00010000:00010000:0.0:1789366652.123506:0:5815:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9638832d3600/0x8da3486b955f3936 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366652.123514:0:5815:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9638832d3600/0x8da3486b955f3936 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366652.123535:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff963887f88600) 00010000:00010000:0.0:1789366652.123538:0:5815:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1789366652.123542:0:5815:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9638832d3600/0x8da3486b955f3936 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366652.123559:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9638832d3600/0x8da3486b955f3936 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366652.123593:0:5815:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9638b6ce3a00/0x8da3486b955f3879 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 7614 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366652.123599:0:5815:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9638b6ce3a00/0x8da3486b955f3879 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 7614 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366652.123605:0:5815:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9638b6ce3a00/0x8da3486b955f3879 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 7614 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366652.123610:0:5815:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9638b6ce3a00 already unused, calling callback (ffffffffc20ee4f0) 00010000:00010000:0.0:1789366652.123613:0:5815:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9638b6ce3a00/0x8da3486b955f3879 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 7614 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366652.123618:0:5815:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9638b6ce3a00/0x8da3486b955f3879 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 7614 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366652.123627:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9638a7404a00) 00010000:00010000:0.0:1789366652.123629:0:5815:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1789366652.123636:0:5815:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720ce00/0x8da3486b955f3880 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.23@tcp remote: 0xda917a494d06c125 expref: 18 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366652.123647:0:5815:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720ce00/0x8da3486b955f3880 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.23@tcp remote: 0xda917a494d06c125 expref: 18 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366652.123669:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720ce00/0x8da3486b955f3880 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.23@tcp remote: 0xda917a494d06c125 expref: 18 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366652.123706:0:5815:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720ce00/0x8da3486b955f3880 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.23@tcp remote: 0xda917a494d06c125 expref: 18 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789366652.123735:0:5815:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9638af280000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5815:1876286758776320:192.168.202.23@tcp:105: 00000100:00100000:0.0:1789366652.123794:0:5815:0:(client.c:2716:ptlrpc_set_wait()) set ffff9638b70ff240 going to sleep for 11 seconds 00000100:00100000:2.0:1789366652.125703:0:5815:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9638af280000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5815:1876286758776320:192.168.202.23@tcp:105: 00010000:00010000:2.0:1789366652.125759:0:5815:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9638b6ce3a00/0x8da3486b955f3879 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 7614 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366652.125769:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9638b6ce3a00/0x8da3486b955f3879 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 7614 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366652.125800:0:5815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c8a00/0x8da3486b955f393d lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366652.125814:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c8a00/0x8da3486b955f393d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366652.125834:0:5815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c8a00/0x8da3486b955f393d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366652.125844:0:5815:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c8a00/0x8da3486b955f393d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366652.125850:0:5815:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c8a00/0x8da3486b955f393d lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366652.125857:0:5815:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c8a00/0x8da3486b955f393d lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366652.125862:0:5815:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9638902c8a00 already unused, calling callback (ffffffffc20ee4f0) 00010000:00010000:2.0:1789366652.125866:0:5815:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c8a00/0x8da3486b955f393d lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366652.125873:0:5815:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c8a00/0x8da3486b955f393d lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366652.125881:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9638a7404a00) 00010000:00010000:2.0:1789366652.125884:0:5815:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789366652.125887:0:5815:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c8a00/0x8da3486b955f393d lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366652.125893:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c8a00/0x8da3486b955f393d lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366652.125902:0:5815:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9638832d3c00/0x8da3486b955f392f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366652.125908:0:5815:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9638832d3c00/0x8da3486b955f392f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366652.125918:0:5815:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9638832d3c00/0x8da3486b955f392f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366652.125923:0:5815:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9638832d3c00 already unused, calling callback (ffffffffc20ee4f0) 00010000:00010000:2.0:1789366652.125926:0:5815:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9638832d3c00/0x8da3486b955f392f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366652.125932:0:5815:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9638832d3c00/0x8da3486b955f392f lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366652.125938:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9638a7404a00) 00010000:00010000:2.0:1789366652.125941:0:5815:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1789366652.125944:0:5815:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9638832d3c00/0x8da3486b955f392f lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366652.125950:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9638832d3c00/0x8da3486b955f392f lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789366652.126125:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963882ee3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0ab23baa-a205-44ad-bf17-f7b47295d82b+18:10541:x1876286751433344:12345-192.168.202.23@tcp:57:lhsmtool_posix.0 Request processed in 9070us (9198us total) trans 4294967406 rc 0/0 00000100:00100000:2.0:1789366652.126136:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 127 00000020:00080000:2.0:1789366652.126141:0:5815:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:3.0:1789366652.126182:0:11650:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1789366652.126188:0:11650:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1789366652.126241:0:11650:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 3 count 3 00000040:00080000:3.0:1789366652.126248:0:11650:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1789366652.126769:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:0.0:1789366652.126804:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751433600 00000100:00100000:0.0:1789366652.126810:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751433600 00000100:00100000:0.0:1789366652.126850:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 31 00000100:00100000:0.0:1789366652.126861:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963882ee0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0ab23baa-a205-44ad-bf17-f7b47295d82b+18:10540:x1876286751433600:12345-192.168.202.23@tcp:49:lfs.0 00000100:00100000:0.0:1789366652.126968:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963882ee0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0ab23baa-a205-44ad-bf17-f7b47295d82b+18:10540:x1876286751433600:12345-192.168.202.23@tcp:49:lfs.0 Request processed in 109us (199us total) trans 0 rc 0/0 00000100:00100000:0.0:1789366652.126976:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 31 00000100:00100000:1.0:1789366652.128264:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:1.0:1789366652.128342:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:2.0:1789366652.129055:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751433856 00000100:00100000:2.0:1789366652.129063:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751433856 00000100:00100000:2.0:1789366652.129111:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 32 00000100:00100000:2.0:1789366652.129120:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963888cb8450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0ab23baa-a205-44ad-bf17-f7b47295d82b+18:10541:x1876286751433856:12345-192.168.202.23@tcp:35:lhsmtool_posix.0 00000004:00080000:2.0:1789366652.129802:0:5818:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x9:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:2.0:1789366652.129923:0:5818:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967407 00010000:00010000:2.0:1789366652.129976:0:5818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c8200/0x8da3486b955f3944 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366652.129992:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c8200/0x8da3486b955f3944 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366652.130002:0:5818:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c8200/0x8da3486b955f3944 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366652.130011:0:5818:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c8200/0x8da3486b955f3944 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366652.130017:0:5818:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c8200/0x8da3486b955f3944 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366652.130025:0:5818:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c8200/0x8da3486b955f3944 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366652.130046:0:5818:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789366652.130091:0:6675:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789366652.130099:0:6675:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c8200/0x8da3486b955f3944 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366652.130107:0:6675:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9638902c8200 already unused, calling callback (ffffffffc16df520) 00010000:00010000:1.0:1789366652.130120:0:6675:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c8200/0x8da3486b955f3944 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366652.130130:0:6675:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c8200/0x8da3486b955f3944 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789366652.130132:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963888cb8450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0ab23baa-a205-44ad-bf17-f7b47295d82b+20:10541:x1876286751433856:12345-192.168.202.23@tcp:35:lhsmtool_posix.0 Request processed in 1011us (1867us total) trans 4294967408 rc 0/0 00000100:00100000:2.0:1789366652.130147:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 32 00010000:00010000:1.0:1789366652.130151:0:6675:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9638a7404800) 00000020:00080000:2.0:1789366652.130153:0:5818:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1789366652.130156:0:6675:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1789366652.130161:0:6675:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c8200/0x8da3486b955f3944 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366652.130168:0:6675:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c8200/0x8da3486b955f3944 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366652.130198:0:6675:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789366652.130201:0:6675:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789366652.130203:0:6675:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789366652.130485:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751434112 00000100:00100000:3.0:1789366652.130491:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751434112 00000100:00100000:3.0:1789366652.130530:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 128 00000100:00100000:3.0:1789366652.130539:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963882ee1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0ab23baa-a205-44ad-bf17-f7b47295d82b+20:10540:x1876286751434112:12345-192.168.202.23@tcp:58:lfs.0 00000040:00080000:3.0:1789366652.130691:0:5817:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].3, 136 off8600 00000100:00100000:3.0:1789366652.130775:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963882ee1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0ab23baa-a205-44ad-bf17-f7b47295d82b+20:10540:x1876286751434112:12345-192.168.202.23@tcp:58:lfs.0 Request processed in 238us (2432us total) trans 0 rc 0/0 00000100:00100000:3.0:1789366652.130782:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 128 00000100:00100000:1.0:1789366652.154267:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:3.0:1789366652.154566:0:7132:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751434240 00000100:00100000:3.0:1789366652.154577:0:7132:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751434240 00000100:00100000:3.0:1789366652.154630:0:7132:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 129 00000100:00100000:3.0:1789366652.154640:0:7132:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963882ee2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0ab23baa-a205-44ad-bf17-f7b47295d82b+20:10543:x1876286751434240:12345-192.168.202.23@tcp:101:lfs.0 00010000:00010000:3.0:1789366652.154680:0:7132:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789366652.154701:0:7132:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9638832d3a00/0x8da3486b955f394b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xda917a494d06c15d expref: -99 pid: 7132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366652.154788:0:7132:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9638832d3400/0x8da3486b955f3952 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366652.154804:0:7132:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9638832d3400/0x8da3486b955f3952 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366652.154816:0:7132:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9638832d3400/0x8da3486b955f3952 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366652.154963:0:7132:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9638832d2000/0x8da3486b955f3959 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366652.154971:0:7132:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9638832d2000/0x8da3486b955f3959 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366652.154983:0:7132:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9638832d2000/0x8da3486b955f3959 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366652.155210:0:7132:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9638832d2200/0x8da3486b955f3960 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366652.155222:0:7132:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9638b6ce2600/0x8da3486b955f386b lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.23@tcp remote: 0xda917a494d06c11e expref: 21 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366652.155242:0:7132:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9638832d2200/0x8da3486b955f3960 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366652.155277:0:7132:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9638b6ce2600/0x8da3486b955f386b lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.23@tcp remote: 0xda917a494d06c11e expref: 21 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366652.155297:0:7132:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9638b6ce2600/0x8da3486b955f386b lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.23@tcp remote: 0xda917a494d06c11e expref: 21 pid: 5815 timeout: 327 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789366652.155376:0:7132:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9638bfefbb80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7132:1876286758776448:192.168.202.23@tcp:104: 00000100:00100000:3.0:1789366652.155512:0:7132:0:(client.c:2716:ptlrpc_set_wait()) set ffff9638aef8c000 going to sleep for 11 seconds 00000100:00100000:2.0:1789366652.162136:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:1.0:1789366652.162249:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751434496 00000100:00100000:1.0:1789366652.162258:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751434496 00000100:00100000:1.0:1789366652.162422:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 33 00000100:00100000:1.0:1789366652.162433:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638b7352680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0ab23baa-a205-44ad-bf17-f7b47295d82b+22:5581:x1876286751434496:12345-192.168.202.23@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1789366652.162670:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638b7352680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0ab23baa-a205-44ad-bf17-f7b47295d82b+23:5581:x1876286751434496:12345-192.168.202.23@tcp:35:ldlm_bl.0 Request processed in 238us (542us total) trans 4294967409 rc 0/0 00000100:00100000:1.0:1789366652.162677:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 33 00000100:00100000:3.0:1789366652.162795:0:7132:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9638bfefbb80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7132:1876286758776448:192.168.202.23@tcp:104: 00010000:00010000:3.0:1789366652.162821:0:7132:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9638832d2200/0x8da3486b955f3960 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789366652.164149:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:3.0:1789366652.164204:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751434624 00000100:00100000:3.0:1789366652.164212:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751434624 00010000:00010000:3.0:1789366652.164274:0:5801:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9638b6ce2600/0x8da3486b955f386b lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.23@tcp remote: 0xda917a494d06c11e expref: 23 pid: 5815 timeout: 327 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789366652.164315:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 59 00000100:00100000:3.0:1789366652.164325:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963882ee0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0ab23baa-a205-44ad-bf17-f7b47295d82b+23:2354:x1876286751434624:12345-192.168.202.23@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789366652.164337:0:5801:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789366652.164344:0:5801:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9638b6ce2600/0x8da3486b955f386b lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.23@tcp remote: 0xda917a494d06c11e expref: 23 pid: 5815 timeout: 327 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366652.164358:0:5801:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9638b6ce2600/0x8da3486b955f386b lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.23@tcp remote: 0xda917a494d06c11e expref: 23 pid: 5815 timeout: 327 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366652.164380:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9638b6ce2600/0x8da3486b955f386b lrc: 0/0,0 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.23@tcp remote: 0xda917a494d06c11e expref: 23 pid: 5815 timeout: 327 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366652.164415:0:5801:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9638a7404a00) 00010000:00010000:3.0:1789366652.164420:0:5801:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9638832d2200/0x8da3486b955f3960 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366652.164430:0:5801:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9638832d2200/0x8da3486b955f3960 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366652.164439:0:5801:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9638832d2200/0x8da3486b955f3960 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366652.164522:0:5801:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789366652.164565:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963882ee0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0ab23baa-a205-44ad-bf17-f7b47295d82b+22:2354:x1876286751434624:12345-192.168.202.23@tcp:103:ldlm_bl.0 Request processed in 241us (418us total) trans 0 rc 0/0 00000100:00100000:3.0:1789366652.164573:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 59 00010000:00010000:2.0:1789366652.164688:0:7132:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9638832d2200/0x8da3486b955f3960 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366652.164697:0:7132:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9638832d2200/0x8da3486b955f3960 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789366652.164908:0:7132:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:2.0:1789366652.164913:0:7132:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1789366652.164943:0:7132:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9638832d2200/0x8da3486b955f3960 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366652.164956:0:7132:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9638832d2200/0x8da3486b955f3960 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366652.164967:0:7132:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9638832d3400/0x8da3486b955f3952 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366652.164974:0:7132:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9638832d3400/0x8da3486b955f3952 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366652.164981:0:7132:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9638832d3400/0x8da3486b955f3952 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366652.164987:0:7132:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9638832d3400 already unused, calling callback (ffffffffc20ee4f0) 00010000:00010000:2.0:1789366652.164991:0:7132:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9638832d3400/0x8da3486b955f3952 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366652.165000:0:7132:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9638832d3400/0x8da3486b955f3952 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366652.165010:0:7132:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff963890797000) 00010000:00010000:2.0:1789366652.165013:0:7132:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789366652.165017:0:7132:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9638832d3400/0x8da3486b955f3952 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366652.165023:0:7132:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9638832d3400/0x8da3486b955f3952 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366652.165035:0:7132:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9638832d2000/0x8da3486b955f3959 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366652.165041:0:7132:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9638832d2000/0x8da3486b955f3959 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366652.165053:0:7132:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9638832d2000/0x8da3486b955f3959 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366652.165059:0:7132:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9638832d2000 already unused, calling callback (ffffffffc20ee4f0) 00010000:00010000:2.0:1789366652.165064:0:7132:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9638832d2000/0x8da3486b955f3959 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366652.165070:0:7132:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9638832d2000/0x8da3486b955f3959 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366652.165080:0:7132:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff96388c43f000) 00010000:00010000:2.0:1789366652.165083:0:7132:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789366652.165086:0:7132:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9638832d2000/0x8da3486b955f3959 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366652.165093:0:7132:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9638832d2000/0x8da3486b955f3959 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366652.165129:0:7132:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9638832d3a00/0x8da3486b955f394b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.23@tcp remote: 0xda917a494d06c15d expref: 22 pid: 7132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366652.165142:0:7132:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9638832d2200/0x8da3486b955f3960 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.23@tcp remote: 0xda917a494d06c15d expref: 21 pid: 7132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366652.165149:0:7132:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9638a7404a00) 00010000:00010000:2.0:1789366652.165151:0:7132:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789366652.165153:0:7132:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9638832d2200, rc 0) 00000100:00100000:2.0:1789366652.165191:0:7132:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963882ee2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0ab23baa-a205-44ad-bf17-f7b47295d82b+21:10543:x1876286751434240:12345-192.168.202.23@tcp:101:lfs.0 Request processed in 10553us (10935us total) trans 0 rc 0/0 00000100:00100000:2.0:1789366652.165206:0:7132:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 129 00000100:00100000:2.0:1789366652.627860:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:2.0:1789366652.627904:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:0.0:1789366652.627947:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751434752 00000100:00100000:0.0:1789366652.627956:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751434752 00000100:00100000:0.0:1789366652.628004:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 273 00000100:00100000:0.0:1789366652.628014:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638b4e80850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:14a2847b-91d8-4d87-b71b-010443acc91a+13:2355:x1876286751434752:12345-192.168.202.23@tcp:400:kworker.0 00000100:00100000:0.0:1789366652.628077:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638b4e80850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:14a2847b-91d8-4d87-b71b-010443acc91a+13:2355:x1876286751434752:12345-192.168.202.23@tcp:400:kworker.0 Request processed in 65us (227us total) trans 0 rc 0/0 00000100:00100000:0.0:1789366652.628085:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 273 00000100:00100000:2.0:1789366652.630126:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:2.0:1789366652.630413:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:2.0:1789366652.630493:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:1.0:1789366652.630533:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751435008 00000100:00100000:1.0:1789366652.630542:0:6660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751435008 00000100:00100000:2.0:1789366652.630557:0:8065:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751435136 00000100:00100000:1.0:1789366652.630587:0:6660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 50 00000100:00100000:2.0:1789366652.630613:0:8065:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751435136 00000100:00100000:2.0:1789366652.630650:0:8065:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 51 00000100:00100000:2.0:1789366652.630657:0:8065:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638af2d4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0ab23baa-a205-44ad-bf17-f7b47295d82b+5:2355:x1876286751435136:12345-192.168.202.23@tcp:400:kworker.0 00000100:00100000:2.0:1789366652.630714:0:8065:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638af2d4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0ab23baa-a205-44ad-bf17-f7b47295d82b+5:2355:x1876286751435136:12345-192.168.202.23@tcp:400:kworker.0 Request processed in 57us (221us total) trans 0 rc 0/0 00000100:00100000:2.0:1789366652.630738:0:8065:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 51 00000100:00080000:2.0:1789366652.630756:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789366652.630881:0:6660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638b7351180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0ab23baa-a205-44ad-bf17-f7b47295d82b+6:2355:x1876286751435008:12345-192.168.202.23@tcp:400:kworker.0 00000100:00100000:1.0:1789366652.630917:0:6660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638b7351180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0ab23baa-a205-44ad-bf17-f7b47295d82b+6:2355:x1876286751435008:12345-192.168.202.23@tcp:400:kworker.0 Request processed in 322us (3013us total) trans 0 rc 0/0 00000100:00100000:1.0:1789366652.630924:0:6660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 50 00000100:00100000:0.0:1789366652.631515:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751435264 00000100:00100000:0.0:1789366652.631521:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751435264 00000100:00100000:0.0:1789366652.631573:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751434880 00000100:00100000:0.0:1789366652.631576:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751434880 00000100:00100000:0.0:1789366652.631598:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 109 00000100:00100000:0.0:1789366652.631606:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638b7351f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b9764435-e52f-45ac-a5f9-bab1231105ac+5:2355:x1876286751435264:12345-192.168.202.23@tcp:400:kworker.0 00000100:00100000:0.0:1789366652.631643:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638b7351f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b9764435-e52f-45ac-a5f9-bab1231105ac+5:2355:x1876286751435264:12345-192.168.202.23@tcp:400:kworker.0 Request processed in 38us (1523us total) trans 0 rc 0/0 00000100:00100000:0.0:1789366652.631650:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 109 00000100:00100000:0.0:1789366652.631665:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 110 00000100:00100000:0.0:1789366652.631670:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638b7216a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0ab23baa-a205-44ad-bf17-f7b47295d82b+21:2355:x1876286751434880:12345-192.168.202.23@tcp:400:kworker.0 00000100:00100000:0.0:1789366652.631697:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638b7216a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0ab23baa-a205-44ad-bf17-f7b47295d82b+21:2355:x1876286751434880:12345-192.168.202.23@tcp:400:kworker.0 Request processed in 26us (1285us total) trans 0 rc 0/0 00000100:00100000:0.0:1789366652.631703:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 110 00000100:00080000:0.0:1789366652.631817:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000040:00080000:2.0:1789366652.647039:0:12065:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1789366652.647050:0:12065:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1789366652.647096:0:12065:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:2.0:1789366652.647101:0:12065:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1789366652.858527:0:3287:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9638af280700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3287:1876286758776960:0@lo:400:kworker.0 00000100:00100000:0.0:1789366652.858602:0:3287:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789366652.858670:0:3287:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789366652.858676:0:3287:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9638af281880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3287:1876286758776832:0@lo:400:kworker.0 00000100:00100000:0.0:1789366652.858703:0:3287:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789366652.858761:0:8065:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286758776960 00000100:00100000:0.0:1789366652.858768:0:8065:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286758776960 00000100:00100000:0.0:1789366652.858815:0:8065:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1789366652.858825:0:8065:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638af282680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3287:x1876286758776960:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789366652.858873:0:8065:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638af282680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3287:x1876286758776960:12345-0@lo:400:kworker.0 Request processed in 50us (272us total) trans 0 rc 0/0 00000100:00100000:0.0:1789366652.858881:0:8065:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1789366652.858926:0:3287:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9638af280700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3287:1876286758776960:0@lo:400:kworker.0 00000100:00100000:2.0:1789366652.859014:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9638af281f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8cde4528-5832-4854-a387-4adacc3dd0ab:3284:1876286758776576:0@lo:400:kworker.0 00000100:00100000:2.0:1789366652.859047:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789366652.859078:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9638af282d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3284:1876286758777088:0@lo:400:kworker.0 00000100:00100000:2.0:1789366652.859101:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789366652.859121:0:3284:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1789366652.859126:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9638af283b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3284:1876286758776704:0@lo:400:kworker.0 00000100:00100000:2.0:1789366652.859147:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789366652.859174:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9638af280a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3284:1876286758777216:0@lo:400:kworker.0 00000100:00100000:2.0:1789366652.859212:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789366652.859252:0:7132:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286758776832 00000100:00100000:2.0:1789366652.859256:0:7132:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286758776832 00000100:00100000:2.0:1789366652.859290:0:7132:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286758777088 00000100:00100000:2.0:1789366652.859293:0:7132:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286758777088 00000100:00100000:2.0:1789366652.859310:0:7132:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286758776704 00000100:00100000:2.0:1789366652.859313:0:7132:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286758776704 00000100:00100000:2.0:1789366652.859326:0:7132:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1789366652.859332:0:7132:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638af281c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3287:x1876286758776832:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789366652.859367:0:7132:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638af281c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3287:x1876286758776832:12345-0@lo:400:kworker.0 Request processed in 35us (663us total) trans 0 rc 0/0 00000100:00100000:2.0:1789366652.859374:0:7132:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1789366652.859386:0:7132:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:2.0:1789366652.859392:0:7132:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638c1e6ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3284:x1876286758777088:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789366652.859423:0:7132:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638c1e6ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3284:x1876286758777088:12345-0@lo:400:kworker.0 Request processed in 31us (321us total) trans 0 rc 0/0 00000100:00100000:2.0:1789366652.859429:0:7132:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:2.0:1789366652.859440:0:7132:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:2.0:1789366652.859446:0:7132:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638c1e6d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3284:x1876286758776704:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789366652.859471:0:7132:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638c1e6d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3284:x1876286758776704:12345-0@lo:400:kworker.0 Request processed in 25us (324us total) trans 0 rc 0/0 00000100:00100000:2.0:1789366652.859477:0:7132:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00080000:2.0:1789366652.859496:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789366652.859517:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9638af283b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3284:1876286758776704:0@lo:400:kworker.0 00000100:00100000:2.0:1789366652.859527:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9638af282d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3284:1876286758777088:0@lo:400:kworker.0 00000100:00100000:2.0:1789366652.859562:0:3287:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9638af281880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3287:1876286758776832:0@lo:400:kworker.0 00000100:00100000:2.0:1789366652.859590:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286758777216 00000100:00100000:2.0:1789366652.859593:0:6660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286758777216 00000100:00100000:2.0:1789366652.859613:0:6660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1789366652.859619:0:6660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638b6fc4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3284:x1876286758777216:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789366652.859653:0:6660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638b6fc4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3284:x1876286758777216:12345-0@lo:400:kworker.0 Request processed in 33us (440us total) trans 0 rc 0/0 00000100:00100000:2.0:1789366652.859659:0:6660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1789366652.859759:0:3286:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff963890775c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3286:1876286758777344:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789366652.859809:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789366652.859827:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9638af280a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3284:1876286758777216:0@lo:400:kworker.0 00000100:00100000:1.0:1789366652.859850:0:6663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286758777344 00000100:00100000:1.0:1789366652.859855:0:6663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286758777344 00000100:00100000:1.0:1789366652.859888:0:6663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1789366652.859896:0:6663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963890775500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3286:x1876286758777344:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789366652.859932:0:6663:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789366652.859978:0:6663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963890775500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3286:x1876286758777344:12345-0@lo:13:osp-pre-1-0.0 Request processed in 83us (170us total) trans 0 rc 0/0 00000100:00100000:1.0:1789366652.859984:0:6663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1789366652.860015:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286758776576 00000100:00100000:0.0:1789366652.860021:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286758776576 00000100:00100000:0.0:1789366652.860055:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 274 00000100:00100000:0.0:1789366652.860068:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638b4e80050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8cde4528-5832-4854-a387-4adacc3dd0ab+19:3284:x1876286758776576:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789366652.860148:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638b4e80050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8cde4528-5832-4854-a387-4adacc3dd0ab+19:3284:x1876286758776576:12345-0@lo:400:kworker.0 Request processed in 81us (1099us total) trans 0 rc 0/0 00000100:00100000:0.0:1789366652.860154:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 274 00000100:00100000:2.0:1789366652.860248:0:3286:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff963890775c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3286:1876286758777344:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789366652.860298:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9638af281f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8cde4528-5832-4854-a387-4adacc3dd0ab:3284:1876286758776576:0@lo:400:kworker.0 00010000:00010000:0.0:1789366652.983946:0:5805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1789366653.177958:0:11650:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1789366653.177967:0:11650:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1789366653.178015:0:11650:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:3.0:1789366653.178028:0:11650:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1789366653.178146:0:11650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9638bfefbb80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11650:1876286758777472:192.168.202.23@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1789366653.178266:0:11650:0:(client.c:2716:ptlrpc_set_wait()) set ffff9638850c9240 going to sleep for 11 seconds 00000100:00100000:3.0:1789366653.179895:0:11650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9638bfefbb80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11650:1876286758777472:192.168.202.23@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1789366653.180288:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:2.0:1789366653.180371:0:7132:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751435392 00000100:00100000:2.0:1789366653.180379:0:7132:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751435392 00000100:00100000:2.0:1789366653.180456:0:7132:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 130 00000100:00100000:2.0:1789366653.180466:0:7132:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638af280700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0ab23baa-a205-44ad-bf17-f7b47295d82b+21:10555:x1876286751435392:12345-192.168.202.23@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1789366653.180496:0:7132:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1789366653.180588:0:7132:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638af280700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0ab23baa-a205-44ad-bf17-f7b47295d82b+21:10555:x1876286751435392:12345-192.168.202.23@tcp:53:lhsmtool_posix.0 Request processed in 123us (350us total) trans 0 rc 0/0 00000100:00100000:2.0:1789366653.180596:0:7132:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 130 00000100:00100000:2.0:1789366653.184797:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:0.0:1789366653.184881:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751435648 00000100:00100000:0.0:1789366653.184891:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751435648 00000100:00100000:0.0:1789366653.184943:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 131 00000100:00100000:0.0:1789366653.184950:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638c1e6f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0ab23baa-a205-44ad-bf17-f7b47295d82b+21:10555:x1876286751435648:12345-192.168.202.23@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789366653.184967:0:5816:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789366653.184983:0:5816:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720c800/0x8da3486b955f3967 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xda917a494d06c164 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366653.185093:0:5816:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720d600/0x8da3486b955f396e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366653.185108:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720d600/0x8da3486b955f396e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366653.185120:0:5816:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720d600/0x8da3486b955f396e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789366653.185131:0:5816:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:0.0:1789366653.185255:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720c800/0x8da3486b955f3967 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.23@tcp remote: 0xda917a494d06c164 expref: 24 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366653.185268:0:5816:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720d600/0x8da3486b955f396e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.23@tcp remote: 0xda917a494d06c164 expref: 23 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366653.185288:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9638a7404a00) 00010000:00010000:0.0:1789366653.185290:0:5816:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789366653.185293:0:5816:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9638b720d600, rc 0) 00000100:00100000:0.0:1789366653.185342:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638c1e6f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0ab23baa-a205-44ad-bf17-f7b47295d82b+23:10555:x1876286751435648:12345-192.168.202.23@tcp:101:lhsmtool_posix.0 Request processed in 392us (551us total) trans 4294967410 rc 0/0 00000100:00100000:0.0:1789366653.185349:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 131 00000100:00100000:1.0:1789366653.189812:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:1.0:1789366653.189844:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:0.0:1789366653.189868:0:8419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751435776 00000100:00100000:0.0:1789366653.189879:0:8419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751435776 00000100:00100000:3.0:1789366653.189887:0:7614:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751436032 00000100:00100000:3.0:1789366653.189893:0:7614:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751436032 00000100:00100000:3.0:1789366653.189935:0:7614:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 132 00000100:00100000:3.0:1789366653.189943:0:7614:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963890775c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0ab23baa-a205-44ad-bf17-f7b47295d82b+24:10555:x1876286751436032:12345-192.168.202.23@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1789366653.189954:0:8419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 9 00000100:00100000:0.0:1789366653.189970:0:8419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96389861d850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0ab23baa-a205-44ad-bf17-f7b47295d82b+24:2354:x1876286751435776:12345-192.168.202.23@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789366653.189984:0:8419:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789366653.190006:0:8419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720d600/0x8da3486b955f396e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.23@tcp remote: 0xda917a494d06c164 expref: 24 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366653.190020:0:7614:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9638832d2000/0x8da3486b955f397c lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7614 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366653.190025:0:8419:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9638a7404a00) 00010000:00010000:0.0:1789366653.190033:0:8419:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789366653.190045:0:7614:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9638832d2000/0x8da3486b955f397c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7614 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366653.190056:0:7614:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9638832d2000/0x8da3486b955f397c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7614 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789366653.190090:0:8419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96389861d850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0ab23baa-a205-44ad-bf17-f7b47295d82b+23:2354:x1876286751435776:12345-192.168.202.23@tcp:103:ldlm_bl.0 Request processed in 123us (283us total) trans 0 rc 0/0 00000100:00100000:0.0:1789366653.190097:0:8419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 9 00010000:00010000:3.0:1789366653.190339:0:7614:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9638832d2000/0x8da3486b955f397c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7614 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366653.190348:0:7614:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9638832d2000/0x8da3486b955f397c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7614 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366653.190355:0:7614:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9638832d2000/0x8da3486b955f397c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7614 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366653.190361:0:7614:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9638832d2000 already unused, calling callback (ffffffffc20ee4f0) 00010000:00010000:3.0:1789366653.190365:0:7614:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9638832d2000/0x8da3486b955f397c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7614 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366653.190373:0:7614:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9638832d2000/0x8da3486b955f397c lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7614 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366653.190383:0:7614:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9638a7404a00) 00010000:00010000:3.0:1789366653.190386:0:7614:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1789366653.190390:0:7614:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9638832d2000/0x8da3486b955f397c lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7614 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366653.190396:0:7614:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9638832d2000/0x8da3486b955f397c lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7614 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789366653.190517:0:7614:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963890775c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0ab23baa-a205-44ad-bf17-f7b47295d82b+23:10555:x1876286751436032:12345-192.168.202.23@tcp:57:lhsmtool_posix.0 Request processed in 573us (669us total) trans 4294967411 rc 0/0 00000100:00100000:3.0:1789366653.190524:0:7614:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 132 00000040:00080000:2.0:1789366653.190593:0:11650:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1789366653.190599:0:11650:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1789366653.191109:0:11650:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:2.0:1789366653.191118:0:11650:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1789366653.197139:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:0.0:1789366653.197197:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751436288 00000100:00100000:0.0:1789366653.197207:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751436288 00000100:00100000:0.0:1789366653.197306:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 34 00000100:00100000:0.0:1789366653.197316:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963890777800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0ab23baa-a205-44ad-bf17-f7b47295d82b+23:10555:x1876286751436288:12345-192.168.202.23@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1789366653.197660:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963890777800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0ab23baa-a205-44ad-bf17-f7b47295d82b+24:10555:x1876286751436288:12345-192.168.202.23@tcp:35:lhsmtool_posix.0 Request processed in 345us (528us total) trans 4294967412 rc 0/0 00000100:00100000:0.0:1789366653.197682:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 34 00010000:00010000:3.0:1789366654.008195:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1789366654.178829:0:12116:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1789366654.178838:0:12116:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1789366654.178881:0:12116:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:3.0:1789366654.178886:0:12116:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1789366654.301705:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:3.0:1789366654.301809:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751436544 00000100:00100000:3.0:1789366654.301819:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751436544 00000100:00100000:3.0:1789366654.301885:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 133 00000100:00100000:3.0:1789366654.301895:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638af281180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0ab23baa-a205-44ad-bf17-f7b47295d82b+24:10576:x1876286751436544:12345-192.168.202.23@tcp:101:lfs.0 00010000:00010000:3.0:1789366654.301920:0:5815:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789366654.301941:0:5815:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9638832d2000/0x8da3486b955f3983 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xda917a494d06c16b expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366654.302065:0:5815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9638832d3a00/0x8da3486b955f398a lrc: 3/1,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366654.302081:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9638832d3a00/0x8da3486b955f398a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366654.302093:0:5815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9638832d3a00/0x8da3486b955f398a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789366654.302104:0:5815:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:3.0:1789366654.302232:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9638832d2000/0x8da3486b955f3983 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.23@tcp remote: 0xda917a494d06c16b expref: 27 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366654.302268:0:5815:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9638832d3a00/0x8da3486b955f398a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.23@tcp remote: 0xda917a494d06c16b expref: 26 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366654.302278:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9638a7404a00) 00010000:00010000:3.0:1789366654.302281:0:5815:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1789366654.302284:0:5815:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9638832d3a00, rc 0) 00000100:00100000:3.0:1789366654.302341:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638af281180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0ab23baa-a205-44ad-bf17-f7b47295d82b+26:10576:x1876286751436544:12345-192.168.202.23@tcp:101:lfs.0 Request processed in 447us (645us total) trans 4294967413 rc 0/0 00000100:00100000:3.0:1789366654.302348:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 133 00000100:00080000:0.0:1789366654.302552:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789366654.307653:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:3.0:1789366654.308074:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751436672 00000100:00100000:3.0:1789366654.308084:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751436672 00000100:00100000:3.0:1789366654.308136:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 134 00000100:00100000:3.0:1789366654.308147:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638c1e6df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0ab23baa-a205-44ad-bf17-f7b47295d82b+26:10576:x1876286751436672:12345-192.168.202.23@tcp:54:lfs.0 00010000:00010000:3.0:1789366654.308220:0:5817:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9638832d3400/0x8da3486b955f3998 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366654.308238:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9638832d3400/0x8da3486b955f3998 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366654.308252:0:5817:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9638832d3400/0x8da3486b955f3998 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366654.308277:0:5817:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9638832d3400/0x8da3486b955f3998 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366654.308284:0:5817:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9638832d3400/0x8da3486b955f3998 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366654.308301:0:5817:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9638832d3400/0x8da3486b955f3998 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366654.308307:0:5817:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9638832d3400 already unused, calling callback (ffffffffc20ee4f0) 00010000:00010000:3.0:1789366654.308311:0:5817:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9638832d3400/0x8da3486b955f3998 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366654.308319:0:5817:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9638832d3400/0x8da3486b955f3998 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366654.308330:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9638a7404a00) 00010000:00010000:3.0:1789366654.308333:0:5817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789366654.308338:0:5817:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9638832d3400/0x8da3486b955f3998 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366654.308346:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9638832d3400/0x8da3486b955f3998 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789366654.308411:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638c1e6df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0ab23baa-a205-44ad-bf17-f7b47295d82b+26:10576:x1876286751436672:12345-192.168.202.23@tcp:54:lfs.0 Request processed in 261us (761us total) trans 0 rc 0/0 00000100:00100000:3.0:1789366654.308418:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 134 00000100:00100000:3.0:1789366654.372245:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:0.0:1789366654.372371:0:8065:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751436800 00000100:00100000:0.0:1789366654.372382:0:8065:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751436800 00000100:00080000:2.0:1789366654.372452:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789366654.372510:0:8065:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 46 00000100:00100000:0.0:1789366654.372522:0:8065:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638bfefbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0ab23baa-a205-44ad-bf17-f7b47295d82b+6:2354:x1876286751436800:12345-192.168.202.23@tcp:101:cat.0 00010000:00010000:0.0:1789366654.372540:0:8065:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789366654.372561:0:8065:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002cd9e6e2/0x8da3486b955f399f lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda917a494d06c172 expref: -99 pid: 8065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789366654.372601:0:8065:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 13, mtime: 0x6aa7917b, atime: 0x6aa7917b, ctime: 0x6aa7917b, blocks: 0xb 00010000:00010000:0.0:1789366654.372622:0:8065:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=229s v=(0 0) 00010000:00010000:0.0:1789366654.372627:0:8065:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789366654.372635:0:8065:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002cd9e6e2/0x8da3486b955f399f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.23@tcp remote: 0xda917a494d06c172 expref: 7 pid: 8065 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366654.372654:0:8065:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000002cd9e6e2/0x8da3486b955f399f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.23@tcp remote: 0xda917a494d06c172 expref: 7 pid: 8065 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366654.372669:0:8065:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9638b720c200, rc 0) 00000100:00100000:0.0:1789366654.372807:0:8065:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638bfefbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0ab23baa-a205-44ad-bf17-f7b47295d82b+7:2354:x1876286751436800:12345-192.168.202.23@tcp:101:cat.0 Request processed in 288us (572us total) trans 0 rc 0/0 00000100:00100000:0.0:1789366654.372814:0:8065:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 46 00000100:00100000:0.0:1789366654.378281:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:1.0:1789366654.378415:0:6664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751436928 00000100:00100000:1.0:1789366654.378427:0:6664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751436928 00002000:00100000:1.0:1789366654.378484:0:6664:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x4:0x0] (0->4095) req@ffff9638af281500 x1876286751436928/t0(0) o3->0ab23baa-a205-44ad-bf17-f7b47295d82b@192.168.202.23@tcp:55/0 lens 488/0 e 0 to 0 dl 1789366665 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789366654.378496:0:6664:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9638af281500 with x1876286751436928 ext(0->4095) 00002000:00010000:1.0:1789366654.378502:0:6664:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9638af281500 00000100:00100000:1.0:1789366654.378583:0:6664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 3 00000100:00100000:1.0:1789366654.378593:0:6664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638af281500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0ab23baa-a205-44ad-bf17-f7b47295d82b+7:2354:x1876286751436928:12345-192.168.202.23@tcp:3:cat.0 00000100:00100000:1.0:1789366654.378877:0:6664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638af281500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0ab23baa-a205-44ad-bf17-f7b47295d82b+7:2354:x1876286751436928:12345-192.168.202.23@tcp:3:cat.0 Request processed in 285us (606us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1789366654.378886:0:6664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 3 00002000:00100000:1.0:1789366654.378893:0:6664:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x4:0x0] (0->4095) req@ffff9638af281500 x1876286751436928/t0(0) o3->0ab23baa-a205-44ad-bf17-f7b47295d82b@192.168.202.23@tcp:55/0 lens 488/4536 e 0 to 0 dl 1789366665 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789366654.378902:0:6664:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9638af281500 with x1876286751436928 ext(0->4095) 00002000:00010000:1.0:1789366654.378905:0:6664:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9638af281500 00010000:00010000:1.0:1789366655.033524:0:6675:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789366655.418982:0:3286:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789366655.419005:0:3286:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9638b70cd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3286:1876286758777600:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789366655.419083:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789366655.419278:0:7134:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286758777600 00000100:00100000:3.0:1789366655.419287:0:7134:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286758777600 00000100:00100000:3.0:1789366655.419367:0:7134:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1789366655.419378:0:7134:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963890777b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3286:x1876286758777600:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789366655.419414:0:7134:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00080000:2.0:1789366655.419429:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789366655.419472:0:7134:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963890777b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3286:x1876286758777600:12345-0@lo:13:osp-pre-0-0.0 Request processed in 96us (387us total) trans 0 rc 0/0 00000100:00100000:3.0:1789366655.419489:0:7134:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1789366655.419656:0:3286:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9638b70cd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3286:1876286758777600:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1789366656.057623:0:5805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1789366656.464069:0:7617:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967304 is committed 00010000:00010000:1.0:1789366657.081474:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789366657.271413:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:3.0:1789366657.271546:0:7614:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751437056 00000100:00100000:3.0:1789366657.271560:0:7614:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751437056 00000100:00100000:3.0:1789366657.271696:0:7614:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 135 00000100:00100000:3.0:1789366657.271709:0:7614:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638b70cd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0ab23baa-a205-44ad-bf17-f7b47295d82b+26:10221:x1876286751437056:12345-192.168.202.23@tcp:60:lhsmtool_posix.0 00000100:00100000:3.0:1789366657.271970:0:7614:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638b70cd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0ab23baa-a205-44ad-bf17-f7b47295d82b+26:10221:x1876286751437056:12345-192.168.202.23@tcp:60:lhsmtool_posix.0 Request processed in 262us (572us total) trans 0 rc 0/0 00000100:00100000:3.0:1789366657.271978:0:7614:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 135 00000100:00080000:2.0:1789366657.272802:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789366657.276011:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:1.0:1789366657.277201:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751437312 00000100:00100000:1.0:1789366657.277215:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751437312 00000100:00100000:1.0:1789366657.277296:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 35 00000100:00100000:1.0:1789366657.277309:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638bfec9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0ab23baa-a205-44ad-bf17-f7b47295d82b+26:10221:x1876286751437312:12345-192.168.202.23@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1789366657.277689:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638bfec9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0ab23baa-a205-44ad-bf17-f7b47295d82b+27:10221:x1876286751437312:12345-192.168.202.23@tcp:35:lhsmtool_posix.0 Request processed in 382us (1689us total) trans 4294967414 rc 0/0 00000100:00100000:1.0:1789366657.277699:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 35 00000100:00100000:1.0:1789366657.415653:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:0.0:1789366657.421260:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751437440 00000100:00100000:0.0:1789366657.421285:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751437440 00000100:00080000:2.0:1789366657.421529:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789366657.421631:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 136 00000100:00100000:0.0:1789366657.421644:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963890775880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b9764435-e52f-45ac-a5f9-bab1231105ac+5:11027:x1876286751437440:12345-192.168.202.23@tcp:101:lsof.0 00010000:00010000:0.0:1789366657.421672:0:5816:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789366657.421702:0:5816:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720c400/0x8da3486b955f39a6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xda917a494d06c179 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366657.421811:0:5816:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720ca00/0x8da3486b955f39ad lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366657.421829:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720ca00/0x8da3486b955f39ad lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366657.421844:0:5816:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720ca00/0x8da3486b955f39ad lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789366657.421889:0:5816:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1789366657.421894:0:5816:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1789366657.421946:0:5816:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720ca00/0x8da3486b955f39ad lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366657.421976:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720c400/0x8da3486b955f39a6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.23@tcp remote: 0xda917a494d06c179 expref: 7 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366657.421999:0:5816:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720ca00/0x8da3486b955f39ad lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.23@tcp remote: 0xda917a494d06c179 expref: 6 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366657.422034:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff963890797800) 00010000:00010000:0.0:1789366657.422037:0:5816:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789366657.422043:0:5816:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9638b720ca00, rc 0) 00000100:00100000:0.0:1789366657.422533:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963890775880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b9764435-e52f-45ac-a5f9-bab1231105ac+6:11027:x1876286751437440:12345-192.168.202.23@tcp:101:lsof.0 Request processed in 890us (6894us total) trans 0 rc 0/0 00000100:00100000:0.0:1789366657.422542:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 136 00000001:00080000:3.0:1789366657.495882:0:5837:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967412 is committed 00000020:00080000:3.0:1789366657.495911:0:5837:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9638aef8c540 refcount 2 committed 0 result 0 batchid 4 00000020:00080000:3.0:1789366657.495918:0:5837:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff963784a7ae00 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9638aef8c240 00000020:00080000:3.0:1789366657.495922:0:5837:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff963784a7a900 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9638b73a3c00 00000001:00080000:3.0:1789366657.495937:0:5837:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967414 is committed 00000020:00080000:3.0:1789366657.495983:0:5837:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 3 batchid updated 00000020:00080000:3.0:1789366657.495996:0:5848:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 4 committed batchid 3 00000020:00080000:3.0:1789366657.496212:0:5848:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 3 00000001:00080000:0.0:1789366657.502248:0:6685:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967312 is committed 00000001:00080000:0.0:1789366657.502275:0:6685:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967311 is committed 00000100:00100000:2.0:1789366657.743426:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:2.0:1789366657.743481:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:2.0:1789366657.743645:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:3.0:1789366657.743795:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751437696 00000100:00100000:3.0:1789366657.743811:0:6661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751437696 00000100:00100000:3.0:1789366657.743880:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751437824 00000100:00100000:3.0:1789366657.743884:0:6661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751437824 00000100:00100000:3.0:1789366657.743913:0:6661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 54 00000100:00100000:3.0:1789366657.743923:0:6661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638bfecb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0ab23baa-a205-44ad-bf17-f7b47295d82b+6:2356:x1876286751437696:12345-192.168.202.23@tcp:400:kworker.0 00000100:00100000:3.0:1789366657.743998:0:6661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638bfecb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0ab23baa-a205-44ad-bf17-f7b47295d82b+6:2356:x1876286751437696:12345-192.168.202.23@tcp:400:kworker.0 Request processed in 76us (515us total) trans 0 rc 0/0 00000100:00100000:3.0:1789366657.744006:0:6661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 54 00000100:00100000:3.0:1789366657.744037:0:6661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 55 00000100:00100000:3.0:1789366657.744049:0:6661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638bf4b0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0ab23baa-a205-44ad-bf17-f7b47295d82b+5:2357:x1876286751437824:12345-192.168.202.23@tcp:400:kworker.0 00000100:00100000:3.0:1789366657.744078:0:6661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638bf4b0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0ab23baa-a205-44ad-bf17-f7b47295d82b+5:2357:x1876286751437824:12345-192.168.202.23@tcp:400:kworker.0 Request processed in 30us (433us total) trans 0 rc 0/0 00000100:00100000:3.0:1789366657.744085:0:6661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 55 00000100:00080000:2.0:1789366657.744146:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789366657.744150:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789366657.744775:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751437568 00000100:00100000:0.0:1789366657.744789:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751437568 00000100:00100000:0.0:1789366657.744856:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 275 00000100:00100000:0.0:1789366657.744867:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638b4e81450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:14a2847b-91d8-4d87-b71b-010443acc91a+13:2357:x1876286751437568:12345-192.168.202.23@tcp:400:kworker.0 00000100:00100000:0.0:1789366657.744928:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638b4e81450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:14a2847b-91d8-4d87-b71b-010443acc91a+13:2357:x1876286751437568:12345-192.168.202.23@tcp:400:kworker.0 Request processed in 65us (1513us total) trans 0 rc 0/0 00000100:00100000:0.0:1789366657.744935:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 275 00000100:00100000:3.0:1789366657.976053:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9638af280e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8cde4528-5832-4854-a387-4adacc3dd0ab:3284:1876286758777728:0@lo:400:kworker.0 00000100:00100000:2.0:1789366657.976053:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9638af282300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3285:1876286758777856:0@lo:400:kworker.0 00000100:00100000:0.0:1789366657.976105:0:3286:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9638af283100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3286:1876286758777984:0@lo:400:kworker.0 00000100:00100000:2.0:1789366657.976180:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789366657.976198:0:3287:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9638af280380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3287:1876286758778112:0@lo:400:kworker.0 00000100:00100000:0.0:1789366657.976247:0:3287:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789366657.976290:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9638af282a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3285:1876286758778368:0@lo:400:kworker.0 00000100:00100000:3.0:1789366657.976319:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789366657.976335:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789366657.976363:0:7132:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286758777856 00000100:00100000:0.0:1789366657.976376:0:7132:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286758777856 00000100:00100000:3.0:1789366657.976383:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9638af283800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3284:1876286758778240:0@lo:400:kworker.0 00000100:00100000:2.0:1789366657.976400:0:8065:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286758778112 00000100:00100000:2.0:1789366657.976410:0:8065:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286758778112 00000100:00100000:3.0:1789366657.976419:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789366657.976461:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286758777728 00000100:00100000:3.0:1789366657.976466:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286758777728 00000100:00100000:2.0:1789366657.976485:0:8065:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286758778368 00000100:00100000:2.0:1789366657.976490:0:8065:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286758778368 00000100:00100000:3.0:1789366657.976510:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 276 00000100:00100000:3.0:1789366657.976521:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638b4e80c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8cde4528-5832-4854-a387-4adacc3dd0ab+19:3284:x1876286758777728:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789366657.976572:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638b4e80c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8cde4528-5832-4854-a387-4adacc3dd0ab+19:3284:x1876286758777728:12345-0@lo:400:kworker.0 Request processed in 54us (256us total) trans 0 rc 0/0 00000100:00100000:3.0:1789366657.976579:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 276 00000100:00100000:2.0:1789366657.976601:0:8065:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1789366657.976612:0:8065:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638af281f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3287:x1876286758778112:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789366657.976630:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9638af280e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8cde4528-5832-4854-a387-4adacc3dd0ab:3284:1876286758777728:0@lo:400:kworker.0 00000100:00100000:2.0:1789366657.976657:0:8065:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638af281f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3287:x1876286758778112:12345-0@lo:400:kworker.0 Request processed in 47us (410us total) trans 0 rc 0/0 00000100:00100000:3.0:1789366657.976662:0:6661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1789366657.976671:0:8065:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1789366657.976675:0:6661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638b4f18a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3285:x1876286758778368:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1789366657.976700:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789366657.976706:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789366657.976714:0:6661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638b4f18a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3285:x1876286758778368:12345-0@lo:400:kworker.0 Request processed in 43us (381us total) trans 0 rc 0/0 00000100:00100000:3.0:1789366657.976748:0:6661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1789366657.976752:0:3285:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967304 gen 2 00000004:00080000:2.0:1789366657.976759:0:3285:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff963882ee1500, transno 4294967304 00000100:00100000:2.0:1789366657.976773:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9638af282a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3285:1876286758778368:0@lo:400:kworker.0 00000100:00100000:2.0:1789366657.977129:0:3287:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967312 gen 2 00000004:00080000:2.0:1789366657.977134:0:3287:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9638b7352a00, transno 4294967310 00000004:00080000:2.0:1789366657.977153:0:3287:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967312 committed transno 4294967312 00000100:00100000:2.0:1789366657.977178:0:3287:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9638af280380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3287:1876286758778112:0@lo:400:kworker.0 00000100:00100000:2.0:1789366657.977193:0:3287:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789366657.977200:0:3287:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9638b7214e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3287:1876286758778496:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789366657.977228:0:3287:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789366657.977257:0:6663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286758778496 00000100:00100000:2.0:1789366657.977261:0:6663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286758778496 00000100:00100000:2.0:1789366657.977291:0:6663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1789366657.977299:0:6663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638b4f19880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3287:x1876286758778496:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789366657.977325:0:6663:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789366657.977366:0:6663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638b4f19880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3287:x1876286758778496:12345-0@lo:13:osp-pre-1-0.0 Request processed in 67us (137us total) trans 0 rc 0/0 00000100:00100000:2.0:1789366657.977374:0:6663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1789366657.977412:0:3287:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9638b7214e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3287:1876286758778496:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789366657.977447:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789366657.982353:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:2.0:1789366657.982382:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638bf5aaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3285:x1876286758777856:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789366657.982394:0:7614:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286758778240 00000100:00100000:3.0:1789366657.982408:0:7614:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286758778240 00000100:00100000:3.0:1789366657.982544:0:7614:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:2.0:1789366657.982556:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638bf5aaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3285:x1876286758777856:12345-0@lo:400:kworker.0 Request processed in 188us (6386us total) trans 0 rc 0/0 00000100:00100000:2.0:1789366657.982570:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:3.0:1789366657.982572:0:7614:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638bfef8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3284:x1876286758778240:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789366657.982622:0:7614:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638bfef8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3284:x1876286758778240:12345-0@lo:400:kworker.0 Request processed in 55us (6204us total) trans 0 rc 0/0 00000100:00100000:2.0:1789366657.982628:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9638af282300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3285:1876286758777856:0@lo:400:kworker.0 00000100:00100000:3.0:1789366657.982631:0:7614:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:3.0:1789366657.982664:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9638af283800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3284:1876286758778240:0@lo:400:kworker.0 00000100:00080000:1.0:1789366657.982791:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789366657.983809:0:7132:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286758777984 00000100:00100000:0.0:1789366657.983826:0:7132:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286758777984 00000100:00080000:1.0:1789366657.983945:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789366657.983983:0:7132:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:0.0:1789366657.983998:0:7132:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963785f2b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3286:x1876286758777984:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789366657.984107:0:7132:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963785f2b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3286:x1876286758777984:12345-0@lo:400:kworker.0 Request processed in 113us (6659us total) trans 0 rc 0/0 00000100:00100000:0.0:1789366657.984133:0:7132:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:2.0:1789366657.984360:0:3286:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9638af283100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3286:1876286758777984:0@lo:400:kworker.0 00010000:00010000:1.0:1789366658.104200:0:6675:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789366659.129764:0:5805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1789366659.426641:0:12315:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1b: Test manual lfs pcc attach with restore on remote access ========================================================== 02:17:38 (1789366658) 00010000:00010000:1.0:1789366660.151959:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789366660.179827:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:0.0:1789366660.179901:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751438080 00000100:00100000:0.0:1789366660.179912:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751438080 00000100:00100000:0.0:1789366660.180002:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 137 00000100:00100000:0.0:1789366660.180014:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638bfefad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0ab23baa-a205-44ad-bf17-f7b47295d82b+13:11292:x1876286751438080:12345-192.168.202.23@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789366660.180038:0:5817:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789366660.180059:0:5817:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720c800/0x8da3486b955f39b4 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xda917a494d06c180 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366660.180127:0:5817:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720dc00/0x8da3486b955f39bb lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366660.180142:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720dc00/0x8da3486b955f39bb lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366660.180167:0:5817:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720dc00/0x8da3486b955f39bb lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366660.180184:0:5817:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720cc00/0x8da3486b955f39c2 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366660.180192:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720cc00/0x8da3486b955f39c2 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366660.180200:0:5817:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720cc00/0x8da3486b955f39c2 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1789366660.180202:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1789366660.180542:0:5817:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720c000/0x8da3486b955f39c9 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366660.180562:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720c000/0x8da3486b955f39c9 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366660.180570:0:5817:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720c000/0x8da3486b955f39c9 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789366660.180580:0:5817:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 16384 00010000:00010000:0.0:1789366660.180744:0:5817:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720dc00/0x8da3486b955f39bb lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366660.180752:0:5817:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720dc00/0x8da3486b955f39bb lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366660.180758:0:5817:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720dc00/0x8da3486b955f39bb lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366660.180765:0:5817:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9638b720dc00 already unused, calling callback (ffffffffc20ee4f0) 00010000:00010000:0.0:1789366660.180769:0:5817:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720dc00/0x8da3486b955f39bb lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366660.180777:0:5817:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720dc00/0x8da3486b955f39bb lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366660.180790:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff963890797400) 00010000:00010000:0.0:1789366660.180793:0:5817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789366660.180797:0:5817:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720dc00/0x8da3486b955f39bb lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366660.180813:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720dc00/0x8da3486b955f39bb lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366660.180826:0:5817:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720cc00/0x8da3486b955f39c2 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366660.180832:0:5817:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720cc00/0x8da3486b955f39c2 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366660.180838:0:5817:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720cc00/0x8da3486b955f39c2 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366660.180844:0:5817:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9638b720cc00 already unused, calling callback (ffffffffc20ee4f0) 00010000:00010000:0.0:1789366660.180847:0:5817:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720cc00/0x8da3486b955f39c2 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366660.180854:0:5817:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720cc00/0x8da3486b955f39c2 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366660.180861:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff963890797900) 00010000:00010000:0.0:1789366660.180864:0:5817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789366660.180867:0:5817:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720cc00/0x8da3486b955f39c2 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366660.180873:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720cc00/0x8da3486b955f39c2 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366660.181291:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720c800/0x8da3486b955f39b4 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.23@tcp remote: 0xda917a494d06c180 expref: 16 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366660.181307:0:5817:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720c000/0x8da3486b955f39c9 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.23@tcp remote: 0xda917a494d06c180 expref: 15 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366660.181320:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9638a7404100) 00010000:00010000:0.0:1789366660.181323:0:5817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789366660.181326:0:5817:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9638b720c000, rc 0) 00000100:00100000:0.0:1789366660.181403:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638bfefad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0ab23baa-a205-44ad-bf17-f7b47295d82b+15:11292:x1876286751438080:12345-192.168.202.23@tcp:101:lhsmtool_posix.0 Request processed in 1391us (1584us total) trans 4294967415 rc 0/0 00000100:00100000:0.0:1789366660.181411:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 137 00000100:00100000:1.0:1789366660.185332:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:1.0:1789366660.185358:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:3.0:1789366660.185482:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751438208 00000100:00100000:3.0:1789366660.185500:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751438208 00000100:00100000:3.0:1789366660.185651:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 10 00000100:00100000:3.0:1789366660.185661:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638b7217100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0ab23baa-a205-44ad-bf17-f7b47295d82b+15:2355:x1876286751438208:12345-192.168.202.23@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789366660.185674:0:5801:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789366660.185696:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720c000/0x8da3486b955f39c9 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.23@tcp remote: 0xda917a494d06c180 expref: 15 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366660.185713:0:5801:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9638a7404100) 00010000:00010000:3.0:1789366660.186221:0:5801:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789366660.186228:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751438336 00000100:00100000:2.0:1789366660.186235:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751438336 00000100:00100000:2.0:1789366660.186273:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 138 00000100:00100000:2.0:1789366660.186282:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638b7216d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0ab23baa-a205-44ad-bf17-f7b47295d82b+15:11292:x1876286751438336:12345-192.168.202.23@tcp:59:lhsmtool_posix.0 00000100:00100000:3.0:1789366660.186327:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638b7217100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0ab23baa-a205-44ad-bf17-f7b47295d82b+15:2355:x1876286751438208:12345-192.168.202.23@tcp:103:ldlm_bl.0 Request processed in 666us (1001us total) trans 0 rc 0/0 00000100:00100000:3.0:1789366660.186335:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 10 00000100:00100000:2.0:1789366660.186358:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638b7216d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0ab23baa-a205-44ad-bf17-f7b47295d82b+14:11292:x1876286751438336:12345-192.168.202.23@tcp:59:lhsmtool_posix.0 Request processed in 77us (997us total) trans 0 rc 0/0 00000100:00100000:2.0:1789366660.186366:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 138 00000040:00080000:1.0:1789366660.344070:0:11650:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1789366660.344079:0:11650:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1789366660.344520:0:11650:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:1.0:1789366660.344528:0:11650:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1789366660.536069:0:3286:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789366660.536092:0:3286:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff963883308e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3286:1876286758778624:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789366660.536177:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789366660.536285:0:7134:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286758778624 00000100:00100000:2.0:1789366660.536293:0:7134:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286758778624 00000100:00100000:2.0:1789366660.536402:0:7134:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1789366660.536413:0:7134:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638b7216680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3286:x1876286758778624:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789366660.536455:0:7134:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789366660.536517:0:7134:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638b7216680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3286:x1876286758778624:12345-0@lo:13:osp-pre-0-0.0 Request processed in 96us (328us total) trans 0 rc 0/0 00000100:00100000:2.0:1789366660.536526:0:7134:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00080000:0.0:1789366660.536534:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789366660.536582:0:3286:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff963883308e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3286:1876286758778624:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789366661.167683:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:1.0:1789366661.167777:0:7132:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751438464 00000100:00100000:1.0:1789366661.167788:0:7132:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751438464 00000100:00100000:1.0:1789366661.167851:0:7132:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 139 00000100:00100000:1.0:1789366661.167862:0:7132:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638af280a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0ab23baa-a205-44ad-bf17-f7b47295d82b+14:11334:x1876286751438464:12345-192.168.202.23@tcp:101:lfs.0 00010000:00010000:1.0:1789366661.167883:0:7132:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789366661.167906:0:7132:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9638b6ce2400/0x8da3486b955f39d7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xda917a494d06c187 expref: -99 pid: 7132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366661.167967:0:7132:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9638b6ce3600/0x8da3486b955f39de lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366661.167983:0:7132:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9638b6ce3600/0x8da3486b955f39de lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366661.167999:0:7132:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9638b6ce3600/0x8da3486b955f39de lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366661.168013:0:7132:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9638b6ce3c00/0x8da3486b955f39e5 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366661.168020:0:7132:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9638b6ce3c00/0x8da3486b955f39e5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366661.168028:0:7132:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9638b6ce3c00/0x8da3486b955f39e5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366661.168222:0:7132:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9638b6ce3600/0x8da3486b955f39de lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366661.168231:0:7132:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9638b6ce3600/0x8da3486b955f39de lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366661.168238:0:7132:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9638b6ce3600/0x8da3486b955f39de lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366661.168254:0:7132:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9638b6ce3600 already unused, calling callback (ffffffffc20ee4f0) 00010000:00010000:1.0:1789366661.168259:0:7132:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9638b6ce3600/0x8da3486b955f39de lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366661.168267:0:7132:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9638b6ce3600/0x8da3486b955f39de lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366661.168280:0:7132:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff963890797800) 00010000:00010000:1.0:1789366661.168283:0:7132:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789366661.168288:0:7132:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9638b6ce3600/0x8da3486b955f39de lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366661.168295:0:7132:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9638b6ce3600/0x8da3486b955f39de lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366661.168305:0:7132:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9638b6ce3c00/0x8da3486b955f39e5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366661.168312:0:7132:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9638b6ce3c00/0x8da3486b955f39e5 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366661.168319:0:7132:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9638b6ce3c00/0x8da3486b955f39e5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366661.168325:0:7132:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9638b6ce3c00 already unused, calling callback (ffffffffc20ee4f0) 00010000:00010000:1.0:1789366661.168327:0:7132:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9638b6ce3c00/0x8da3486b955f39e5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366661.168333:0:7132:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9638b6ce3c00/0x8da3486b955f39e5 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366661.168349:0:7132:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff963887f88d00) 00010000:00010000:1.0:1789366661.168351:0:7132:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789366661.168354:0:7132:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9638b6ce3c00/0x8da3486b955f39e5 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366661.168360:0:7132:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9638b6ce3c00/0x8da3486b955f39e5 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366661.168391:0:7132:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9638b6ce2400/0x8da3486b955f39d7 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.23@tcp remote: 0xda917a494d06c187 expref: 15 pid: 7132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366661.168402:0:7132:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff963890797800) 00010000:00010000:1.0:1789366661.168404:0:7132:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789366661.168408:0:7132:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9638b6ce2400/0x8da3486b955f39d7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.23@tcp remote: 0xda917a494d06c187 expref: 15 pid: 7132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366661.168418:0:7132:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9638b6ce2400, rc 0) 00000100:00100000:1.0:1789366661.168526:0:7132:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638af280a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0ab23baa-a205-44ad-bf17-f7b47295d82b+14:11334:x1876286751438464:12345-192.168.202.23@tcp:101:lfs.0 Request processed in 665us (851us total) trans 0 rc 301/301 00000100:00100000:1.0:1789366661.168534:0:7132:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 139 00000100:00100000:0.0:1789366661.172384:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:1.0:1789366661.172459:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751438720 00000100:00100000:1.0:1789366661.172468:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751438720 00000100:00100000:1.0:1789366661.172546:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 140 00000100:00100000:1.0:1789366661.172556:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638af282680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0ab23baa-a205-44ad-bf17-f7b47295d82b+14:11334:x1876286751438720:12345-192.168.202.23@tcp:36:lfs.0 00010000:00010000:1.0:1789366661.172609:0:5817:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789366661.172634:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720da00/0x8da3486b955f3355 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.23@tcp remote: 0xda917a494d06bfc0 expref: 14 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366661.172662:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff963890797800) 00010000:00010000:1.0:1789366661.172667:0:5817:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789366661.172880:0:5817:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9638b6ce3800/0x8da3486b955f39ec lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366661.172893:0:5817:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720ca00/0x8da3486b955f39ad lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.23@tcp remote: 0xda917a494d06c179 expref: 5 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366661.172901:0:5817:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9638b6ce3800/0x8da3486b955f39ec lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366661.172933:0:5817:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720ca00/0x8da3486b955f39ad lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.23@tcp remote: 0xda917a494d06c179 expref: 5 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366661.172947:0:5817:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720ca00/0x8da3486b955f39ad lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.23@tcp remote: 0xda917a494d06c179 expref: 5 pid: 5816 timeout: 336 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789366661.172961:0:5817:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9638b7214e00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5817:1876286758778752:192.168.202.23@tcp:104: 00000100:00100000:1.0:1789366661.173040:0:5817:0:(client.c:2716:ptlrpc_set_wait()) set ffff96388894ac00 going to sleep for 11 seconds 00010000:00010000:0.0:1789366661.176228:0:6675:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789366661.176488:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:0.0:1789366661.176581:0:5817:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9638b7214e00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5817:1876286758778752:192.168.202.23@tcp:104: 00010000:00010000:0.0:1789366661.176611:0:5817:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9638b6ce3800/0x8da3486b955f39ec lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789366661.176691:0:8419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751438848 00000100:00100000:3.0:1789366661.176698:0:8419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751438848 00010000:00010000:3.0:1789366661.176821:0:8419:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720ca00/0x8da3486b955f39ad lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.23@tcp remote: 0xda917a494d06c179 expref: 6 pid: 5816 timeout: 336 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789366661.176855:0:8419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 60 00000100:00100000:3.0:1789366661.176864:0:8419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638a74c9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b9764435-e52f-45ac-a5f9-bab1231105ac+6:2355:x1876286751438848:12345-192.168.202.23@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789366661.176885:0:8419:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789366661.176892:0:8419:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720ca00/0x8da3486b955f39ad lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.23@tcp remote: 0xda917a494d06c179 expref: 6 pid: 5816 timeout: 336 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366661.176903:0:8419:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720ca00/0x8da3486b955f39ad lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.23@tcp remote: 0xda917a494d06c179 expref: 6 pid: 5816 timeout: 336 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366661.176922:0:8419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720ca00/0x8da3486b955f39ad lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.23@tcp remote: 0xda917a494d06c179 expref: 6 pid: 5816 timeout: 336 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366661.176935:0:8419:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff963890797800) 00010000:00010000:3.0:1789366661.176940:0:8419:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9638b6ce3800/0x8da3486b955f39ec lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366661.176950:0:8419:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9638b6ce3800/0x8da3486b955f39ec lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366661.176958:0:8419:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9638b6ce3800/0x8da3486b955f39ec lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366661.176979:0:8419:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789366661.177022:0:8419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638a74c9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b9764435-e52f-45ac-a5f9-bab1231105ac+5:2355:x1876286751438848:12345-192.168.202.23@tcp:103:ldlm_bl.0 Request processed in 159us (539us total) trans 0 rc 0/0 00000100:00100000:3.0:1789366661.177039:0:8419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 60 00000100:00080000:0.0:1789366661.177150:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1789366661.177231:0:5817:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9638b6ce3800/0x8da3486b955f39ec lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366661.177239:0:5817:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9638b6ce3800/0x8da3486b955f39ec lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366661.177261:0:5817:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720de00/0x8da3486b955f39f3 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366661.177269:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720de00/0x8da3486b955f39f3 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366661.177286:0:5817:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720de00/0x8da3486b955f39f3 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789366661.178492:0:5817:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:0.0:1789366661.178506:0:5817:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9638b6ce3800/0x8da3486b955f39ec lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366661.178514:0:5817:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9638b6ce3800/0x8da3486b955f39ec lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366661.178521:0:5817:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9638b6ce3800/0x8da3486b955f39ec lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366661.178527:0:5817:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9638b6ce3800 already unused, calling callback (ffffffffc20ee4f0) 00010000:00010000:0.0:1789366661.178532:0:5817:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9638b6ce3800/0x8da3486b955f39ec lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366661.178540:0:5817:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9638b6ce3800/0x8da3486b955f39ec lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366661.178551:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff963890797800) 00010000:00010000:0.0:1789366661.178554:0:5817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789366661.178558:0:5817:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9638b6ce3800/0x8da3486b955f39ec lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366661.178564:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9638b6ce3800/0x8da3486b955f39ec lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789366661.178581:0:5817:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000007eef1d88 reply state 00000000d81f226c transno 4294967416 ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720de00/0x8da3486b955f39f3 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789366661.178600:0:5817:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789366661.178673:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638af282680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0ab23baa-a205-44ad-bf17-f7b47295d82b+15:11334:x1876286751438720:12345-192.168.202.23@tcp:36:lfs.0 Request processed in 6117us (6297us total) trans 4294967416 rc 0/0 00000100:00100000:0.0:1789366661.178681:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 140 00010000:00010000:0.0:1789366661.180528:0:3271:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720de00/0x8da3486b955f39f3 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366661.180542:0:3271:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720de00/0x8da3486b955f39f3 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366661.180550:0:3271:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720de00/0x8da3486b955f39f3 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366661.180556:0:3271:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9638b720de00 already unused, calling callback (ffffffffc20ee4f0) 00010000:00010000:0.0:1789366661.180560:0:3271:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720de00/0x8da3486b955f39f3 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366661.180568:0:3271:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720de00/0x8da3486b955f39f3 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366661.180582:0:3271:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff963890797900) 00010000:00010000:0.0:1789366661.180585:0:3271:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789366661.180589:0:3271:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720de00/0x8da3486b955f39f3 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366661.180595:0:3271:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720de00/0x8da3486b955f39f3 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789366661.238338:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:2.0:1789366661.238707:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751438976 00000100:00100000:2.0:1789366661.238754:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751438976 00000100:00100000:2.0:1789366661.238813:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 141 00000100:00100000:2.0:1789366661.238824:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638af281880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0ab23baa-a205-44ad-bf17-f7b47295d82b+14:11342:x1876286751438976:12345-192.168.202.23@tcp:101:lctl.0 00010000:00010000:2.0:1789366661.238844:0:5816:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789366661.238864:0:5816:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c8400/0x8da3486b955f39fa lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xda917a494d06c18e expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366661.239223:0:5816:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9400/0x8da3486b955f3a01 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366661.239236:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9400/0x8da3486b955f3a01 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366661.239261:0:5816:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9400/0x8da3486b955f3a01 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789366661.239299:0:5816:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1789366661.239303:0:5816:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1789366661.239325:0:5816:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9400/0x8da3486b955f3a01 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366661.239350:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c8400/0x8da3486b955f39fa lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.23@tcp remote: 0xda917a494d06c18e expref: 16 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366661.239369:0:5816:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9400/0x8da3486b955f3a01 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.23@tcp remote: 0xda917a494d06c18e expref: 15 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366661.239377:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9638a7404800) 00010000:00010000:2.0:1789366661.239379:0:5816:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789366661.239383:0:5816:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9638902c9400, rc 0) 00000100:00100000:2.0:1789366661.239492:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638af281880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0ab23baa-a205-44ad-bf17-f7b47295d82b+15:11342:x1876286751438976:12345-192.168.202.23@tcp:101:lctl.0 Request processed in 669us (1163us total) trans 0 rc 0/0 00000100:00100000:2.0:1789366661.239499:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 141 00000100:00100000:1.0:1789366661.285838:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:0.0:1789366661.285907:0:7132:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751439104 00000100:00100000:0.0:1789366661.285926:0:7132:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751439104 00000100:00100000:0.0:1789366661.285989:0:7132:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 142 00000100:00100000:0.0:1789366661.286002:0:7132:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638a74cbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0ab23baa-a205-44ad-bf17-f7b47295d82b+15:11348:x1876286751439104:12345-192.168.202.23@tcp:101:bash.0 00010000:00010000:0.0:1789366661.286022:0:7132:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789366661.286041:0:7132:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720de00/0x8da3486b955f3a08 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xda917a494d06c195 expref: -99 pid: 7132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366661.286105:0:7132:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720dc00/0x8da3486b955f3a0f lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366661.286120:0:7132:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720dc00/0x8da3486b955f3a0f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366661.286132:0:7132:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720dc00/0x8da3486b955f3a0f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366661.286155:0:7132:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720cc00/0x8da3486b955f3a16 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366661.286163:0:7132:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720cc00/0x8da3486b955f3a16 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366661.286169:0:7132:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720cc00/0x8da3486b955f3a16 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366661.286254:0:7132:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720c800/0x8da3486b955f3a1d lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366661.286262:0:7132:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720c800/0x8da3486b955f3a1d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366661.286268:0:7132:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720c800/0x8da3486b955f3a1d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789366661.286301:0:7132:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00000004:00200000:0.0:1789366661.286305:0:7132:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1789366661.286322:0:7132:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720c800/0x8da3486b955f3a1d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366661.286334:0:7132:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720dc00/0x8da3486b955f3a0f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366661.286340:0:7132:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720dc00/0x8da3486b955f3a0f lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366661.286347:0:7132:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720dc00/0x8da3486b955f3a0f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366661.286353:0:7132:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9638b720dc00 already unused, calling callback (ffffffffc20ee4f0) 00010000:00010000:0.0:1789366661.286358:0:7132:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720dc00/0x8da3486b955f3a0f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366661.286366:0:7132:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720dc00/0x8da3486b955f3a0f lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366661.286378:0:7132:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9638a7404800) 00010000:00010000:0.0:1789366661.286380:0:7132:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789366661.286385:0:7132:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720dc00/0x8da3486b955f3a0f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366661.286391:0:7132:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720dc00/0x8da3486b955f3a0f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366661.286403:0:7132:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720cc00/0x8da3486b955f3a16 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366661.286419:0:7132:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720cc00/0x8da3486b955f3a16 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366661.286424:0:7132:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720cc00/0x8da3486b955f3a16 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366661.286429:0:7132:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9638b720cc00 already unused, calling callback (ffffffffc20ee4f0) 00010000:00010000:0.0:1789366661.286432:0:7132:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720cc00/0x8da3486b955f3a16 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366661.286439:0:7132:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720cc00/0x8da3486b955f3a16 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366661.286446:0:7132:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff963890797900) 00010000:00010000:0.0:1789366661.286448:0:7132:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789366661.286451:0:7132:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720cc00/0x8da3486b955f3a16 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366661.286457:0:7132:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720cc00/0x8da3486b955f3a16 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366661.286498:0:7132:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720de00/0x8da3486b955f3a08 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.23@tcp remote: 0xda917a494d06c195 expref: 17 pid: 7132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366661.286511:0:7132:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720c800/0x8da3486b955f3a1d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.23@tcp remote: 0xda917a494d06c195 expref: 16 pid: 7132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366661.286518:0:7132:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff963890797800) 00010000:00010000:0.0:1789366661.286520:0:7132:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1789366661.286529:0:7132:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9638b720c800, rc 0) 00000100:00100000:0.0:1789366661.286591:0:7132:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638a74cbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0ab23baa-a205-44ad-bf17-f7b47295d82b+16:11348:x1876286751439104:12345-192.168.202.23@tcp:101:bash.0 Request processed in 592us (759us total) trans 0 rc 0/0 00000100:00100000:0.0:1789366661.286597:0:7132:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 142 00000100:00100000:0.0:1789366661.289905:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:2.0:1789366661.290035:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751439360 00000100:00100000:2.0:1789366661.290045:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751439360 00000100:00100000:2.0:1789366661.290100:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 143 00000100:00100000:2.0:1789366661.290111:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638af282d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0ab23baa-a205-44ad-bf17-f7b47295d82b+16:11348:x1876286751439360:12345-192.168.202.23@tcp:101:bash.0 00010000:00010000:2.0:1789366661.290129:0:5817:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789366661.290159:0:5817:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9c00/0x8da3486b955f3a24 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xda917a494d06c19c expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366661.290297:0:5817:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9e00/0x8da3486b955f3a2b lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366661.290312:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9e00/0x8da3486b955f3a2b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366661.290323:0:5817:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9e00/0x8da3486b955f3a2b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366661.290382:0:5817:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9000/0x8da3486b955f3a32 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366661.290390:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9000/0x8da3486b955f3a32 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366661.290398:0:5817:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9000/0x8da3486b955f3a32 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1789366661.291053:0:5817:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x4:0x0], index 1: 0 00010000:00010000:2.0:1789366661.291221:0:5817:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9600/0x8da3486b955f3a39 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366661.291230:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9600/0x8da3486b955f3a39 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366661.291238:0:5817:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9600/0x8da3486b955f3a39 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366661.291271:0:5817:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9e00/0x8da3486b955f3a2b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366661.291288:0:5817:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9e00/0x8da3486b955f3a2b lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366661.291295:0:5817:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9e00/0x8da3486b955f3a2b lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366661.291301:0:5817:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9638902c9e00 already unused, calling callback (ffffffffc20ee4f0) 00010000:00010000:2.0:1789366661.291305:0:5817:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9e00/0x8da3486b955f3a2b lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366661.291313:0:5817:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9e00/0x8da3486b955f3a2b lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366661.291322:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff963890797800) 00010000:00010000:2.0:1789366661.291325:0:5817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789366661.291329:0:5817:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9e00/0x8da3486b955f3a2b lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366661.291335:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9e00/0x8da3486b955f3a2b lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789366661.291348:0:5817:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000625ec7ea reply state 000000007dfe9294 transno 4294967417 ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9000/0x8da3486b955f3a32 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789366661.291357:0:5817:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1789366661.291385:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9c00/0x8da3486b955f3a24 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.23@tcp remote: 0xda917a494d06c19c expref: 19 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366661.291399:0:5817:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9600/0x8da3486b955f3a39 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.23@tcp remote: 0xda917a494d06c19c expref: 18 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366661.291416:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9638a7404f00) 00010000:00010000:2.0:1789366661.291419:0:5817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789366661.291421:0:5817:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9638902c9600, rc 0) 00000100:00100000:2.0:1789366661.291491:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638af282d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0ab23baa-a205-44ad-bf17-f7b47295d82b+19:11348:x1876286751439360:12345-192.168.202.23@tcp:101:bash.0 Request processed in 1381us (1595us total) trans 4294967417 rc 0/0 00000100:00100000:2.0:1789366661.291498:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 143 00010000:00010000:3.0:1789366661.293085:0:3270:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9000/0x8da3486b955f3a32 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366661.293096:0:3270:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9000/0x8da3486b955f3a32 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366661.293111:0:3270:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9000/0x8da3486b955f3a32 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366661.293115:0:3270:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9638902c9000 already unused, calling callback (ffffffffc20ee4f0) 00010000:00010000:3.0:1789366661.293118:0:3270:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9000/0x8da3486b955f3a32 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366661.293122:0:3270:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9000/0x8da3486b955f3a32 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366661.293131:0:3270:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9638a7404000) 00010000:00010000:3.0:1789366661.293133:0:3270:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789366661.293135:0:3270:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9000/0x8da3486b955f3a32 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366661.293150:0:3270:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9000/0x8da3486b955f3a32 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789366661.297198:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:2.0:1789366661.297242:0:8065:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751439488 00000100:00100000:2.0:1789366661.297253:0:8065:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751439488 00000100:00080000:0.0:1789366661.297373:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789366661.297418:0:8065:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 47 00000100:00100000:2.0:1789366661.297443:0:8065:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638af283b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0ab23baa-a205-44ad-bf17-f7b47295d82b+5:2356:x1876286751439488:12345-192.168.202.23@tcp:101:bash.0 00010000:00010000:2.0:1789366661.297461:0:8065:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789366661.297482:0:8065:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000099873343/0x8da3486b955f3a47 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda917a494d06c1a3 expref: -99 pid: 8065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789366661.297511:0:8065:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789366661.297530:0:8065:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=236s v=(0 0) 00010000:00010000:2.0:1789366661.297535:0:8065:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789366661.297543:0:8065:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000099873343/0x8da3486b955f3a47 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.23@tcp remote: 0xda917a494d06c1a3 expref: 6 pid: 8065 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366661.297562:0:8065:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000099873343/0x8da3486b955f3a47 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.23@tcp remote: 0xda917a494d06c1a3 expref: 6 pid: 8065 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366661.297575:0:8065:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9638902c8200, rc 0) 00000100:00100000:2.0:1789366661.297636:0:8065:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638af283b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0ab23baa-a205-44ad-bf17-f7b47295d82b+6:2356:x1876286751439488:12345-192.168.202.23@tcp:101:bash.0 Request processed in 198us (446us total) trans 0 rc 0/0 00000100:00100000:2.0:1789366661.297656:0:8065:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 47 00000100:00100000:2.0:1789366661.302299:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:1.0:1789366661.302360:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751439616 00000100:00100000:1.0:1789366661.302378:0:6660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751439616 00000100:00100000:1.0:1789366661.302445:0:6660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 48 00000100:00100000:1.0:1789366661.302455:0:6660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963883309c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0ab23baa-a205-44ad-bf17-f7b47295d82b+6:11348:x1876286751439616:12345-192.168.202.23@tcp:101:bash.0 00010000:00010000:1.0:1789366661.302471:0:6660:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789366661.302498:0:6660:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003ac13bbc/0x8da3486b955f3a4e lrc: 2/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda917a494d06c1aa expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366661.302521:0:6660:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000099873343/0x8da3486b955f3a47 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.23@tcp remote: 0xda917a494d06c1a3 expref: 7 pid: 8065 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366661.302527:0:6660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789366661.302531:0:6660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789366661.302534:0:6660:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003ac13bbc/0x8da3486b955f3a4e lrc: 4/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.23@tcp remote: 0xda917a494d06c1aa expref: 7 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366661.302558:0:6660:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000099873343/0x8da3486b955f3a47 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.23@tcp remote: 0xda917a494d06c1a3 expref: 7 pid: 8065 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366661.302568:0:6660:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000099873343/0x8da3486b955f3a47 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.23@tcp remote: 0xda917a494d06c1a3 expref: 7 pid: 8065 timeout: 336 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789366661.302578:0:6660:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9638a74cad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6660:1876286758778880:192.168.202.23@tcp:104: 00000100:00100000:1.0:1789366661.302677:0:6660:0:(client.c:2716:ptlrpc_set_wait()) set ffff96388894a300 going to sleep for 11 seconds 00000100:00100000:1.0:1789366661.306009:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:2.0:1789366661.306223:0:6660:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9638a74cad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6660:1876286758778880:192.168.202.23@tcp:104: 00000100:00100000:3.0:1789366661.306254:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751439744 00010000:00010000:2.0:1789366661.306258:0:6660:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000003ac13bbc/0x8da3486b955f3a4e lrc: 3/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.23@tcp remote: 0xda917a494d06c1aa expref: 7 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789366661.306262:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751439744 00010000:00010000:2.0:1789366661.306282:0:6660:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9638b6ce3600, rc 0) 00010000:00010000:3.0:1789366661.306300:0:5803:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000099873343/0x8da3486b955f3a47 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.23@tcp remote: 0xda917a494d06c1a3 expref: 8 pid: 8065 timeout: 336 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789366661.306347:0:6660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963883309c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0ab23baa-a205-44ad-bf17-f7b47295d82b+8:11348:x1876286751439616:12345-192.168.202.23@tcp:101:bash.0 Request processed in 3891us (4054us total) trans 0 rc 0/0 00000100:00100000:3.0:1789366661.306348:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 61 00000100:00100000:2.0:1789366661.306360:0:6660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 48 00000100:00100000:3.0:1789366661.306372:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638b6cbe300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0ab23baa-a205-44ad-bf17-f7b47295d82b+8:2355:x1876286751439744:12345-192.168.202.23@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789366661.306386:0:5803:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789366661.306408:0:5803:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000099873343/0x8da3486b955f3a47 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.23@tcp remote: 0xda917a494d06c1a3 expref: 7 pid: 8065 timeout: 336 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366661.306438:0:5803:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000099873343/0x8da3486b955f3a47 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.23@tcp remote: 0xda917a494d06c1a3 expref: 7 pid: 8065 timeout: 336 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366661.306461:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000099873343/0x8da3486b955f3a47 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.23@tcp remote: 0xda917a494d06c1a3 expref: 7 pid: 8065 timeout: 336 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366661.306474:0:5803:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789366661.306478:0:5803:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789366661.306486:0:5803:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000003ac13bbc/0x8da3486b955f3a4e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.23@tcp remote: 0xda917a494d06c1aa expref: 6 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366661.306496:0:5803:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003ac13bbc/0x8da3486b955f3a4e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.23@tcp remote: 0xda917a494d06c1aa expref: 6 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366661.306529:0:5803:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000003ac13bbc/0x8da3486b955f3a4e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.23@tcp remote: 0xda917a494d06c1aa expref: 6 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789366661.306542:0:5803:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9638bfef8a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5803:1876286758779008:192.168.202.23@tcp:105: 00000100:00100000:3.0:1789366661.306601:0:5803:0:(client.c:2716:ptlrpc_set_wait()) set ffff9638a7492f00 going to sleep for 11 seconds 00000100:00100000:3.0:1789366661.309633:0:5803:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9638bfef8a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5803:1876286758779008:192.168.202.23@tcp:105: 00000100:00100000:0.0:1789366661.309634:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00010000:00010000:3.0:1789366661.309658:0:5803:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789366661.309775:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638b6cbe300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0ab23baa-a205-44ad-bf17-f7b47295d82b+6:2355:x1876286751439744:12345-192.168.202.23@tcp:103:ldlm_bl.0 Request processed in 3414us (3773us total) trans 0 rc 0/0 00000100:00100000:3.0:1789366661.309787:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 61 00000100:00100000:1.0:1789366661.309868:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751440000 00000100:00100000:1.0:1789366661.309875:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751440000 00000100:00100000:1.0:1789366661.309923:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 36 00000100:00100000:1.0:1789366661.309932:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638af280000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0ab23baa-a205-44ad-bf17-f7b47295d82b+18:11348:x1876286751440000:12345-192.168.202.23@tcp:35:bash.0 00000100:00100000:1.0:1789366661.310257:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638af280000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0ab23baa-a205-44ad-bf17-f7b47295d82b+19:11348:x1876286751440000:12345-192.168.202.23@tcp:35:bash.0 Request processed in 324us (624us total) trans 4294967418 rc 0/0 00000100:00100000:1.0:1789366661.310274:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 36 00000100:00100000:0.0:1789366661.322705:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:3.0:1789366661.322763:0:6665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751440128 00000100:00100000:3.0:1789366661.322775:0:6665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751440128 00000100:00100000:0.0:1789366661.322795:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00002000:00100000:3.0:1789366661.322827:0:6665:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x4:0x0] (0->12) req@ffff9638af283100 x1876286751440128/t0(0) o4->0ab23baa-a205-44ad-bf17-f7b47295d82b@192.168.202.23@tcp:62/0 lens 504/0 e 0 to 0 dl 1789366672 ref 1 fl New:/600/ffffffff rc 0/-1 job:'bash.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789366661.322839:0:6665:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9638af283100 with x1876286751440128 ext(0->12) 00002000:00010000:3.0:1789366661.322845:0:6665:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9638af283100 00000100:00100000:3.0:1789366661.322882:0:6665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 4 00000100:00100000:3.0:1789366661.322893:0:6665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638af283100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0ab23baa-a205-44ad-bf17-f7b47295d82b+6:2357:x1876286751440128:12345-192.168.202.23@tcp:4:bash.0 00000100:00100000:3.0:1789366661.323401:0:6665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638af283100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0ab23baa-a205-44ad-bf17-f7b47295d82b+8:2357:x1876286751440128:12345-192.168.202.23@tcp:4:bash.0 Request processed in 509us (704us total) trans 4294967305 rc 0/0 00000100:00100000:3.0:1789366661.323408:0:6665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 4 00002000:00100000:3.0:1789366661.323415:0:6665:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x4:0x0] (0->12) req@ffff9638af283100 x1876286751440128/t4294967305(0) o4->0ab23baa-a205-44ad-bf17-f7b47295d82b@192.168.202.23@tcp:62/0 lens 504/448 e 0 to 0 dl 1789366672 ref 1 fl Complete:/600/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789366661.323423:0:6665:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9638af283100 with x1876286751440128 ext(0->12) 00002000:00010000:3.0:1789366661.323427:0:6665:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9638af283100 00000100:00100000:1.0:1789366661.323505:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751440256 00000100:00100000:1.0:1789366661.323510:0:6659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751440256 00000100:00100000:1.0:1789366661.323547:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 49 00000100:00100000:1.0:1789366661.323554:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638af283800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0ab23baa-a205-44ad-bf17-f7b47295d82b+8:2356:x1876286751440256:12345-192.168.202.23@tcp:16:kworker.0 00000001:00080000:0.0:1789366661.333189:0:7617:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967305 is committed 00000100:00100000:1.0:1789366661.333359:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638af283800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0ab23baa-a205-44ad-bf17-f7b47295d82b+6:2356:x1876286751440256:12345-192.168.202.23@tcp:16:kworker.0 Request processed in 9800us (10558us total) trans 0 rc 0/0 00000100:00100000:1.0:1789366661.333372:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 49 00000100:00100000:0.0:1789366661.343792:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:2.0:1789366661.343884:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751440512 00000100:00100000:2.0:1789366661.343893:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751440512 00000100:00100000:2.0:1789366661.343938:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 144 00000100:00100000:2.0:1789366661.343946:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638af282300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0ab23baa-a205-44ad-bf17-f7b47295d82b+19:11358:x1876286751440512:12345-192.168.202.23@tcp:101:lfs.0 00010000:00010000:2.0:1789366661.343968:0:5816:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789366661.343988:0:5816:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c8a00/0x8da3486b955f3a55 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xda917a494d06c1b1 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789366661.344089:0:5816:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:2.0:1789366661.344229:0:5816:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c8a00/0x8da3486b955f3a55 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.23@tcp remote: 0xda917a494d06c1b1 expref: 21 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366661.344244:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9638a7404800) 00010000:00010000:2.0:1789366661.344247:0:5816:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789366661.344253:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c8a00/0x8da3486b955f3a55 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.23@tcp remote: 0xda917a494d06c1b1 expref: 21 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366661.344297:0:5816:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9638902c8a00, rc 0) 00000100:00100000:2.0:1789366661.344354:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638af282300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0ab23baa-a205-44ad-bf17-f7b47295d82b+20:11358:x1876286751440512:12345-192.168.202.23@tcp:101:lfs.0 Request processed in 407us (571us total) trans 4294967419 rc 301/301 00000100:00100000:2.0:1789366661.344362:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 144 00000100:00100000:2.0:1789366661.346763:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:1.0:1789366661.346825:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751440768 00000100:00100000:1.0:1789366661.346844:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751440768 00000100:00100000:1.0:1789366661.346893:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 37 00000100:00100000:1.0:1789366661.346903:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963883308a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0ab23baa-a205-44ad-bf17-f7b47295d82b+20:11358:x1876286751440768:12345-192.168.202.23@tcp:35:lfs.0 00000100:00100000:1.0:1789366661.347110:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963883308a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0ab23baa-a205-44ad-bf17-f7b47295d82b+21:11358:x1876286751440768:12345-192.168.202.23@tcp:35:lfs.0 Request processed in 207us (351us total) trans 4294967420 rc 0/0 00000100:00100000:1.0:1789366661.347118:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 37 00000100:00100000:0.0:1789366661.378166:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:1.0:1789366661.378225:0:7132:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751440896 00000100:00100000:1.0:1789366661.378235:0:7132:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751440896 00000100:00100000:1.0:1789366661.378280:0:7132:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 145 00000100:00100000:1.0:1789366661.378288:0:7132:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638af280380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0ab23baa-a205-44ad-bf17-f7b47295d82b+21:11364:x1876286751440896:12345-192.168.202.23@tcp:101:lfs.0 00010000:00010000:1.0:1789366661.378314:0:7132:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789366661.378335:0:7132:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9638b6ce2200/0x8da3486b955f3a63 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xda917a494d06c1b8 expref: -99 pid: 7132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366661.378407:0:7132:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9638b6ce3400/0x8da3486b955f3a6a lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366661.378432:0:7132:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9638b6ce3400/0x8da3486b955f3a6a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366661.378441:0:7132:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9638b6ce3400/0x8da3486b955f3a6a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789366661.378469:0:7132:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00000004:00200000:1.0:1789366661.378471:0:7132:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1789366661.378483:0:7132:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9638b6ce3400/0x8da3486b955f3a6a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366661.378503:0:7132:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9638b6ce2200/0x8da3486b955f3a63 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.23@tcp remote: 0xda917a494d06c1b8 expref: 23 pid: 7132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366661.378515:0:7132:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9638b6ce3400/0x8da3486b955f3a6a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.23@tcp remote: 0xda917a494d06c1b8 expref: 22 pid: 7132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366661.378522:0:7132:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff963890797800) 00010000:00010000:1.0:1789366661.378525:0:7132:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789366661.378527:0:7132:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9638b6ce3400, rc 0) 00000100:00100000:1.0:1789366661.378583:0:7132:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638af280380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0ab23baa-a205-44ad-bf17-f7b47295d82b+22:11364:x1876286751440896:12345-192.168.202.23@tcp:101:lfs.0 Request processed in 296us (426us total) trans 0 rc 0/0 00000100:00100000:1.0:1789366661.378588:0:7132:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 145 00000100:00100000:0.0:1789366661.380554:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:2.0:1789366661.380620:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751441152 00000100:00100000:2.0:1789366661.380627:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751441152 00000100:00100000:2.0:1789366661.380671:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 146 00000100:00100000:2.0:1789366661.380678:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638af282a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0ab23baa-a205-44ad-bf17-f7b47295d82b+22:11364:x1876286751441152:12345-192.168.202.23@tcp:101:lfs.0 00010000:00010000:2.0:1789366661.380697:0:5817:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789366661.380712:0:5817:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9a00/0x8da3486b955f3a71 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xda917a494d06c1bf expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366661.380800:0:5817:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c8c00/0x8da3486b955f3a78 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366661.380810:0:5817:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9600/0x8da3486b955f3a39 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.23@tcp remote: 0xda917a494d06c19c expref: 23 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366661.380816:0:5817:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c8c00/0x8da3486b955f3a78 lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366661.380843:0:5817:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9600/0x8da3486b955f3a39 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.23@tcp remote: 0xda917a494d06c19c expref: 23 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366661.380856:0:5817:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9600/0x8da3486b955f3a39 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.23@tcp remote: 0xda917a494d06c19c expref: 23 pid: 5817 timeout: 336 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789366661.380892:0:5817:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96388330aa00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5817:1876286758779136:192.168.202.23@tcp:104: 00000100:00100000:2.0:1789366661.380957:0:5817:0:(client.c:2716:ptlrpc_set_wait()) set ffff963882efef00 going to sleep for 11 seconds 00000100:00100000:0.0:1789366661.381931:0:5817:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96388330aa00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5817:1876286758779136:192.168.202.23@tcp:104: 00010000:00010000:0.0:1789366661.381953:0:5817:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c8c00/0x8da3486b955f3a78 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789366661.382007:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:0.0:1789366661.382059:0:8419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751441280 00000100:00100000:0.0:1789366661.382063:0:8419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751441280 00010000:00010000:0.0:1789366661.382081:0:8419:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9600/0x8da3486b955f3a39 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.23@tcp remote: 0xda917a494d06c19c expref: 24 pid: 5817 timeout: 336 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789366661.382115:0:8419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 62 00000100:00100000:0.0:1789366661.382123:0:8419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638bfef8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0ab23baa-a205-44ad-bf17-f7b47295d82b+24:2354:x1876286751441280:12345-192.168.202.23@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789366661.382134:0:8419:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789366661.382153:0:8419:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9600/0x8da3486b955f3a39 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.23@tcp remote: 0xda917a494d06c19c expref: 24 pid: 5817 timeout: 336 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366661.382179:0:8419:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9600/0x8da3486b955f3a39 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.23@tcp remote: 0xda917a494d06c19c expref: 24 pid: 5817 timeout: 336 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366661.382197:0:8419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9600/0x8da3486b955f3a39 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.23@tcp remote: 0xda917a494d06c19c expref: 24 pid: 5817 timeout: 336 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366661.382210:0:8419:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9638a7404f00) 00010000:00010000:0.0:1789366661.382215:0:8419:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c8c00/0x8da3486b955f3a78 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366661.382229:0:8419:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c8c00/0x8da3486b955f3a78 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366661.382234:0:8419:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c8c00/0x8da3486b955f3a78 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366661.382250:0:8419:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789366661.382281:0:5817:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c8c00/0x8da3486b955f3a78 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366661.382290:0:5817:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c8c00/0x8da3486b955f3a78 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789366661.382292:0:8419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638bfef8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0ab23baa-a205-44ad-bf17-f7b47295d82b+23:2354:x1876286751441280:12345-192.168.202.23@tcp:103:ldlm_bl.0 Request processed in 160us (276us total) trans 0 rc 0/0 00000100:00100000:0.0:1789366661.382305:0:8419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 62 00000004:00200000:2.0:1789366661.382307:0:5817:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:2.0:1789366661.382422:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9a00/0x8da3486b955f3a71 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.23@tcp remote: 0xda917a494d06c1bf expref: 24 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366661.382436:0:5817:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c8c00/0x8da3486b955f3a78 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.23@tcp remote: 0xda917a494d06c1bf expref: 23 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366661.382444:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9638a7404f00) 00010000:00010000:2.0:1789366661.382447:0:5817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1789366661.382450:0:5817:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9638902c8c00, rc 0) 00000100:00100000:2.0:1789366661.382480:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638af282a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0ab23baa-a205-44ad-bf17-f7b47295d82b+23:11364:x1876286751441152:12345-192.168.202.23@tcp:101:lfs.0 Request processed in 1802us (1930us total) trans 4294967421 rc 0/0 00000100:00100000:2.0:1789366661.382486:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 146 00000100:00100000:3.0:1789366661.386570:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:2.0:1789366661.386623:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751441536 00000100:00100000:2.0:1789366661.386632:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751441536 00000100:00100000:2.0:1789366661.386682:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 147 00000100:00100000:2.0:1789366661.386693:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638bfefa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0ab23baa-a205-44ad-bf17-f7b47295d82b+23:11364:x1876286751441536:12345-192.168.202.23@tcp:101:lfs.0 00010000:00010000:2.0:1789366661.386738:0:5816:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789366661.386752:0:5816:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1789366661.386774:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c8c00/0x8da3486b955f3a78 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.23@tcp remote: 0xda917a494d06c1bf expref: 23 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366661.386787:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9638a7404f00) 00010000:00010000:2.0:1789366661.386796:0:5816:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789366661.386807:0:5816:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c8000/0x8da3486b955f3a86 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xda917a494d06c1c6 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366661.386882:0:5816:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9800/0x8da3486b955f3a8d lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366661.386892:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9800/0x8da3486b955f3a8d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366661.386898:0:5816:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9800/0x8da3486b955f3a8d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789366661.386906:0:5816:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:2.0:1789366661.386988:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c8000/0x8da3486b955f3a86 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.23@tcp remote: 0xda917a494d06c1c6 expref: 25 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366661.386998:0:5816:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9800/0x8da3486b955f3a8d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.23@tcp remote: 0xda917a494d06c1c6 expref: 24 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366661.387006:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9638a7404300) 00010000:00010000:2.0:1789366661.387008:0:5816:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1789366661.387011:0:5816:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9638902c9800, rc 0) 00000100:00100000:2.0:1789366661.387056:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638bfefa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0ab23baa-a205-44ad-bf17-f7b47295d82b+24:11364:x1876286751441536:12345-192.168.202.23@tcp:101:lfs.0 Request processed in 367us (494us total) trans 4294967422 rc 0/0 00000100:00100000:2.0:1789366661.387068:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 147 00000100:00100000:1.0:1789366661.390125:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:0.0:1789366661.390181:0:7132:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751441664 00000100:00100000:0.0:1789366661.390189:0:7132:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751441664 00000100:00100000:0.0:1789366661.390239:0:7132:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 148 00000100:00100000:0.0:1789366661.390247:0:7132:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638b6cbea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0ab23baa-a205-44ad-bf17-f7b47295d82b+24:11364:x1876286751441664:12345-192.168.202.23@tcp:101:lfs.0 00010000:00010000:0.0:1789366661.390266:0:7132:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789366661.390281:0:7132:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720c600/0x8da3486b955f3a9b lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xda917a494d06c1cd expref: -99 pid: 7132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366661.390343:0:7132:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720c600/0x8da3486b955f3a9b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.23@tcp remote: 0xda917a494d06c1cd expref: 25 pid: 7132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366661.390356:0:7132:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720c600/0x8da3486b955f3a9b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.23@tcp remote: 0xda917a494d06c1cd expref: 25 pid: 7132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366661.390373:0:7132:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9638a7404300) 00010000:00010000:0.0:1789366661.390376:0:7132:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1789366661.390379:0:7132:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9638b720c600, rc 0) 00000100:00100000:0.0:1789366661.390426:0:7132:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638b6cbea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0ab23baa-a205-44ad-bf17-f7b47295d82b+25:11364:x1876286751441664:12345-192.168.202.23@tcp:101:lfs.0 Request processed in 180us (307us total) trans 0 rc 0/0 00000100:00100000:0.0:1789366661.390433:0:7132:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 148 00000100:00100000:1.0:1789366661.394487:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:3.0:1789366661.394543:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751441792 00000100:00100000:3.0:1789366661.394552:0:6661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751441792 00000100:00100000:3.0:1789366661.394611:0:6661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 50 00000100:00100000:3.0:1789366661.394631:0:6661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963882ee1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0ab23baa-a205-44ad-bf17-f7b47295d82b+6:2357:x1876286751441792:12345-192.168.202.23@tcp:1:lfs.0 00010000:00010000:3.0:1789366661.394666:0:6661:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b2a22d6c/0x8da3486b955f3aa2 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366661.394694:0:6661:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000003ac13bbc/0x8da3486b955f3a4e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.23@tcp remote: 0xda917a494d06c1aa expref: 6 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366661.394741:0:6661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789366661.394747:0:6661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789366661.394753:0:6661:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b2a22d6c/0x8da3486b955f3aa2 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366661.394786:0:6661:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000003ac13bbc/0x8da3486b955f3a4e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.23@tcp remote: 0xda917a494d06c1aa expref: 6 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366661.394808:0:6661:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000003ac13bbc/0x8da3486b955f3a4e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.23@tcp remote: 0xda917a494d06c1aa expref: 6 pid: 6660 timeout: 336 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789366661.394823:0:6661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9638bfef9c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6661:1876286758779264:192.168.202.23@tcp:104: 00000100:00100000:3.0:1789366661.394906:0:6661:0:(client.c:2716:ptlrpc_set_wait()) set ffff9638a74926c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789366661.396081:0:6661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9638bfef9c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6661:1876286758779264:192.168.202.23@tcp:104: 00010000:00010000:0.0:1789366661.396097:0:6661:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000b2a22d6c/0x8da3486b955f3aa2 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789366661.396303:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:0.0:1789366661.396363:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751441920 00000100:00100000:0.0:1789366661.396369:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751441920 00010000:00010000:0.0:1789366661.396392:0:5801:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000003ac13bbc/0x8da3486b955f3a4e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.23@tcp remote: 0xda917a494d06c1aa expref: 7 pid: 6660 timeout: 336 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789366661.396425:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 63 00000100:00100000:0.0:1789366661.396434:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963882ee0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0ab23baa-a205-44ad-bf17-f7b47295d82b+7:2355:x1876286751441920:12345-192.168.202.23@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789366661.396446:0:5801:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:0.0:1789366661.396463:0:5801:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:0.0:1789366661.396473:0:5801:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb mtime from disk: 0 -> 1789366661 00002000:00010000:0.0:1789366661.396476:0:5801:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb ctime from disk: 0 -> 1789366661 00002000:00010000:0.0:1789366661.396479:0:5801:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb blocks from disk: 1 -> 11 00010000:00010000:0.0:1789366661.396486:0:5801:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000003ac13bbc/0x8da3486b955f3a4e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.23@tcp remote: 0xda917a494d06c1aa expref: 7 pid: 6660 timeout: 336 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366661.396504:0:5801:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000003ac13bbc/0x8da3486b955f3a4e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.23@tcp remote: 0xda917a494d06c1aa expref: 7 pid: 6660 timeout: 336 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366661.396525:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003ac13bbc/0x8da3486b955f3a4e lrc: 0/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.23@tcp remote: 0xda917a494d06c1aa expref: 7 pid: 6660 timeout: 336 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366661.396538:0:5801:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789366661.396542:0:5801:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789366661.396548:0:5801:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000b2a22d6c/0x8da3486b955f3aa2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366661.396558:0:5801:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b2a22d6c/0x8da3486b955f3aa2 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366661.396581:0:5801:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789366661.396615:0:6661:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000b2a22d6c/0x8da3486b955f3aa2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789366661.396622:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963882ee0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0ab23baa-a205-44ad-bf17-f7b47295d82b+6:2355:x1876286751441920:12345-192.168.202.23@tcp:103:ldlm_bl.0 Request processed in 187us (318us total) trans 0 rc 0/0 00010000:00010000:3.0:1789366661.396634:0:6661:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b2a22d6c/0x8da3486b955f3aa2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789366661.396636:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 63 00010000:00010000:3.0:1789366661.396662:0:6661:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b2a22d6c/0x8da3486b955f3aa2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366661.396681:0:6661:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b2a22d6c/0x8da3486b955f3aa2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366661.396702:0:6661:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b2a22d6c/0x8da3486b955f3aa2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366661.396710:0:6661:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9638832d3400 already unused, calling callback (ffffffffc16df520) 00010000:00010000:3.0:1789366661.396714:0:6661:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b2a22d6c/0x8da3486b955f3aa2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366661.396749:0:6661:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b2a22d6c/0x8da3486b955f3aa2 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366661.396763:0:6661:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b2a22d6c/0x8da3486b955f3aa2 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366661.396771:0:6661:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b2a22d6c/0x8da3486b955f3aa2 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789366661.396826:0:6661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963882ee1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0ab23baa-a205-44ad-bf17-f7b47295d82b+5:2357:x1876286751441792:12345-192.168.202.23@tcp:1:lfs.0 Request processed in 2198us (2347us total) trans 0 rc 0/0 00000100:00100000:3.0:1789366661.396831:0:6661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 50 00000100:00100000:1.0:1789366661.397830:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:0.0:1789366661.397867:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751442176 00000100:00100000:0.0:1789366661.397873:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751442176 00000100:00100000:0.0:1789366661.397911:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 38 00000100:00100000:0.0:1789366661.397921:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963888cbb050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0ab23baa-a205-44ad-bf17-f7b47295d82b+25:11364:x1876286751442176:12345-192.168.202.23@tcp:35:lfs.0 00000004:00010000:0.0:1789366661.397977:0:5819:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0xb:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9800/0x8da3486b955f3a8d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.23@tcp remote: 0xda917a494d06c1c6 expref: 25 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789366661.398227:0:5819:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967423 00000001:00080000:0.0:1789366661.398271:0:5819:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967424 00000001:00080000:0.0:1789366661.398798:0:5819:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967425 00010000:00010000:0.0:1789366661.398848:0:5819:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720c400/0x8da3486b955f3aa9 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366661.398862:0:5819:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720c600/0x8da3486b955f3a9b lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.23@tcp remote: 0xda917a494d06c1cd expref: 29 pid: 7132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366661.398872:0:5819:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720c400/0x8da3486b955f3aa9 lrc: 4/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366661.398901:0:5819:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720c600/0x8da3486b955f3a9b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.23@tcp remote: 0xda917a494d06c1cd expref: 29 pid: 7132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366661.398914:0:5819:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720c600/0x8da3486b955f3a9b lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.23@tcp remote: 0xda917a494d06c1cd expref: 29 pid: 7132 timeout: 336 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789366661.398927:0:5819:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9638af280e00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5819:1876286758779392:192.168.202.23@tcp:104: 00000100:00100000:0.0:1789366661.399001:0:5819:0:(client.c:2716:ptlrpc_set_wait()) set ffff96388a34d780 going to sleep for 11 seconds 00000100:00100000:2.0:1789366661.400942:0:5819:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9638af280e00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5819:1876286758779392:192.168.202.23@tcp:104: 00010000:00010000:2.0:1789366661.400967:0:5819:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720c400/0x8da3486b955f3aa9 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789366661.401488:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:0.0:1789366661.401607:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751442304 00000100:00100000:0.0:1789366661.401614:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751442304 00010000:00010000:0.0:1789366661.401646:0:5802:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720c600/0x8da3486b955f3a9b lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.23@tcp remote: 0xda917a494d06c1cd expref: 30 pid: 7132 timeout: 336 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789366661.401678:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 64 00000100:00100000:0.0:1789366661.401694:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963882ee2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0ab23baa-a205-44ad-bf17-f7b47295d82b+30:2355:x1876286751442304:12345-192.168.202.23@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789366661.401709:0:5802:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789366661.402049:0:5802:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720c600/0x8da3486b955f3a9b lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.23@tcp remote: 0xda917a494d06c1cd expref: 30 pid: 7132 timeout: 336 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366661.402064:0:5802:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720c600/0x8da3486b955f3a9b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.23@tcp remote: 0xda917a494d06c1cd expref: 30 pid: 7132 timeout: 336 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366661.402085:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720c600/0x8da3486b955f3a9b lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.23@tcp remote: 0xda917a494d06c1cd expref: 30 pid: 7132 timeout: 336 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366661.402109:0:5802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9638a7404300) 00010000:00010000:0.0:1789366661.402113:0:5802:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720c400/0x8da3486b955f3aa9 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366661.402290:0:5802:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720c400/0x8da3486b955f3aa9 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366661.402298:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720c400/0x8da3486b955f3aa9 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366661.402327:0:5802:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789366661.402371:0:5819:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720c400/0x8da3486b955f3aa9 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789366661.402374:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963882ee2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0ab23baa-a205-44ad-bf17-f7b47295d82b+29:2355:x1876286751442304:12345-192.168.202.23@tcp:103:ldlm_bl.0 Request processed in 680us (885us total) trans 0 rc 0/0 00010000:00010000:2.0:1789366661.402390:0:5819:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720c400/0x8da3486b955f3aa9 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789366661.402391:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 64 00000001:00080000:2.0:1789366661.402509:0:5819:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967426 00000001:00080000:2.0:1789366661.402688:0:5819:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967427 00000100:00100000:2.0:1789366661.402810:0:5819:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96388330aa00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5819:1876286758779520:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1789366661.402853:0:5819:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789366661.402934:0:5819:0:(client.c:2716:ptlrpc_set_wait()) set ffff963882efef00 going to sleep for 11 seconds 00000100:00100000:0.0:1789366661.402977:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286758779520 00000100:00100000:0.0:1789366661.402984:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286758779520 00000100:00100000:0.0:1789366661.403028:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1789366661.403037:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963883308e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5819:x1876286758779520:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1789366661.403150:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963883308e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5819:x1876286758779520:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 103us (285us total) trans 0 rc 0/0 00000100:00100000:0.0:1789366661.403158:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1789366661.403161:0:5819:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96388330aa00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5819:1876286758779520:0@lo:1000:mdt_rdpg00_001.0 00000100:00080000:1.0:1789366661.403280:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:00080000:2.0:1789366661.403493:0:5819:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967428 00000100:00100000:2.0:1789366661.403540:0:5819:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96388330aa00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5819:1876286758779648:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1789366661.403566:0:5819:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789366661.403586:0:5819:0:(client.c:2716:ptlrpc_set_wait()) set ffff963882efe300 going to sleep for 11 seconds 00000100:00100000:1.0:1789366661.403675:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286758779648 00000100:00100000:1.0:1789366661.403680:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286758779648 00000100:00100000:1.0:1789366661.403854:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1789366661.403864:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638a74cad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5819:x1876286758779648:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1789366661.404057:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638a74cad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5819:x1876286758779648:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 195us (489us total) trans 4294967306 rc 0/0 00000100:00100000:1.0:1789366661.404064:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1789366661.404088:0:5819:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96388330aa00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5819:1876286758779648:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:2.0:1789366661.404126:0:5819:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967429 00010000:00010000:2.0:1789366661.404167:0:5819:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720c400/0x8da3486b955f3aa9 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366661.404175:0:5819:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720c400/0x8da3486b955f3aa9 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366661.404188:0:5819:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720c400/0x8da3486b955f3aa9 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366661.404195:0:5819:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9638b720c400 already unused, calling callback (ffffffffc20ee4f0) 00010000:00010000:2.0:1789366661.404199:0:5819:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720c400/0x8da3486b955f3aa9 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366661.404208:0:5819:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720c400/0x8da3486b955f3aa9 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366661.404220:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9638a7404300) 00010000:00010000:2.0:1789366661.404224:0:5819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:2.0:1789366661.404228:0:5819:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720c400/0x8da3486b955f3aa9 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366661.404235:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720c400/0x8da3486b955f3aa9 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1789366661.404384:0:5819:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0xc:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:2.0:1789366661.404462:0:5819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].4, 64 off8448 00000004:00080000:2.0:1789366661.404473:0:5819:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 236868754155ns, next at 237868752058ns, rc = 0 00000001:00080000:2.0:1789366661.404478:0:5819:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967430 00010000:00010000:2.0:1789366661.404504:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9638a7404300) 00010000:00010000:2.0:1789366661.404507:0:5819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1789366661.404513:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9800/0x8da3486b955f3a8d lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.23@tcp remote: 0xda917a494d06c1c6 expref: 33 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789366661.404655:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963888cbb050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0ab23baa-a205-44ad-bf17-f7b47295d82b+32:11364:x1876286751442176:12345-192.168.202.23@tcp:35:lfs.0 Request processed in 6735us (6826us total) trans 4294967431 rc 0/0 00000100:00100000:2.0:1789366661.404673:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 38 00000020:00080000:2.0:1789366661.404677:0:5819:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:1.0:1789366661.406415:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:2.0:1789366661.406678:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751442432 00000100:00100000:2.0:1789366661.406684:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751442432 00000100:00100000:2.0:1789366661.406796:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 149 00000100:00100000:2.0:1789366661.406803:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963882ee0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0ab23baa-a205-44ad-bf17-f7b47295d82b+32:11364:x1876286751442432:12345-192.168.202.23@tcp:101:lfs.0 00010000:00010000:2.0:1789366661.406819:0:5817:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789366661.406834:0:5817:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c8000/0x8da3486b955f3ab0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xda917a494d06c1d4 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366661.406881:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c8000/0x8da3486b955f3ab0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.23@tcp remote: 0xda917a494d06c1d4 expref: 33 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366661.406891:0:5817:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c8000/0x8da3486b955f3ab0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.23@tcp remote: 0xda917a494d06c1d4 expref: 33 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366661.406903:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9638a7404f00) 00010000:00010000:2.0:1789366661.406905:0:5817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789366661.406907:0:5817:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9638902c8000, rc 0) 00000100:00100000:2.0:1789366661.406966:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963882ee0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0ab23baa-a205-44ad-bf17-f7b47295d82b+33:11364:x1876286751442432:12345-192.168.202.23@tcp:101:lfs.0 Request processed in 164us (557us total) trans 0 rc 0/0 00000100:00100000:2.0:1789366661.406972:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 149 00000100:00100000:0.0:1789366661.408546:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:1.0:1789366661.408593:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751442688 00000100:00100000:1.0:1789366661.408601:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751442688 00000100:00100000:1.0:1789366661.408688:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 39 00000100:00100000:1.0:1789366661.408698:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638af280000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0ab23baa-a205-44ad-bf17-f7b47295d82b+33:11364:x1876286751442688:12345-192.168.202.23@tcp:35:lfs.0 00000100:00100000:1.0:1789366661.408894:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638af280000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0ab23baa-a205-44ad-bf17-f7b47295d82b+34:11364:x1876286751442688:12345-192.168.202.23@tcp:35:lfs.0 Request processed in 196us (348us total) trans 4294967432 rc 0/0 00000100:00100000:1.0:1789366661.408901:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 39 00000100:00100000:1.0:1789366661.442694:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:2.0:1789366661.443317:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751442944 00000100:00100000:2.0:1789366661.443328:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751442944 00000100:00100000:2.0:1789366661.443387:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 150 00000100:00100000:2.0:1789366661.443401:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963882ee2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0ab23baa-a205-44ad-bf17-f7b47295d82b+34:11375:x1876286751442944:12345-192.168.202.23@tcp:101:lfs.0 00010000:00010000:2.0:1789366661.443509:0:5816:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789366661.443533:0:5816:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9800/0x8da3486b955f3ab7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xda917a494d06c1db expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366661.443939:0:5816:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c8c00/0x8da3486b955f3abe lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366661.444015:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c8c00/0x8da3486b955f3abe lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366661.444030:0:5816:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c8c00/0x8da3486b955f3abe lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789366661.444042:0:5816:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:2.0:1789366661.444171:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9800/0x8da3486b955f3ab7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.23@tcp remote: 0xda917a494d06c1db expref: 37 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366661.444190:0:5816:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c8c00/0x8da3486b955f3abe lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.23@tcp remote: 0xda917a494d06c1db expref: 36 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366661.444199:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff963890797800) 00010000:00010000:2.0:1789366661.444202:0:5816:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1789366661.444206:0:5816:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9638902c8c00, rc 0) 00000100:00100000:2.0:1789366661.444266:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963882ee2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0ab23baa-a205-44ad-bf17-f7b47295d82b+36:11375:x1876286751442944:12345-192.168.202.23@tcp:101:lfs.0 Request processed in 869us (1582us total) trans 4294967433 rc 0/0 00000100:00100000:2.0:1789366661.444274:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 150 00000100:00100000:0.0:1789366661.446182:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:1.0:1789366661.446281:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751443072 00000100:00100000:1.0:1789366661.446289:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751443072 00000100:00100000:1.0:1789366661.446334:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 151 00000100:00100000:1.0:1789366661.446343:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638af280e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0ab23baa-a205-44ad-bf17-f7b47295d82b+36:11375:x1876286751443072:12345-192.168.202.23@tcp:34:lfs.0 00010000:00010000:1.0:1789366661.446400:0:5815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9638b6ce3000/0x8da3486b955f3acc lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366661.446414:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9638b6ce3000/0x8da3486b955f3acc lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366661.446425:0:5815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9638b6ce3000/0x8da3486b955f3acc lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366661.446466:0:5815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9638b6ce2e00/0x8da3486b955f3ad3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366661.446474:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9638b6ce2e00/0x8da3486b955f3ad3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366661.446481:0:5815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9638b6ce2e00/0x8da3486b955f3ad3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366661.446565:0:5815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9638b6ce2a00/0x8da3486b955f3ada lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366661.446574:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9638b6ce2a00/0x8da3486b955f3ada lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366661.446593:0:5815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9638b6ce2a00/0x8da3486b955f3ada lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789366661.446628:0:5815:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9638b6ce2a00/0x8da3486b955f3ada lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366661.446640:0:5815:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9638b6ce3000/0x8da3486b955f3acc lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366661.446647:0:5815:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9638b6ce3000/0x8da3486b955f3acc lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366661.446654:0:5815:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9638b6ce3000/0x8da3486b955f3acc lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366661.446660:0:5815:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9638b6ce3000 already unused, calling callback (ffffffffc20ee4f0) 00010000:00010000:1.0:1789366661.446664:0:5815:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9638b6ce3000/0x8da3486b955f3acc lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366661.446678:0:5815:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9638b6ce3000/0x8da3486b955f3acc lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366661.446688:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff963890797800) 00010000:00010000:1.0:1789366661.446691:0:5815:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789366661.446696:0:5815:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9638b6ce3000/0x8da3486b955f3acc lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366661.446703:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9638b6ce3000/0x8da3486b955f3acc lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366661.446750:0:5815:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9638b6ce2e00/0x8da3486b955f3ad3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366661.446757:0:5815:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9638b6ce2e00/0x8da3486b955f3ad3 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366661.446763:0:5815:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9638b6ce2e00/0x8da3486b955f3ad3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366661.446768:0:5815:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9638b6ce2e00 already unused, calling callback (ffffffffc20ee4f0) 00010000:00010000:1.0:1789366661.446771:0:5815:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9638b6ce2e00/0x8da3486b955f3ad3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366661.446776:0:5815:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9638b6ce2e00/0x8da3486b955f3ad3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366661.446783:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff963887f88d00) 00010000:00010000:1.0:1789366661.446786:0:5815:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789366661.446788:0:5815:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9638b6ce2e00/0x8da3486b955f3ad3 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366661.446804:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9638b6ce2e00/0x8da3486b955f3ad3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366661.446820:0:5815:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9638b6ce2a00/0x8da3486b955f3ada lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366661.446825:0:5815:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9638b6ce2a00/0x8da3486b955f3ada lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366661.446831:0:5815:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9638b6ce2a00/0x8da3486b955f3ada lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366661.446836:0:5815:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9638b6ce2a00 already unused, calling callback (ffffffffc20ee4f0) 00010000:00010000:1.0:1789366661.446839:0:5815:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9638b6ce2a00/0x8da3486b955f3ada lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366661.446845:0:5815:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9638b6ce2a00/0x8da3486b955f3ada lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366661.446852:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9638a7404f00) 00010000:00010000:1.0:1789366661.446854:0:5815:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789366661.446857:0:5815:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9638b6ce2a00/0x8da3486b955f3ada lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366661.446862:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9638b6ce2a00/0x8da3486b955f3ada lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789366661.446929:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638af280e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0ab23baa-a205-44ad-bf17-f7b47295d82b+36:11375:x1876286751443072:12345-192.168.202.23@tcp:34:lfs.0 Request processed in 586us (751us total) trans 0 rc 0/0 00000100:00100000:1.0:1789366661.446936:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 151 00000100:00100000:0.0:1789366661.469596:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:2.0:1789366661.469691:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751443328 00000100:00100000:2.0:1789366661.469700:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751443328 00000100:00100000:2.0:1789366661.470036:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 152 00000100:00100000:2.0:1789366661.470060:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638b7214e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0ab23baa-a205-44ad-bf17-f7b47295d82b+36:11378:x1876286751443328:12345-192.168.202.23@tcp:101:lfs.0 00010000:00010000:2.0:1789366661.470080:0:5817:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789366661.470103:0:5817:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9800/0x8da3486b955f3ae1 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xda917a494d06c1e2 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366661.470191:0:5817:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9a00/0x8da3486b955f3ae8 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366661.470208:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9a00/0x8da3486b955f3ae8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366661.470220:0:5817:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9a00/0x8da3486b955f3ae8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366661.470235:0:5817:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9600/0x8da3486b955f3aef lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366661.470242:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9600/0x8da3486b955f3aef lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366661.470250:0:5817:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9600/0x8da3486b955f3aef lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366661.470365:0:5817:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c8a00/0x8da3486b955f3af6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366661.470374:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c8a00/0x8da3486b955f3af6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366661.470381:0:5817:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c8a00/0x8da3486b955f3af6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789366661.470401:0:5817:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:2.0:1789366661.470499:0:5817:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9a00/0x8da3486b955f3ae8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366661.470508:0:5817:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9a00/0x8da3486b955f3ae8 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366661.470515:0:5817:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9a00/0x8da3486b955f3ae8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366661.470521:0:5817:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9638902c9a00 already unused, calling callback (ffffffffc20ee4f0) 00010000:00010000:2.0:1789366661.470525:0:5817:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9a00/0x8da3486b955f3ae8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366661.470533:0:5817:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9a00/0x8da3486b955f3ae8 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366661.470546:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff963890797800) 00010000:00010000:2.0:1789366661.470550:0:5817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789366661.470555:0:5817:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9a00/0x8da3486b955f3ae8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366661.470561:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9a00/0x8da3486b955f3ae8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366661.470572:0:5817:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9600/0x8da3486b955f3aef lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366661.470578:0:5817:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9600/0x8da3486b955f3aef lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366661.470594:0:5817:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9600/0x8da3486b955f3aef lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366661.470599:0:5817:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9638902c9600 already unused, calling callback (ffffffffc20ee4f0) 00010000:00010000:2.0:1789366661.470603:0:5817:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9600/0x8da3486b955f3aef lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366661.470610:0:5817:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9600/0x8da3486b955f3aef lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366661.470618:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9638a7404300) 00010000:00010000:2.0:1789366661.470620:0:5817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789366661.470624:0:5817:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9600/0x8da3486b955f3aef lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366661.470629:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9600/0x8da3486b955f3aef lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366661.470669:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9800/0x8da3486b955f3ae1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.23@tcp remote: 0xda917a494d06c1e2 expref: 39 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366661.470686:0:5817:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c8a00/0x8da3486b955f3af6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.23@tcp remote: 0xda917a494d06c1e2 expref: 38 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366661.470693:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9638a7404f00) 00010000:00010000:2.0:1789366661.470696:0:5817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789366661.470698:0:5817:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9638902c8a00, rc 0) 00000100:00100000:2.0:1789366661.470775:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638b7214e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0ab23baa-a205-44ad-bf17-f7b47295d82b+38:11378:x1876286751443328:12345-192.168.202.23@tcp:101:lfs.0 Request processed in 717us (1187us total) trans 4294967434 rc 0/0 00000100:00100000:2.0:1789366661.470791:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 152 00000100:00100000:2.0:1789366661.473430:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:0.0:1789366661.473530:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751443456 00000100:00100000:0.0:1789366661.473540:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751443456 00000100:00100000:0.0:1789366661.473603:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 153 00000100:00100000:0.0:1789366661.473615:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963890777800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0ab23baa-a205-44ad-bf17-f7b47295d82b+38:11378:x1876286751443456:12345-192.168.202.23@tcp:54:lfs.0 00010000:00010000:0.0:1789366661.473688:0:5816:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720dc00/0x8da3486b955f3b04 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366661.473704:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720dc00/0x8da3486b955f3b04 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366661.473756:0:5816:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720dc00/0x8da3486b955f3b04 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366661.473781:0:5816:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720dc00/0x8da3486b955f3b04 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366661.473788:0:5816:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720dc00/0x8da3486b955f3b04 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366661.473795:0:5816:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720dc00/0x8da3486b955f3b04 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366661.473801:0:5816:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9638b720dc00 already unused, calling callback (ffffffffc20ee4f0) 00010000:00010000:0.0:1789366661.473805:0:5816:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720dc00/0x8da3486b955f3b04 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366661.473827:0:5816:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720dc00/0x8da3486b955f3b04 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366661.473839:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9638a7404f00) 00010000:00010000:0.0:1789366661.473842:0:5816:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1789366661.473847:0:5816:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720dc00/0x8da3486b955f3b04 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366661.473853:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720dc00/0x8da3486b955f3b04 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789366661.473928:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963890777800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0ab23baa-a205-44ad-bf17-f7b47295d82b+38:11378:x1876286751443456:12345-192.168.202.23@tcp:54:lfs.0 Request processed in 316us (507us total) trans 0 rc 0/0 00000100:00100000:0.0:1789366661.473936:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 153 00000100:00100000:0.0:1789366661.475783:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:2.0:1789366661.475827:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751443712 00000100:00100000:2.0:1789366661.475835:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751443712 00000100:00100000:2.0:1789366661.475886:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 40 00000100:00100000:2.0:1789366661.475896:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638af2d4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0ab23baa-a205-44ad-bf17-f7b47295d82b+38:11378:x1876286751443712:12345-192.168.202.23@tcp:35:lfs.0 00000100:00100000:2.0:1789366661.476083:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638af2d4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0ab23baa-a205-44ad-bf17-f7b47295d82b+39:11378:x1876286751443712:12345-192.168.202.23@tcp:35:lfs.0 Request processed in 189us (305us total) trans 4294967435 rc 0/0 00000100:00100000:2.0:1789366661.476088:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 40 00000100:00100000:3.0:1789366661.612423:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:1.0:1789366661.612525:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751443968 00000100:00100000:1.0:1789366661.612535:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751443968 00000100:00100000:1.0:1789366661.612643:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 154 00000100:00100000:1.0:1789366661.612654:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638bfef9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0ab23baa-a205-44ad-bf17-f7b47295d82b+39:11409:x1876286751443968:12345-192.168.202.23@tcp:101:cat.0 00010000:00010000:1.0:1789366661.612679:0:5815:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789366661.612704:0:5815:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9638b6ce2e00/0x8da3486b955f3b0b lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xda917a494d06c1e9 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366661.612854:0:5815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9638b6ce3000/0x8da3486b955f3b12 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366661.612871:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9638b6ce3000/0x8da3486b955f3b12 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366661.612886:0:5815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9638b6ce3000/0x8da3486b955f3b12 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789366661.612896:0:5815:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:1.0:1789366661.613023:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9638b6ce2e00/0x8da3486b955f3b0b lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.23@tcp remote: 0xda917a494d06c1e9 expref: 42 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366661.613042:0:5815:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9638b6ce3000/0x8da3486b955f3b12 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.23@tcp remote: 0xda917a494d06c1e9 expref: 41 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366661.613051:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9638a7404f00) 00010000:00010000:1.0:1789366661.613054:0:5815:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789366661.613057:0:5815:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9638b6ce3000, rc 0) 00000100:00100000:1.0:1789366661.613120:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638bfef9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0ab23baa-a205-44ad-bf17-f7b47295d82b+41:11409:x1876286751443968:12345-192.168.202.23@tcp:101:cat.0 Request processed in 467us (707us total) trans 4294967436 rc 0/0 00000100:00100000:1.0:1789366661.613156:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 154 00000100:00100000:1.0:1789366661.624093:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:2.0:1789366661.624202:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751444224 00000100:00100000:2.0:1789366661.624211:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751444224 00000100:00100000:2.0:1789366661.624291:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 41 00000100:00100000:2.0:1789366661.624301:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963882ee1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0ab23baa-a205-44ad-bf17-f7b47295d82b+41:11409:x1876286751444224:12345-192.168.202.23@tcp:35:cat.0 00000100:00100000:2.0:1789366661.624543:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963882ee1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0ab23baa-a205-44ad-bf17-f7b47295d82b+42:11409:x1876286751444224:12345-192.168.202.23@tcp:35:cat.0 Request processed in 243us (465us total) trans 4294967437 rc 0/0 00000100:00100000:2.0:1789366661.624551:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 41 00000100:00100000:0.0:1789366661.626372:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:3.0:1789366661.626447:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751444352 00000100:00100000:3.0:1789366661.626454:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751444352 00000100:00100000:3.0:1789366661.626498:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 11 00000100:00100000:3.0:1789366661.626512:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96389861e450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0ab23baa-a205-44ad-bf17-f7b47295d82b+42:2355:x1876286751444352:12345-192.168.202.23@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789366661.626527:0:5803:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789366661.626563:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9638b6ce3000/0x8da3486b955f3b12 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.23@tcp remote: 0xda917a494d06c1e9 expref: 42 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366661.626586:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9638a7404f00) 00010000:00010000:3.0:1789366661.626592:0:5803:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789366661.626667:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96389861e450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0ab23baa-a205-44ad-bf17-f7b47295d82b+41:2355:x1876286751444352:12345-192.168.202.23@tcp:103:ldlm_bl.0 Request processed in 157us (300us total) trans 0 rc 0/0 00000100:00100000:3.0:1789366661.626675:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 11 00000100:00100000:3.0:1789366661.660425:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:2.0:1789366661.660518:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751444608 00000100:00100000:2.0:1789366661.660529:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751444608 00000100:00100000:2.0:1789366661.660604:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 155 00000100:00100000:2.0:1789366661.660612:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638bfef8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0ab23baa-a205-44ad-bf17-f7b47295d82b+41:11415:x1876286751444608:12345-192.168.202.23@tcp:101:dd.0 00010000:00010000:2.0:1789366661.660631:0:5817:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789366661.660633:0:5817:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1789366661.660664:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9638b6ce3400/0x8da3486b955f3a6a lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.23@tcp remote: 0xda917a494d06c1b8 expref: 41 pid: 7132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366661.660702:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff963890797800) 00010000:00010000:2.0:1789366661.660707:0:5817:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789366661.660765:0:5817:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9800/0x8da3486b955f3b20 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xda917a494d06c1f0 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366661.660894:0:5817:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9600/0x8da3486b955f3b27 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366661.660905:0:5817:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c8a00/0x8da3486b955f3af6 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.23@tcp remote: 0xda917a494d06c1e2 expref: 41 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366661.660910:0:5817:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9600/0x8da3486b955f3b27 lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366661.660935:0:5817:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c8a00/0x8da3486b955f3af6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.23@tcp remote: 0xda917a494d06c1e2 expref: 41 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366661.660944:0:5817:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c8a00/0x8da3486b955f3af6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.23@tcp remote: 0xda917a494d06c1e2 expref: 41 pid: 5817 timeout: 337 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789366661.660954:0:5817:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9638bfec9500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5817:1876286758779776:192.168.202.23@tcp:104: 00000100:00100000:2.0:1789366661.661036:0:5817:0:(client.c:2716:ptlrpc_set_wait()) set ffff963882efe6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789366661.663172:0:5817:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9638bfec9500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5817:1876286758779776:192.168.202.23@tcp:104: 00000100:00100000:1.0:1789366661.663178:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00010000:00010000:2.0:1789366661.663199:0:5817:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9600/0x8da3486b955f3b27 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789366661.663267:0:8419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751444736 00000100:00100000:3.0:1789366661.663274:0:8419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751444736 00010000:00010000:3.0:1789366661.663344:0:8419:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c8a00/0x8da3486b955f3af6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.23@tcp remote: 0xda917a494d06c1e2 expref: 42 pid: 5817 timeout: 337 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789366661.663428:0:8419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 65 00000100:00100000:3.0:1789366661.663438:0:8419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963882ee0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0ab23baa-a205-44ad-bf17-f7b47295d82b+42:2355:x1876286751444736:12345-192.168.202.23@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789366661.663452:0:8419:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789366661.663459:0:8419:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c8a00/0x8da3486b955f3af6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.23@tcp remote: 0xda917a494d06c1e2 expref: 42 pid: 5817 timeout: 337 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366661.663470:0:8419:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c8a00/0x8da3486b955f3af6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.23@tcp remote: 0xda917a494d06c1e2 expref: 42 pid: 5817 timeout: 337 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366661.663488:0:8419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c8a00/0x8da3486b955f3af6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.23@tcp remote: 0xda917a494d06c1e2 expref: 42 pid: 5817 timeout: 337 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366661.663502:0:8419:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9638a7404f00) 00010000:00010000:3.0:1789366661.663513:0:8419:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9600/0x8da3486b955f3b27 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366661.663522:0:8419:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9600/0x8da3486b955f3b27 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366661.663530:0:8419:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9600/0x8da3486b955f3b27 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366661.663557:0:8419:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789366661.663585:0:5817:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9600/0x8da3486b955f3b27 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366661.663598:0:5817:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9600/0x8da3486b955f3b27 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789366661.663609:0:8419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963882ee0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0ab23baa-a205-44ad-bf17-f7b47295d82b+41:2355:x1876286751444736:12345-192.168.202.23@tcp:103:ldlm_bl.0 Request processed in 172us (431us total) trans 0 rc 0/0 00000004:00200000:2.0:1789366661.663613:0:5817:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00000100:00100000:3.0:1789366661.663616:0:8419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 65 00010000:00010000:2.0:1789366661.664293:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9800/0x8da3486b955f3b20 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.23@tcp remote: 0xda917a494d06c1f0 expref: 42 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366661.664310:0:5817:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9600/0x8da3486b955f3b27 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.23@tcp remote: 0xda917a494d06c1f0 expref: 41 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366661.664318:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9638a7404f00) 00010000:00010000:2.0:1789366661.664320:0:5817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1789366661.664323:0:5817:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9638902c9600, rc 0) 00000100:00100000:2.0:1789366661.664363:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638bfef8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0ab23baa-a205-44ad-bf17-f7b47295d82b+41:11415:x1876286751444608:12345-192.168.202.23@tcp:101:dd.0 Request processed in 3751us (3944us total) trans 4294967438 rc 0/0 00000100:00100000:2.0:1789366661.664370:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 155 00000100:00100000:1.0:1789366661.665639:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:0.0:1789366661.665739:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751444992 00000100:00100000:0.0:1789366661.665748:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751444992 00000100:00100000:0.0:1789366661.665825:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 156 00000100:00100000:0.0:1789366661.665833:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963882ee2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0ab23baa-a205-44ad-bf17-f7b47295d82b+41:11415:x1876286751444992:12345-192.168.202.23@tcp:36:dd.0 00010000:00010000:0.0:1789366661.666018:0:5816:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720cc00/0x8da3486b955f3b35 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366661.666029:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720cc00/0x8da3486b955f3b35 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366661.666037:0:5816:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720cc00/0x8da3486b955f3b35 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789366661.666085:0:5816:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967439 00000004:00010000:0.0:1789366661.666101:0:5816:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000b5c4f9f7 reply state 00000000fa38df14 transno 4294967440 ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720cc00/0x8da3486b955f3b35 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789366661.666107:0:5816:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789366661.666183:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963882ee2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0ab23baa-a205-44ad-bf17-f7b47295d82b+44:11415:x1876286751444992:12345-192.168.202.23@tcp:36:dd.0 Request processed in 350us (548us total) trans 4294967440 rc 0/0 00000100:00100000:0.0:1789366661.666188:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 156 00000020:00080000:0.0:1789366661.666191:0:5816:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1789366661.668607:0:3271:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720cc00/0x8da3486b955f3b35 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366661.668623:0:3271:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720cc00/0x8da3486b955f3b35 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366661.668631:0:3271:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720cc00/0x8da3486b955f3b35 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366661.668638:0:3271:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9638b720cc00 already unused, calling callback (ffffffffc20ee4f0) 00010000:00010000:0.0:1789366661.668643:0:3271:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720cc00/0x8da3486b955f3b35 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366661.668652:0:3271:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720cc00/0x8da3486b955f3b35 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366661.668671:0:3271:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9638a7404f00) 00010000:00010000:0.0:1789366661.668674:0:3271:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789366661.668678:0:3271:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720cc00/0x8da3486b955f3b35 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366661.668685:0:3271:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720cc00/0x8da3486b955f3b35 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789366661.847382:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:0.0:1789366661.847474:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751445120 00000100:00100000:0.0:1789366661.847482:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751445120 00000100:00100000:0.0:1789366661.847526:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 157 00000100:00100000:0.0:1789366661.847533:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963882ee3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0ab23baa-a205-44ad-bf17-f7b47295d82b+43:11429:x1876286751445120:12345-192.168.202.23@tcp:101:stat.0 00010000:00010000:0.0:1789366661.847551:0:5815:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789366661.847571:0:5815:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720cc00/0x8da3486b955f3b3c lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xda917a494d06c1f7 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366661.847635:0:5815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720de00/0x8da3486b955f3b43 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366661.847650:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720de00/0x8da3486b955f3b43 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366661.847662:0:5815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720de00/0x8da3486b955f3b43 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366661.847676:0:5815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720ca00/0x8da3486b955f3b4a lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366661.847683:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720ca00/0x8da3486b955f3b4a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366661.848174:0:5815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720ca00/0x8da3486b955f3b4a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366661.848265:0:5815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720d000/0x8da3486b955f3b51 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366661.848276:0:5815:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9600/0x8da3486b955f3b27 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.23@tcp remote: 0xda917a494d06c1f0 expref: 44 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366661.848297:0:5815:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720d000/0x8da3486b955f3b51 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366661.848332:0:5815:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9600/0x8da3486b955f3b27 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.23@tcp remote: 0xda917a494d06c1f0 expref: 44 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366661.848346:0:5815:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9600/0x8da3486b955f3b27 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.23@tcp remote: 0xda917a494d06c1f0 expref: 44 pid: 5817 timeout: 337 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789366661.848360:0:5815:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9638b7352680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5815:1876286758779904:192.168.202.23@tcp:104: 00000100:00100000:1.0:1789366661.848596:0:5815:0:(client.c:2716:ptlrpc_set_wait()) set ffff96388a34d840 going to sleep for 11 seconds 00000100:00100000:2.0:1789366661.850536:0:5815:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9638b7352680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5815:1876286758779904:192.168.202.23@tcp:104: 00010000:00010000:2.0:1789366661.850563:0:5815:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720d000/0x8da3486b955f3b51 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789366661.850625:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:0.0:1789366661.850704:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751445376 00000100:00100000:0.0:1789366661.850712:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751445376 00000100:00100000:0.0:1789366661.850820:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 42 00000100:00100000:0.0:1789366661.850830:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963882ee0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0ab23baa-a205-44ad-bf17-f7b47295d82b+45:5580:x1876286751445376:12345-192.168.202.23@tcp:35:ldlm_bl.0 00000100:00100000:0.0:1789366661.851114:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963882ee0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0ab23baa-a205-44ad-bf17-f7b47295d82b+46:5580:x1876286751445376:12345-192.168.202.23@tcp:35:ldlm_bl.0 Request processed in 280us (483us total) trans 4294967441 rc 0/0 00000100:00100000:0.0:1789366661.851121:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 42 00000100:00100000:3.0:1789366661.853126:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:0.0:1789366661.853335:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751445504 00000100:00100000:0.0:1789366661.853345:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751445504 00010000:00010000:0.0:1789366661.853383:0:5801:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9600/0x8da3486b955f3b27 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.23@tcp remote: 0xda917a494d06c1f0 expref: 46 pid: 5817 timeout: 337 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789366661.853425:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 66 00000100:00100000:0.0:1789366661.853636:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638bfef9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0ab23baa-a205-44ad-bf17-f7b47295d82b+46:2355:x1876286751445504:12345-192.168.202.23@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789366661.853654:0:5801:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789366661.853953:0:5801:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9600/0x8da3486b955f3b27 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.23@tcp remote: 0xda917a494d06c1f0 expref: 46 pid: 5817 timeout: 337 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366661.853968:0:5801:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9600/0x8da3486b955f3b27 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.23@tcp remote: 0xda917a494d06c1f0 expref: 46 pid: 5817 timeout: 337 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366661.853991:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9600/0x8da3486b955f3b27 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.23@tcp remote: 0xda917a494d06c1f0 expref: 46 pid: 5817 timeout: 337 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366661.854018:0:5801:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9638a7404f00) 00010000:00010000:0.0:1789366661.854024:0:5801:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720d000/0x8da3486b955f3b51 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366661.854034:0:5801:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720d000/0x8da3486b955f3b51 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366661.854042:0:5801:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720d000/0x8da3486b955f3b51 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366661.854120:0:5801:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789366661.854183:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638bfef9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0ab23baa-a205-44ad-bf17-f7b47295d82b+45:2355:x1876286751445504:12345-192.168.202.23@tcp:103:ldlm_bl.0 Request processed in 551us (1063us total) trans 0 rc 0/0 00000100:00100000:0.0:1789366661.854192:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 66 00010000:00010000:2.0:1789366661.856364:0:5815:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720d000/0x8da3486b955f3b51 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366661.856381:0:5815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720d000/0x8da3486b955f3b51 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789366661.856657:0:5815:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:2.0:1789366661.856734:0:5815:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1789366661.856778:0:5815:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720d000/0x8da3486b955f3b51 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366661.856794:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720d000/0x8da3486b955f3b51 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366661.856805:0:5815:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720de00/0x8da3486b955f3b43 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366661.856812:0:5815:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720de00/0x8da3486b955f3b43 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366661.856819:0:5815:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720de00/0x8da3486b955f3b43 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366661.856825:0:5815:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9638b720de00 already unused, calling callback (ffffffffc20ee4f0) 00010000:00010000:2.0:1789366661.856830:0:5815:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720de00/0x8da3486b955f3b43 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366661.856838:0:5815:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720de00/0x8da3486b955f3b43 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366661.856852:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff963890797800) 00010000:00010000:2.0:1789366661.856856:0:5815:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789366661.856861:0:5815:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720de00/0x8da3486b955f3b43 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366661.856934:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720de00/0x8da3486b955f3b43 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366661.856950:0:5815:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720ca00/0x8da3486b955f3b4a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366661.856957:0:5815:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720ca00/0x8da3486b955f3b4a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366661.856969:0:5815:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720ca00/0x8da3486b955f3b4a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366661.856975:0:5815:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9638b720ca00 already unused, calling callback (ffffffffc20ee4f0) 00010000:00010000:2.0:1789366661.856978:0:5815:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720ca00/0x8da3486b955f3b4a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366661.856985:0:5815:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720ca00/0x8da3486b955f3b4a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366661.856994:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff963890797f00) 00010000:00010000:2.0:1789366661.856996:0:5815:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789366661.857000:0:5815:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720ca00/0x8da3486b955f3b4a lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366661.857075:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720ca00/0x8da3486b955f3b4a lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366661.857121:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720cc00/0x8da3486b955f3b3c lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.23@tcp remote: 0xda917a494d06c1f7 expref: 45 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366661.857151:0:5815:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720d000/0x8da3486b955f3b51 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.23@tcp remote: 0xda917a494d06c1f7 expref: 44 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366661.857160:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9638a7404f00) 00010000:00010000:2.0:1789366661.857162:0:5815:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789366661.857165:0:5815:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9638b720d000, rc 0) 00000100:00100000:2.0:1789366661.857602:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963882ee3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0ab23baa-a205-44ad-bf17-f7b47295d82b+44:11429:x1876286751445120:12345-192.168.202.23@tcp:101:stat.0 Request processed in 10065us (10225us total) trans 0 rc 0/0 00000100:00100000:2.0:1789366661.857621:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 157 00000100:00100000:3.0:1789366661.890574:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:2.0:1789366661.890639:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751445760 00000100:00100000:2.0:1789366661.890650:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751445760 00000100:00100000:2.0:1789366661.890787:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 158 00000100:00100000:2.0:1789366661.890801:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638bfef8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0ab23baa-a205-44ad-bf17-f7b47295d82b+44:11435:x1876286751445760:12345-192.168.202.23@tcp:36:truncate.0 00010000:00010000:2.0:1789366661.890858:0:5817:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789366661.890883:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720d000/0x8da3486b955f3b51 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.23@tcp remote: 0xda917a494d06c1f7 expref: 44 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366661.890902:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9638a7404f00) 00010000:00010000:2.0:1789366661.890908:0:5817:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789366661.891097:0:5817:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9800/0x8da3486b955f3b58 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366661.891107:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9800/0x8da3486b955f3b58 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366661.891115:0:5817:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9800/0x8da3486b955f3b58 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789366661.891176:0:5817:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967442 00000004:00010000:2.0:1789366661.891200:0:5817:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000af560307 reply state 00000000e65b4810 transno 4294967443 ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9800/0x8da3486b955f3b58 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789366661.891209:0:5817:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789366661.891302:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638bfef8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0ab23baa-a205-44ad-bf17-f7b47295d82b+46:11435:x1876286751445760:12345-192.168.202.23@tcp:36:truncate.0 Request processed in 504us (733us total) trans 4294967443 rc 0/0 00000100:00100000:2.0:1789366661.891309:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 158 00000020:00080000:2.0:1789366661.891328:0:5817:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1789366661.892481:0:3270:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9800/0x8da3486b955f3b58 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366661.892494:0:3270:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9800/0x8da3486b955f3b58 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366661.892501:0:3270:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9800/0x8da3486b955f3b58 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366661.892508:0:3270:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9638902c9800 already unused, calling callback (ffffffffc20ee4f0) 00010000:00010000:3.0:1789366661.892513:0:3270:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9800/0x8da3486b955f3b58 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366661.892521:0:3270:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9800/0x8da3486b955f3b58 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366661.892539:0:3270:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9638a7404f00) 00010000:00010000:3.0:1789366661.892550:0:3270:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789366661.892555:0:3270:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9800/0x8da3486b955f3b58 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366661.892562:0:3270:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9800/0x8da3486b955f3b58 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789366661.973512:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:0.0:1789366661.973789:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751445888 00000100:00100000:0.0:1789366661.973799:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751445888 00000100:00100000:0.0:1789366661.973952:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 159 00000100:00100000:0.0:1789366661.973963:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638bfefa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0ab23baa-a205-44ad-bf17-f7b47295d82b+45:11449:x1876286751445888:12345-192.168.202.23@tcp:101:stat.0 00010000:00010000:0.0:1789366661.973986:0:5816:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789366661.974008:0:5816:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720da00/0x8da3486b955f3b5f lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xda917a494d06c1fe expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366661.974088:0:5816:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720d000/0x8da3486b955f3b66 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366661.974104:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720d000/0x8da3486b955f3b66 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366661.974116:0:5816:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720d000/0x8da3486b955f3b66 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366661.974130:0:5816:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720cc00/0x8da3486b955f3b6d lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366661.974150:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720cc00/0x8da3486b955f3b6d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366661.974158:0:5816:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720cc00/0x8da3486b955f3b6d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366661.974255:0:5816:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720ca00/0x8da3486b955f3b74 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366661.974264:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720ca00/0x8da3486b955f3b74 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366661.974272:0:5816:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720ca00/0x8da3486b955f3b74 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789366661.974307:0:5816:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 1234567 00000004:00200000:0.0:1789366661.974312:0:5816:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1789366661.974336:0:5816:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720ca00/0x8da3486b955f3b74 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366661.974361:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720ca00/0x8da3486b955f3b74 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366661.974382:0:5816:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720d000/0x8da3486b955f3b66 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366661.974389:0:5816:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720d000/0x8da3486b955f3b66 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366661.974396:0:5816:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720d000/0x8da3486b955f3b66 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366661.974402:0:5816:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9638b720d000 already unused, calling callback (ffffffffc20ee4f0) 00010000:00010000:0.0:1789366661.974407:0:5816:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720d000/0x8da3486b955f3b66 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366661.974415:0:5816:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720d000/0x8da3486b955f3b66 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366661.974427:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff963890797800) 00010000:00010000:0.0:1789366661.974430:0:5816:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789366661.974435:0:5816:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720d000/0x8da3486b955f3b66 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366661.974442:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720d000/0x8da3486b955f3b66 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366661.974457:0:5816:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720cc00/0x8da3486b955f3b6d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366661.974463:0:5816:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720cc00/0x8da3486b955f3b6d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366661.974477:0:5816:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720cc00/0x8da3486b955f3b6d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366661.974483:0:5816:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9638b720cc00 already unused, calling callback (ffffffffc20ee4f0) 00010000:00010000:0.0:1789366661.974487:0:5816:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720cc00/0x8da3486b955f3b6d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366661.974494:0:5816:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720cc00/0x8da3486b955f3b6d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366661.974503:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff963890797900) 00010000:00010000:0.0:1789366661.974506:0:5816:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789366661.974509:0:5816:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720cc00/0x8da3486b955f3b6d lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366661.974515:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720cc00/0x8da3486b955f3b6d lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366661.974547:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720da00/0x8da3486b955f3b5f lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.23@tcp remote: 0xda917a494d06c1fe expref: 47 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366661.974562:0:5816:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720ca00/0x8da3486b955f3b74 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.23@tcp remote: 0xda917a494d06c1fe expref: 46 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366661.974569:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9638a7404f00) 00010000:00010000:0.0:1789366661.974571:0:5816:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789366661.974574:0:5816:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9638b720ca00, rc 0) 00000100:00100000:0.0:1789366661.974641:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638bfefa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0ab23baa-a205-44ad-bf17-f7b47295d82b+46:11449:x1876286751445888:12345-192.168.202.23@tcp:101:stat.0 Request processed in 679us (1135us total) trans 0 rc 0/0 00000100:00100000:0.0:1789366661.974657:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 159 00000100:00100000:1.0:1789366662.056951:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:2.0:1789366662.057046:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751446144 00000100:00100000:2.0:1789366662.057058:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751446144 00000100:00080000:1.0:1789366662.057118:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789366662.057148:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 160 00000100:00100000:2.0:1789366662.057161:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963882ee2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0ab23baa-a205-44ad-bf17-f7b47295d82b+46:11465:x1876286751446144:12345-192.168.202.23@tcp:101:bash.0 00010000:00010000:2.0:1789366662.057181:0:5815:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789366662.057199:0:5815:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9a00/0x8da3486b955f3b7b lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xda917a494d06c205 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366662.057279:0:5815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9e00/0x8da3486b955f3b82 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366662.057289:0:5815:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720ca00/0x8da3486b955f3b74 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.23@tcp remote: 0xda917a494d06c1fe expref: 47 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366662.057296:0:5815:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9e00/0x8da3486b955f3b82 lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366662.057322:0:5815:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720ca00/0x8da3486b955f3b74 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.23@tcp remote: 0xda917a494d06c1fe expref: 47 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366662.057331:0:5815:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720ca00/0x8da3486b955f3b74 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.23@tcp remote: 0xda917a494d06c1fe expref: 47 pid: 5816 timeout: 337 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789366662.057341:0:5815:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9638bfec9500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5815:1876286758780032:192.168.202.23@tcp:104: 00000100:00100000:2.0:1789366662.057454:0:5815:0:(client.c:2716:ptlrpc_set_wait()) set ffff963882efe6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789366662.058485:0:5815:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9638bfec9500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5815:1876286758780032:192.168.202.23@tcp:104: 00010000:00010000:2.0:1789366662.058503:0:5815:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9e00/0x8da3486b955f3b82 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789366662.058880:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:0.0:1789366662.058933:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751446272 00000100:00100000:0.0:1789366662.058939:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751446272 00010000:00010000:0.0:1789366662.058963:0:5802:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720ca00/0x8da3486b955f3b74 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.23@tcp remote: 0xda917a494d06c1fe expref: 48 pid: 5816 timeout: 337 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789366662.059004:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 67 00000100:00100000:0.0:1789366662.059013:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638b73f8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0ab23baa-a205-44ad-bf17-f7b47295d82b+48:2354:x1876286751446272:12345-192.168.202.23@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789366662.059029:0:5802:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789366662.059036:0:5802:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720ca00/0x8da3486b955f3b74 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.23@tcp remote: 0xda917a494d06c1fe expref: 48 pid: 5816 timeout: 337 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366662.059048:0:5802:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720ca00/0x8da3486b955f3b74 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.23@tcp remote: 0xda917a494d06c1fe expref: 48 pid: 5816 timeout: 337 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366662.059068:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720ca00/0x8da3486b955f3b74 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.23@tcp remote: 0xda917a494d06c1fe expref: 48 pid: 5816 timeout: 337 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366662.059085:0:5802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9638a7404f00) 00010000:00010000:0.0:1789366662.059090:0:5802:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9e00/0x8da3486b955f3b82 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366662.059103:0:5802:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9e00/0x8da3486b955f3b82 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366662.059111:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9e00/0x8da3486b955f3b82 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366662.059161:0:5802:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789366662.059189:0:5815:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9e00/0x8da3486b955f3b82 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366662.059199:0:5815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9e00/0x8da3486b955f3b82 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789366662.059208:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638b73f8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0ab23baa-a205-44ad-bf17-f7b47295d82b+47:2354:x1876286751446272:12345-192.168.202.23@tcp:103:ldlm_bl.0 Request processed in 194us (326us total) trans 0 rc 0/0 00000004:00200000:2.0:1789366662.059216:0:5815:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 1234567 00000100:00100000:0.0:1789366662.059224:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 67 00010000:00010000:2.0:1789366662.059348:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9a00/0x8da3486b955f3b7b lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.23@tcp remote: 0xda917a494d06c205 expref: 48 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366662.059374:0:5815:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9e00/0x8da3486b955f3b82 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.23@tcp remote: 0xda917a494d06c205 expref: 47 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366662.059382:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9638a7404f00) 00010000:00010000:2.0:1789366662.059385:0:5815:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1789366662.059387:0:5815:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9638902c9e00, rc 0) 00000100:00100000:2.0:1789366662.059420:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963882ee2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0ab23baa-a205-44ad-bf17-f7b47295d82b+47:11465:x1876286751446144:12345-192.168.202.23@tcp:101:bash.0 Request processed in 2263us (2481us total) trans 4294967444 rc 0/0 00000100:00100000:2.0:1789366662.059428:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 160 00000100:00100000:1.0:1789366662.060496:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:2.0:1789366662.060535:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751446528 00000100:00100000:2.0:1789366662.060542:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751446528 00000100:00100000:2.0:1789366662.060580:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 161 00000100:00100000:2.0:1789366662.060588:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638b73fad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0ab23baa-a205-44ad-bf17-f7b47295d82b+47:11465:x1876286751446528:12345-192.168.202.23@tcp:36:bash.0 00010000:00010000:2.0:1789366662.060785:0:5817:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c8200/0x8da3486b955f3b90 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366662.060797:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c8200/0x8da3486b955f3b90 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366662.060828:0:5817:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c8200/0x8da3486b955f3b90 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789366662.060879:0:5817:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967445 00000004:00010000:2.0:1789366662.060903:0:5817:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000006ef3c6e5 reply state 0000000065097ec1 transno 4294967446 ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c8200/0x8da3486b955f3b90 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789366662.060911:0:5817:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789366662.060968:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638b73fad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0ab23baa-a205-44ad-bf17-f7b47295d82b+50:11465:x1876286751446528:12345-192.168.202.23@tcp:36:bash.0 Request processed in 380us (472us total) trans 4294967446 rc 0/0 00000100:00100000:2.0:1789366662.060987:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 161 00000020:00080000:2.0:1789366662.060992:0:5817:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1789366662.061560:0:3271:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c8200/0x8da3486b955f3b90 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366662.061571:0:3271:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c8200/0x8da3486b955f3b90 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366662.061578:0:3271:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c8200/0x8da3486b955f3b90 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366662.061585:0:3271:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9638902c8200 already unused, calling callback (ffffffffc20ee4f0) 00010000:00010000:0.0:1789366662.061589:0:3271:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c8200/0x8da3486b955f3b90 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366662.061597:0:3271:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c8200/0x8da3486b955f3b90 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366662.061607:0:3271:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9638a7404f00) 00010000:00010000:0.0:1789366662.061610:0:3271:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789366662.061613:0:3271:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c8200/0x8da3486b955f3b90 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366662.061620:0:3271:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c8200/0x8da3486b955f3b90 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789366662.064123:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:0.0:1789366662.064182:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751446656 00000100:00100000:0.0:1789366662.064191:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751446656 00000100:00100000:0.0:1789366662.064262:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 162 00000100:00100000:0.0:1789366662.064274:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638b73f9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0ab23baa-a205-44ad-bf17-f7b47295d82b+49:11465:x1876286751446656:12345-192.168.202.23@tcp:101:bash.0 00010000:00010000:0.0:1789366662.064296:0:5816:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789366662.064315:0:5816:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720da00/0x8da3486b955f3b97 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xda917a494d06c20c expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366662.064388:0:5816:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720cc00/0x8da3486b955f3b9e lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366662.064403:0:5816:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9e00/0x8da3486b955f3b82 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.23@tcp remote: 0xda917a494d06c205 expref: 50 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366662.064412:0:5816:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720cc00/0x8da3486b955f3b9e lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366662.064460:0:5816:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9e00/0x8da3486b955f3b82 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.23@tcp remote: 0xda917a494d06c205 expref: 50 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366662.064473:0:5816:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9e00/0x8da3486b955f3b82 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.23@tcp remote: 0xda917a494d06c205 expref: 50 pid: 5815 timeout: 337 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789366662.064486:0:5816:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9638b7352a00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5816:1876286758780160:192.168.202.23@tcp:104: 00000100:00100000:0.0:1789366662.064555:0:5816:0:(client.c:2716:ptlrpc_set_wait()) set ffff96388a34d780 going to sleep for 11 seconds 00000100:00100000:0.0:1789366662.065710:0:5816:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9638b7352a00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5816:1876286758780160:192.168.202.23@tcp:104: 00010000:00010000:0.0:1789366662.065753:0:5816:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720cc00/0x8da3486b955f3b9e lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789366662.068438:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:3.0:1789366662.068528:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751446784 00000100:00100000:3.0:1789366662.068537:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751446784 00010000:00010000:3.0:1789366662.068570:0:5803:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9e00/0x8da3486b955f3b82 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.23@tcp remote: 0xda917a494d06c205 expref: 51 pid: 5815 timeout: 337 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789366662.068621:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 68 00000100:00100000:0.0:1789366662.068644:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638b73fa300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0ab23baa-a205-44ad-bf17-f7b47295d82b+51:2354:x1876286751446784:12345-192.168.202.23@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789366662.068669:0:5801:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789366662.068677:0:5801:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9e00/0x8da3486b955f3b82 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.23@tcp remote: 0xda917a494d06c205 expref: 51 pid: 5815 timeout: 337 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366662.068691:0:5801:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9e00/0x8da3486b955f3b82 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.23@tcp remote: 0xda917a494d06c205 expref: 51 pid: 5815 timeout: 337 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366662.068712:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9e00/0x8da3486b955f3b82 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.23@tcp remote: 0xda917a494d06c205 expref: 51 pid: 5815 timeout: 337 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366662.068759:0:5801:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9638a7404f00) 00010000:00010000:0.0:1789366662.068764:0:5801:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720cc00/0x8da3486b955f3b9e lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366662.068774:0:5801:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720cc00/0x8da3486b955f3b9e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366662.068783:0:5801:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720cc00/0x8da3486b955f3b9e lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366662.068810:0:5801:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789366662.068860:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638b73fa300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0ab23baa-a205-44ad-bf17-f7b47295d82b+50:2354:x1876286751446784:12345-192.168.202.23@tcp:103:ldlm_bl.0 Request processed in 218us (428us total) trans 0 rc 0/0 00000100:00100000:0.0:1789366662.068867:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 68 00010000:00010000:2.0:1789366662.068939:0:5816:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720cc00/0x8da3486b955f3b9e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366662.068950:0:5816:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720cc00/0x8da3486b955f3b9e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789366662.069000:0:5816:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:2.0:1789366662.069005:0:5816:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1789366662.069024:0:5816:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720cc00/0x8da3486b955f3b9e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366662.069053:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720da00/0x8da3486b955f3b97 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.23@tcp remote: 0xda917a494d06c20c expref: 50 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366662.069068:0:5816:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720cc00/0x8da3486b955f3b9e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.23@tcp remote: 0xda917a494d06c20c expref: 49 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366662.069076:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9638a7404f00) 00010000:00010000:2.0:1789366662.069086:0:5816:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789366662.069090:0:5816:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9638b720cc00, rc 0) 00000100:00100000:2.0:1789366662.069130:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638b73f9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0ab23baa-a205-44ad-bf17-f7b47295d82b+49:11465:x1876286751446656:12345-192.168.202.23@tcp:101:bash.0 Request processed in 4860us (5015us total) trans 0 rc 0/0 00000100:00100000:2.0:1789366662.069149:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 162 00000100:00100000:1.0:1789366662.072709:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:0.0:1789366662.073101:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751447040 00000100:00100000:0.0:1789366662.073111:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751447040 00000100:00100000:0.0:1789366662.073173:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 43 00000100:00100000:0.0:1789366662.073189:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638b73f9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0ab23baa-a205-44ad-bf17-f7b47295d82b+49:11465:x1876286751447040:12345-192.168.202.23@tcp:35:bash.0 00000100:00100000:0.0:1789366662.073395:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638b73f9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0ab23baa-a205-44ad-bf17-f7b47295d82b+50:11465:x1876286751447040:12345-192.168.202.23@tcp:35:bash.0 Request processed in 212us (693us total) trans 4294967447 rc 0/0 00000100:00100000:0.0:1789366662.073403:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 43 00000100:00100000:1.0:1789366662.113767:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:2.0:1789366662.113828:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751447168 00000100:00100000:2.0:1789366662.113837:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751447168 00000100:00100000:2.0:1789366662.113939:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 163 00000100:00100000:2.0:1789366662.113950:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638987e8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0ab23baa-a205-44ad-bf17-f7b47295d82b+50:11475:x1876286751447168:12345-192.168.202.23@tcp:34:lfs.0 00010000:00010000:2.0:1789366662.114027:0:5815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9a00/0x8da3486b955f3ba5 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366662.114040:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9a00/0x8da3486b955f3ba5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366662.114049:0:5815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9a00/0x8da3486b955f3ba5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366662.114059:0:5815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9c00/0x8da3486b955f3bac lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366662.114064:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9c00/0x8da3486b955f3bac lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366662.114068:0:5815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9c00/0x8da3486b955f3bac lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366662.114151:0:5815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9000/0x8da3486b955f3bb3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366662.114157:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9000/0x8da3486b955f3bb3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366662.114172:0:5815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9000/0x8da3486b955f3bb3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789366662.114210:0:5815:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9000/0x8da3486b955f3bb3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366662.114222:0:5815:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9a00/0x8da3486b955f3ba5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366662.114234:0:5815:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9a00/0x8da3486b955f3ba5 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366662.114242:0:5815:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9a00/0x8da3486b955f3ba5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366662.114248:0:5815:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9638902c9a00 already unused, calling callback (ffffffffc20ee4f0) 00010000:00010000:2.0:1789366662.114252:0:5815:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9a00/0x8da3486b955f3ba5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366662.114258:0:5815:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9a00/0x8da3486b955f3ba5 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366662.114267:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff963890797800) 00010000:00010000:2.0:1789366662.114269:0:5815:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789366662.114273:0:5815:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9a00/0x8da3486b955f3ba5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366662.114277:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9a00/0x8da3486b955f3ba5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366662.114286:0:5815:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9c00/0x8da3486b955f3bac lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366662.114294:0:5815:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9c00/0x8da3486b955f3bac lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366662.114298:0:5815:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9c00/0x8da3486b955f3bac lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366662.114301:0:5815:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9638902c9c00 already unused, calling callback (ffffffffc20ee4f0) 00010000:00010000:2.0:1789366662.114302:0:5815:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9c00/0x8da3486b955f3bac lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366662.114306:0:5815:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9c00/0x8da3486b955f3bac lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366662.114310:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9638a7404300) 00010000:00010000:2.0:1789366662.114311:0:5815:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789366662.114312:0:5815:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9c00/0x8da3486b955f3bac lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366662.114316:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9c00/0x8da3486b955f3bac lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366662.114326:0:5815:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9000/0x8da3486b955f3bb3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366662.114329:0:5815:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9000/0x8da3486b955f3bb3 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366662.114332:0:5815:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9000/0x8da3486b955f3bb3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366662.114335:0:5815:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9638902c9000 already unused, calling callback (ffffffffc20ee4f0) 00010000:00010000:2.0:1789366662.114340:0:5815:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9000/0x8da3486b955f3bb3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366662.114344:0:5815:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9000/0x8da3486b955f3bb3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366662.114348:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9638a7404f00) 00010000:00010000:2.0:1789366662.114349:0:5815:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789366662.114350:0:5815:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9000/0x8da3486b955f3bb3 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366662.114354:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9000/0x8da3486b955f3bb3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789366662.114413:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638987e8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0ab23baa-a205-44ad-bf17-f7b47295d82b+50:11475:x1876286751447168:12345-192.168.202.23@tcp:34:lfs.0 Request processed in 464us (656us total) trans 0 rc 0/0 00000100:00100000:2.0:1789366662.114419:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 163 00000100:00100000:3.0:1789366662.140849:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:2.0:1789366662.140916:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751447424 00000100:00100000:2.0:1789366662.140926:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751447424 00000100:00100000:2.0:1789366662.140981:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 164 00000100:00100000:2.0:1789366662.140992:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638bfefb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0ab23baa-a205-44ad-bf17-f7b47295d82b+50:11478:x1876286751447424:12345-192.168.202.23@tcp:101:lfs.0 00010000:00010000:2.0:1789366662.141012:0:5817:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789366662.141031:0:5817:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9000/0x8da3486b955f3bba lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xda917a494d06c213 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366662.141102:0:5817:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9c00/0x8da3486b955f3bc1 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366662.141117:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9c00/0x8da3486b955f3bc1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366662.141158:0:5817:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9c00/0x8da3486b955f3bc1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366662.141169:0:5817:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9a00/0x8da3486b955f3bc8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366662.141174:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9a00/0x8da3486b955f3bc8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366662.141178:0:5817:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9a00/0x8da3486b955f3bc8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366662.141268:0:5817:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c8400/0x8da3486b955f3bcf lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366662.141274:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c8400/0x8da3486b955f3bcf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366662.141278:0:5817:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c8400/0x8da3486b955f3bcf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789366662.141286:0:5817:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:2.0:1789366662.141381:0:5817:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9c00/0x8da3486b955f3bc1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366662.141400:0:5817:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9c00/0x8da3486b955f3bc1 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366662.141407:0:5817:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9c00/0x8da3486b955f3bc1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366662.141413:0:5817:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9638902c9c00 already unused, calling callback (ffffffffc20ee4f0) 00010000:00010000:2.0:1789366662.141424:0:5817:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9c00/0x8da3486b955f3bc1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366662.141439:0:5817:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9c00/0x8da3486b955f3bc1 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366662.141452:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff963890797800) 00010000:00010000:2.0:1789366662.141455:0:5817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789366662.141460:0:5817:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9c00/0x8da3486b955f3bc1 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366662.141467:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9c00/0x8da3486b955f3bc1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366662.141481:0:5817:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9a00/0x8da3486b955f3bc8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366662.141487:0:5817:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9a00/0x8da3486b955f3bc8 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366662.141492:0:5817:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9a00/0x8da3486b955f3bc8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366662.141498:0:5817:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9638902c9a00 already unused, calling callback (ffffffffc20ee4f0) 00010000:00010000:2.0:1789366662.141501:0:5817:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9a00/0x8da3486b955f3bc8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366662.141507:0:5817:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9a00/0x8da3486b955f3bc8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366662.141515:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9638a7404300) 00010000:00010000:2.0:1789366662.141518:0:5817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789366662.141537:0:5817:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9a00/0x8da3486b955f3bc8 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366662.141545:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9a00/0x8da3486b955f3bc8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366662.141579:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9000/0x8da3486b955f3bba lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.23@tcp remote: 0xda917a494d06c213 expref: 53 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366662.141593:0:5817:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c8400/0x8da3486b955f3bcf lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.23@tcp remote: 0xda917a494d06c213 expref: 52 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366662.141601:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9638a7404f00) 00010000:00010000:2.0:1789366662.141604:0:5817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789366662.141606:0:5817:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9638902c8400, rc 0) 00000100:00100000:2.0:1789366662.141659:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638bfefb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0ab23baa-a205-44ad-bf17-f7b47295d82b+52:11478:x1876286751447424:12345-192.168.202.23@tcp:101:lfs.0 Request processed in 670us (822us total) trans 4294967448 rc 0/0 00000100:00100000:2.0:1789366662.141664:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 164 00000100:00100000:1.0:1789366662.144447:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:2.0:1789366662.144681:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751447552 00000100:00100000:2.0:1789366662.144689:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751447552 00000100:00100000:2.0:1789366662.144753:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 165 00000100:00100000:2.0:1789366662.144763:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638987e8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0ab23baa-a205-44ad-bf17-f7b47295d82b+52:11478:x1876286751447552:12345-192.168.202.23@tcp:54:lfs.0 00010000:00010000:2.0:1789366662.144818:0:5816:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9200/0x8da3486b955f3bdd lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366662.144834:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9200/0x8da3486b955f3bdd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366662.144844:0:5816:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9200/0x8da3486b955f3bdd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366662.144883:0:5816:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9200/0x8da3486b955f3bdd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366662.144890:0:5816:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9200/0x8da3486b955f3bdd lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366662.144896:0:5816:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9200/0x8da3486b955f3bdd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366662.144902:0:5816:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9638902c9200 already unused, calling callback (ffffffffc20ee4f0) 00010000:00010000:2.0:1789366662.144906:0:5816:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9200/0x8da3486b955f3bdd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366662.144913:0:5816:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9200/0x8da3486b955f3bdd lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366662.144924:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9638a7404f00) 00010000:00010000:2.0:1789366662.144927:0:5816:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789366662.144932:0:5816:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9200/0x8da3486b955f3bdd lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366662.144938:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9200/0x8da3486b955f3bdd lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789366662.145006:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638987e8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0ab23baa-a205-44ad-bf17-f7b47295d82b+52:11478:x1876286751447552:12345-192.168.202.23@tcp:54:lfs.0 Request processed in 244us (565us total) trans 0 rc 0/0 00000100:00100000:2.0:1789366662.145013:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 165 00000100:00100000:0.0:1789366662.145353:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:3.0:1789366662.145633:0:8419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751447680 00000100:00100000:3.0:1789366662.145638:0:8419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751447680 00000100:00100000:3.0:1789366662.145666:0:8419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 12 00000100:00100000:3.0:1789366662.145672:0:8419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638b7352a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0ab23baa-a205-44ad-bf17-f7b47295d82b+52:2354:x1876286751447680:12345-192.168.202.23@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789366662.145683:0:8419:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789366662.145700:0:8419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c8400/0x8da3486b955f3bcf lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.23@tcp remote: 0xda917a494d06c213 expref: 52 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366662.145713:0:8419:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9638a7404f00) 00010000:00010000:3.0:1789366662.145749:0:8419:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789366662.145776:0:8419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638b7352a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0ab23baa-a205-44ad-bf17-f7b47295d82b+51:2354:x1876286751447680:12345-192.168.202.23@tcp:103:ldlm_bl.0 Request processed in 104us (426us total) trans 0 rc 0/0 00000100:00100000:3.0:1789366662.145781:0:8419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 12 00000100:00100000:1.0:1789366662.146643:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:2.0:1789366662.146704:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751447936 00000100:00100000:2.0:1789366662.146709:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751447936 00000100:00100000:2.0:1789366662.146791:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 44 00000100:00100000:2.0:1789366662.146808:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963888cb9850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0ab23baa-a205-44ad-bf17-f7b47295d82b+51:11478:x1876286751447936:12345-192.168.202.23@tcp:35:lfs.0 00000100:00100000:2.0:1789366662.147003:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963888cb9850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0ab23baa-a205-44ad-bf17-f7b47295d82b+52:11478:x1876286751447936:12345-192.168.202.23@tcp:35:lfs.0 Request processed in 195us (360us total) trans 4294967449 rc 0/0 00000100:00100000:2.0:1789366662.147011:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 44 00010000:00010000:0.0:1789366662.199996:0:5805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789366662.243501:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:2.0:1789366662.243560:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751448192 00000100:00100000:2.0:1789366662.243569:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751448192 00000100:00100000:2.0:1789366662.243620:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 166 00000100:00100000:2.0:1789366662.243627:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638b702d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0ab23baa-a205-44ad-bf17-f7b47295d82b+52:11496:x1876286751448192:12345-192.168.202.23@tcp:101:cat.0 00010000:00010000:2.0:1789366662.243647:0:5815:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789366662.243674:0:5815:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9200/0x8da3486b955f3be4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xda917a494d06c21a expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366662.243797:0:5815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9000/0x8da3486b955f3beb lrc: 3/1,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366662.243812:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9000/0x8da3486b955f3beb lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366662.243824:0:5815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9000/0x8da3486b955f3beb lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789366662.243835:0:5815:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:2.0:1789366662.243957:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9200/0x8da3486b955f3be4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.23@tcp remote: 0xda917a494d06c21a expref: 55 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366662.244125:0:5815:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9000/0x8da3486b955f3beb lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.23@tcp remote: 0xda917a494d06c21a expref: 54 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366662.244160:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9638a7404f00) 00010000:00010000:2.0:1789366662.244162:0:5815:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1789366662.244165:0:5815:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9638902c9000, rc 0) 00000100:00100000:2.0:1789366662.244216:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638b702d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0ab23baa-a205-44ad-bf17-f7b47295d82b+54:11496:x1876286751448192:12345-192.168.202.23@tcp:101:cat.0 Request processed in 589us (726us total) trans 4294967450 rc 0/0 00000100:00100000:2.0:1789366662.244223:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 166 00000100:00100000:1.0:1789366662.260085:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:2.0:1789366662.260155:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751448320 00000100:00100000:2.0:1789366662.260164:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751448320 00000100:00100000:2.0:1789366662.260215:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 167 00000100:00100000:2.0:1789366662.260222:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638b702c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0ab23baa-a205-44ad-bf17-f7b47295d82b+54:11497:x1876286751448320:12345-192.168.202.23@tcp:101:lfs.0 00010000:00010000:2.0:1789366662.260242:0:5817:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789366662.260258:0:5817:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9200/0x8da3486b955f3bf9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xda917a494d06c221 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366662.260306:0:5817:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9a00/0x8da3486b955f3c00 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366662.260317:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9a00/0x8da3486b955f3c00 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366662.260325:0:5817:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9a00/0x8da3486b955f3c00 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789366662.260353:0:5817:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00000004:00200000:2.0:1789366662.260357:0:5817:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1789366662.260374:0:5817:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9a00/0x8da3486b955f3c00 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366662.260415:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9200/0x8da3486b955f3bf9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.23@tcp remote: 0xda917a494d06c221 expref: 56 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366662.260434:0:5817:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9a00/0x8da3486b955f3c00 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.23@tcp remote: 0xda917a494d06c221 expref: 55 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366662.260443:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff963890797800) 00010000:00010000:2.0:1789366662.260445:0:5817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789366662.260449:0:5817:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9638902c9a00, rc 0) 00000100:00100000:2.0:1789366662.260576:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638b702c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0ab23baa-a205-44ad-bf17-f7b47295d82b+55:11497:x1876286751448320:12345-192.168.202.23@tcp:101:lfs.0 Request processed in 353us (500us total) trans 0 rc 0/0 00000100:00100000:2.0:1789366662.260584:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 167 00000100:00100000:1.0:1789366662.264903:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:0.0:1789366662.264998:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751448704 00000100:00100000:0.0:1789366662.265008:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751448704 00000100:00100000:0.0:1789366662.265061:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 45 00000100:00100000:0.0:1789366662.265072:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638b702ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0ab23baa-a205-44ad-bf17-f7b47295d82b+55:11497:x1876286751448704:12345-192.168.202.23@tcp:35:lfs.0 00000100:00100000:0.0:1789366662.265385:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638b702ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0ab23baa-a205-44ad-bf17-f7b47295d82b+56:11497:x1876286751448704:12345-192.168.202.23@tcp:35:lfs.0 Request processed in 314us (490us total) trans 4294967451 rc 0/0 00000100:00100000:0.0:1789366662.265393:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 45 00000100:00100000:1.0:1789366662.267102:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:3.0:1789366662.267287:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751448832 00000100:00100000:3.0:1789366662.267294:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751448832 00000100:00100000:3.0:1789366662.267352:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 13 00000100:00100000:3.0:1789366662.267358:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96389077ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0ab23baa-a205-44ad-bf17-f7b47295d82b+56:11497:x1876286751448832:12345-192.168.202.23@tcp:103:lfs.0 00010000:00010000:3.0:1789366662.267368:0:5803:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:3.0:1789366662.267388:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720cc00/0x8da3486b955f3b9e lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.23@tcp remote: 0xda917a494d06c20c expref: 56 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366662.267401:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9000/0x8da3486b955f3beb lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.23@tcp remote: 0xda917a494d06c21a expref: 55 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366662.267410:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c8000/0x8da3486b955f3ab0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.23@tcp remote: 0xda917a494d06c1d4 expref: 54 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366662.267417:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9638a7404f00) 00010000:00010000:3.0:1789366662.267424:0:5803:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789366662.267498:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96389077ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0ab23baa-a205-44ad-bf17-f7b47295d82b+53:11497:x1876286751448832:12345-192.168.202.23@tcp:103:lfs.0 Request processed in 140us (400us total) trans 0 rc 0/0 00000100:00100000:3.0:1789366662.267503:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 13 00000100:00100000:1.0:1789366662.268678:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:3.0:1789366662.268801:0:7614:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751448960 00000100:00100000:3.0:1789366662.268807:0:7614:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751448960 00000100:00100000:3.0:1789366662.268933:0:7614:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 168 00000100:00100000:3.0:1789366662.268939:0:7614:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96389077f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0ab23baa-a205-44ad-bf17-f7b47295d82b+53:11497:x1876286751448960:12345-192.168.202.23@tcp:58:lfs.0 00010000:00010000:3.0:1789366662.269039:0:7614:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9638832d3400/0x8da3486b955f3c07 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7614 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366662.269050:0:7614:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9638832d3400/0x8da3486b955f3c07 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7614 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366662.269057:0:7614:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9638832d3400/0x8da3486b955f3c07 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7614 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1789366662.269274:0:7614:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].4, 136 off8736 00000100:00100000:3.0:1789366662.269394:0:7614:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96389077f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0ab23baa-a205-44ad-bf17-f7b47295d82b+53:11497:x1876286751448960:12345-192.168.202.23@tcp:58:lfs.0 Request processed in 454us (718us total) trans 0 rc 0/0 00000100:00100000:3.0:1789366662.269399:0:7614:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 168 00000100:00100000:1.0:1789366662.279795:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:2.0:1789366662.280059:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751449088 00000100:00100000:2.0:1789366662.280067:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751449088 00000100:00100000:2.0:1789366662.280117:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 169 00000100:00100000:2.0:1789366662.280128:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96389077f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0ab23baa-a205-44ad-bf17-f7b47295d82b+53:11499:x1876286751449088:12345-192.168.202.23@tcp:101:lfs.0 00010000:00010000:2.0:1789366662.280159:0:5815:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789366662.280178:0:5815:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9200/0x8da3486b955f3c0e lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xda917a494d06c228 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366662.280230:0:5815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9c00/0x8da3486b955f3c15 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366662.280242:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9c00/0x8da3486b955f3c15 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366662.280250:0:5815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9c00/0x8da3486b955f3c15 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366662.280270:0:5815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c8800/0x8da3486b955f3c1c lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366662.280275:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c8800/0x8da3486b955f3c1c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366662.280279:0:5815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c8800/0x8da3486b955f3c1c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366662.280348:0:5815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c8e00/0x8da3486b955f3c23 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366662.280353:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c8e00/0x8da3486b955f3c23 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366662.280357:0:5815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c8e00/0x8da3486b955f3c23 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789366662.280384:0:5815:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:2.0:1789366662.280387:0:5815:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1789366662.280400:0:5815:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c8e00/0x8da3486b955f3c23 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366662.280408:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c8e00/0x8da3486b955f3c23 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366662.280413:0:5815:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9c00/0x8da3486b955f3c15 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366662.280418:0:5815:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9c00/0x8da3486b955f3c15 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366662.280429:0:5815:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9c00/0x8da3486b955f3c15 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366662.280433:0:5815:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9638902c9c00 already unused, calling callback (ffffffffc20ee4f0) 00010000:00010000:2.0:1789366662.280437:0:5815:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9c00/0x8da3486b955f3c15 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366662.280442:0:5815:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9c00/0x8da3486b955f3c15 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366662.280451:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff963890797800) 00010000:00010000:2.0:1789366662.280453:0:5815:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789366662.280457:0:5815:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9c00/0x8da3486b955f3c15 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366662.280461:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9c00/0x8da3486b955f3c15 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366662.280470:0:5815:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c8800/0x8da3486b955f3c1c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366662.280476:0:5815:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c8800/0x8da3486b955f3c1c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366662.280487:0:5815:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c8800/0x8da3486b955f3c1c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366662.280491:0:5815:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9638902c8800 already unused, calling callback (ffffffffc20ee4f0) 00010000:00010000:2.0:1789366662.280494:0:5815:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c8800/0x8da3486b955f3c1c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366662.280509:0:5815:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c8800/0x8da3486b955f3c1c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366662.280517:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9638a7404300) 00010000:00010000:2.0:1789366662.280520:0:5815:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789366662.280522:0:5815:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c8800/0x8da3486b955f3c1c lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366662.280528:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c8800/0x8da3486b955f3c1c lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366662.280552:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9200/0x8da3486b955f3c0e lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.23@tcp remote: 0xda917a494d06c228 expref: 55 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366662.280562:0:5815:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c8e00/0x8da3486b955f3c23 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.23@tcp remote: 0xda917a494d06c228 expref: 54 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366662.280566:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff96388c43fb00) 00010000:00010000:2.0:1789366662.280568:0:5815:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789366662.280569:0:5815:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9638902c8e00, rc 0) 00000100:00100000:2.0:1789366662.280660:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96389077f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0ab23baa-a205-44ad-bf17-f7b47295d82b+54:11499:x1876286751449088:12345-192.168.202.23@tcp:101:lfs.0 Request processed in 528us (869us total) trans 0 rc 0/0 00000100:00100000:2.0:1789366662.280668:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 169 00000040:00080000:1.0:1789366662.392994:0:11650:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1789366662.393004:0:11650:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1789366662.393172:0:11650:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 4 00000040:00080000:1.0:1789366662.393179:0:11650:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1789366662.393343:0:11650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96389077fb80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11650:1876286758780288:192.168.202.23@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1789366662.393486:0:11650:0:(client.c:2716:ptlrpc_set_wait()) set ffff9638bf1dd540 going to sleep for 11 seconds 00000100:00100000:3.0:1789366662.400086:0:11650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96389077fb80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11650:1876286758780288:192.168.202.23@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1789366662.408138:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:2.0:1789366662.408225:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751449216 00000100:00100000:2.0:1789366662.408235:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751449216 00000100:00100000:2.0:1789366662.408297:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 170 00000100:00100000:2.0:1789366662.408307:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638bfef8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0ab23baa-a205-44ad-bf17-f7b47295d82b+54:11510:x1876286751449216:12345-192.168.202.23@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1789366662.408348:0:5817:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1789366662.408474:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638bfef8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0ab23baa-a205-44ad-bf17-f7b47295d82b+54:11510:x1876286751449216:12345-192.168.202.23@tcp:53:lhsmtool_posix.0 Request processed in 168us (358us total) trans 0 rc 0/0 00000100:00100000:2.0:1789366662.408482:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 170 00000100:00100000:1.0:1789366662.413049:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:2.0:1789366662.414008:0:7614:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751449344 00000100:00100000:2.0:1789366662.414018:0:7614:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751449344 00000100:00100000:2.0:1789366662.414071:0:7614:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 171 00000100:00100000:2.0:1789366662.414080:0:7614:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96389077e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0ab23baa-a205-44ad-bf17-f7b47295d82b+54:11510:x1876286751449344:12345-192.168.202.23@tcp:34:lhsmtool_posix.0 00010000:00010000:2.0:1789366662.414161:0:7614:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9c00/0x8da3486b955f3c2a lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7614 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366662.414178:0:7614:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9c00/0x8da3486b955f3c2a lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7614 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366662.414191:0:7614:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9c00/0x8da3486b955f3c2a lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7614 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366662.414250:0:7614:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c8800/0x8da3486b955f3c31 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7614 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366662.414259:0:7614:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c8800/0x8da3486b955f3c31 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7614 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366662.414265:0:7614:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c8800/0x8da3486b955f3c31 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7614 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366662.414291:0:7614:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9200/0x8da3486b955f3c38 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7614 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366662.414299:0:7614:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9200/0x8da3486b955f3c38 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7614 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366662.414311:0:7614:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9200/0x8da3486b955f3c38 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7614 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789366662.414346:0:7614:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:2.0:1789366662.414350:0:7614:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1789366662.414362:0:7614:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9200/0x8da3486b955f3c38 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7614 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366662.414374:0:7614:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9c00/0x8da3486b955f3c2a lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7614 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366662.414380:0:7614:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9c00/0x8da3486b955f3c2a lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7614 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366662.414387:0:7614:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9c00/0x8da3486b955f3c2a lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7614 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366662.414393:0:7614:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9638902c9c00 already unused, calling callback (ffffffffc20ee4f0) 00010000:00010000:2.0:1789366662.414397:0:7614:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9c00/0x8da3486b955f3c2a lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7614 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366662.414405:0:7614:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9c00/0x8da3486b955f3c2a lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7614 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366662.414416:0:7614:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9638a7404100) 00010000:00010000:2.0:1789366662.414420:0:7614:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789366662.414424:0:7614:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9c00/0x8da3486b955f3c2a lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7614 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366662.414430:0:7614:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9c00/0x8da3486b955f3c2a lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7614 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366662.414451:0:7614:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c8800/0x8da3486b955f3c31 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7614 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366662.414458:0:7614:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c8800/0x8da3486b955f3c31 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7614 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366662.414464:0:7614:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c8800/0x8da3486b955f3c31 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7614 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366662.414469:0:7614:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9638902c8800 already unused, calling callback (ffffffffc20ee4f0) 00010000:00010000:2.0:1789366662.414472:0:7614:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c8800/0x8da3486b955f3c31 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7614 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366662.414478:0:7614:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c8800/0x8da3486b955f3c31 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7614 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366662.414486:0:7614:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x19697575 (ffff9638a7404300) 00010000:00010000:2.0:1789366662.414489:0:7614:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789366662.414492:0:7614:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c8800/0x8da3486b955f3c31 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7614 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366662.414497:0:7614:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c8800/0x8da3486b955f3c31 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7614 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366662.414510:0:7614:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9200/0x8da3486b955f3c38 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7614 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366662.414516:0:7614:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9200/0x8da3486b955f3c38 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7614 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366662.414521:0:7614:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9200/0x8da3486b955f3c38 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7614 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366662.414530:0:7614:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9638902c9200 already unused, calling callback (ffffffffc20ee4f0) 00010000:00010000:2.0:1789366662.414533:0:7614:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9200/0x8da3486b955f3c38 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7614 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366662.414540:0:7614:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9200/0x8da3486b955f3c38 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7614 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366662.414547:0:7614:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff96388c43fb00) 00010000:00010000:2.0:1789366662.414550:0:7614:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789366662.414552:0:7614:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9200/0x8da3486b955f3c38 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7614 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366662.414557:0:7614:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9200/0x8da3486b955f3c38 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7614 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789366662.414628:0:7614:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96389077e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0ab23baa-a205-44ad-bf17-f7b47295d82b+54:11510:x1876286751449344:12345-192.168.202.23@tcp:34:lhsmtool_posix.0 Request processed in 548us (1588us total) trans 0 rc 0/0 00000100:00100000:2.0:1789366662.414635:0:7614:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 171 00000100:00100000:2.0:1789366662.418198:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:1.0:1789366662.421861:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751449600 00000100:00100000:1.0:1789366662.421876:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751449600 00000100:00100000:1.0:1789366662.421998:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 172 00000100:00100000:1.0:1789366662.422009:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638bfec9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0ab23baa-a205-44ad-bf17-f7b47295d82b+54:11510:x1876286751449600:12345-192.168.202.23@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789366662.422031:0:5815:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789366662.422055:0:5815:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9638b6ce3000/0x8da3486b955f3c3f lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xda917a494d06c22f expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366662.422208:0:5815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9638b6ce2e00/0x8da3486b955f3c46 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366662.422225:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9638b6ce2e00/0x8da3486b955f3c46 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366662.422237:0:5815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9638b6ce2e00/0x8da3486b955f3c46 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789366662.422247:0:5815:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:1.0:1789366662.422334:0:5815:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9638b6ce2e00/0x8da3486b955f3c46 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366662.422342:0:5815:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9638b6ce2e00/0x8da3486b955f3c46 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366662.422349:0:5815:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9638b6ce2e00/0x8da3486b955f3c46 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366662.422354:0:5815:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9638b6ce2e00 already unused, calling callback (ffffffffc20ee4f0) 00010000:00010000:1.0:1789366662.422366:0:5815:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9638b6ce2e00/0x8da3486b955f3c46 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366662.422375:0:5815:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9638b6ce2e00/0x8da3486b955f3c46 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366662.422385:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff96388c43fb00) 00010000:00010000:1.0:1789366662.422388:0:5815:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789366662.422393:0:5815:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9638b6ce2e00/0x8da3486b955f3c46 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366662.422400:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9638b6ce2e00/0x8da3486b955f3c46 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366662.422445:0:5815:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9638b6ce3000/0x8da3486b955f3c3f lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.23@tcp remote: 0xda917a494d06c22f expref: 56 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366662.422454:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9638a7404100) 00010000:00010000:1.0:1789366662.422456:0:5815:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1789366662.422460:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9638b6ce3000/0x8da3486b955f3c3f lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.23@tcp remote: 0xda917a494d06c22f expref: 56 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366662.422469:0:5815:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9638b6ce3000, rc 0) 00000100:00100000:1.0:1789366662.422530:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638bfec9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0ab23baa-a205-44ad-bf17-f7b47295d82b+55:11510:x1876286751449600:12345-192.168.202.23@tcp:101:lhsmtool_posix.0 Request processed in 523us (4343us total) trans 4294967452 rc 301/301 00000100:00100000:1.0:1789366662.422547:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 172 00000100:00100000:2.0:1789366662.430399:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:3.0:1789366662.430486:0:7132:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751449728 00000100:00100000:3.0:1789366662.430495:0:7132:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751449728 00000100:00100000:3.0:1789366662.430714:0:7132:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 173 00000100:00100000:3.0:1789366662.430779:0:7132:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638af280000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0ab23baa-a205-44ad-bf17-f7b47295d82b+55:11510:x1876286751449728:12345-192.168.202.23@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1789366662.430955:0:7132:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1789366662.431051:0:7132:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638af280000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0ab23baa-a205-44ad-bf17-f7b47295d82b+55:11510:x1876286751449728:12345-192.168.202.23@tcp:53:lhsmtool_posix.0 Request processed in 275us (661us total) trans 0 rc 0/0 00000100:00100000:3.0:1789366662.431058:0:7132:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 173 00000100:00100000:0.0:1789366662.435258:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:2.0:1789366662.435704:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751449984 00000100:00100000:2.0:1789366662.435714:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751449984 00000100:00100000:2.0:1789366662.435792:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 174 00000100:00100000:2.0:1789366662.435803:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638b7352d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0ab23baa-a205-44ad-bf17-f7b47295d82b+55:11510:x1876286751449984:12345-192.168.202.23@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789366662.435824:0:5816:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789366662.435828:0:5816:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1789366662.435862:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9a00/0x8da3486b955f3c00 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.23@tcp remote: 0xda917a494d06c221 expref: 55 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366662.435897:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff963890797800) 00010000:00010000:2.0:1789366662.435900:0:5816:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789366662.435911:0:5816:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9200/0x8da3486b955f3c54 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xda917a494d06c236 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1789366662.436271:0:5816:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x5:0x0], index 0: 0 00010000:00010000:2.0:1789366662.436457:0:5816:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c8800/0x8da3486b955f3c5b lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366662.436471:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c8800/0x8da3486b955f3c5b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366662.436481:0:5816:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c8800/0x8da3486b955f3c5b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366662.436530:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9200/0x8da3486b955f3c54 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.23@tcp remote: 0xda917a494d06c236 expref: 57 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366662.436545:0:5816:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c8800/0x8da3486b955f3c5b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.23@tcp remote: 0xda917a494d06c236 expref: 56 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366662.436552:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9638a7404300) 00010000:00010000:2.0:1789366662.436555:0:5816:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789366662.436557:0:5816:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9638902c8800, rc 0) 00000100:00100000:2.0:1789366662.436663:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638b7352d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0ab23baa-a205-44ad-bf17-f7b47295d82b+56:11510:x1876286751449984:12345-192.168.202.23@tcp:101:lhsmtool_posix.0 Request processed in 862us (1415us total) trans 4294967453 rc 0/0 00000100:00100000:2.0:1789366662.436671:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 174 00000100:00100000:0.0:1789366662.439238:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:1.0:1789366662.439298:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751450240 00000100:00100000:1.0:1789366662.439307:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751450240 00000100:00100000:1.0:1789366662.439388:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 175 00000100:00100000:1.0:1789366662.439398:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638b7351c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0ab23baa-a205-44ad-bf17-f7b47295d82b+56:11510:x1876286751450240:12345-192.168.202.23@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1789366662.439480:0:5815:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789366662.439512:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c8800/0x8da3486b955f3c5b lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.23@tcp remote: 0xda917a494d06c236 expref: 56 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366662.439528:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9638a7404300) 00010000:00010000:1.0:1789366662.439537:0:5815:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789366662.439555:0:5815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9638b6ce3000/0x8da3486b955f3c69 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366662.439567:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9638b6ce3000/0x8da3486b955f3c69 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366662.439577:0:5815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9638b6ce3000/0x8da3486b955f3c69 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366662.439610:0:5815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9638b6ce2e00/0x8da3486b955f3c70 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x3beb498 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366662.439624:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9638b6ce2e00/0x8da3486b955f3c70 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x3beb498 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366662.439632:0:5815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9638b6ce2e00/0x8da3486b955f3c70 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x3beb498 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366662.439689:0:5815:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9638b6ce3000/0x8da3486b955f3c69 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366662.439696:0:5815:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9638b6ce3000/0x8da3486b955f3c69 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366662.439702:0:5815:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9638b6ce3000/0x8da3486b955f3c69 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366662.439713:0:5815:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9638b6ce3000 already unused, calling callback (ffffffffc20ee4f0) 00010000:00010000:1.0:1789366662.439908:0:5815:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9638b6ce3000/0x8da3486b955f3c69 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366662.439917:0:5815:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9638b6ce3000/0x8da3486b955f3c69 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366662.439926:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff963890797800) 00010000:00010000:1.0:1789366662.439929:0:5815:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789366662.439933:0:5815:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9638b6ce3000/0x8da3486b955f3c69 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366662.439939:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9638b6ce3000/0x8da3486b955f3c69 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366662.439950:0:5815:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9638b6ce2e00/0x8da3486b955f3c70 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x3beb498 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366662.439956:0:5815:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9638b6ce2e00/0x8da3486b955f3c70 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x3beb498 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366662.439961:0:5815:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9638b6ce2e00/0x8da3486b955f3c70 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x3beb498 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366662.439966:0:5815:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9638b6ce2e00 already unused, calling callback (ffffffffc20ee4f0) 00010000:00010000:1.0:1789366662.439969:0:5815:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9638b6ce2e00/0x8da3486b955f3c70 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x3beb498 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366662.439975:0:5815:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9638b6ce2e00/0x8da3486b955f3c70 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x3beb498 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366662.439991:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x3beb498 (ffff963887f88d00) 00010000:00010000:1.0:1789366662.439993:0:5815:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789366662.439996:0:5815:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9638b6ce2e00/0x8da3486b955f3c70 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x3beb498 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366662.440002:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9638b6ce2e00/0x8da3486b955f3c70 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x3beb498 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789366662.440067:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638b7351c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0ab23baa-a205-44ad-bf17-f7b47295d82b+55:11510:x1876286751450240:12345-192.168.202.23@tcp:36:lhsmtool_posix.0 Request processed in 670us (836us total) trans 0 rc -2/-2 00000100:00100000:1.0:1789366662.440074:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 175 00000100:00100000:3.0:1789366662.441706:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:2.0:1789366662.442038:0:7614:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751450368 00000100:00100000:2.0:1789366662.442048:0:7614:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751450368 00000100:00100000:2.0:1789366662.442119:0:7614:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 176 00000100:00100000:2.0:1789366662.442127:0:7614:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638bfefb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0ab23baa-a205-44ad-bf17-f7b47295d82b+55:11510:x1876286751450368:12345-192.168.202.23@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789366662.442161:0:7614:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789366662.442179:0:7614:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9c00/0x8da3486b955f3c77 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xda917a494d06c23d expref: -99 pid: 7614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366662.442209:0:7614:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9000/0x8da3486b955f3c7e lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7614 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366662.442218:0:7614:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9000/0x8da3486b955f3c7e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7614 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366662.442226:0:7614:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9000/0x8da3486b955f3c7e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7614 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366662.442297:0:7614:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9c00/0x8da3486b955f3c77 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.23@tcp remote: 0xda917a494d06c23d expref: 57 pid: 7614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366662.442310:0:7614:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9000/0x8da3486b955f3c7e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.23@tcp remote: 0xda917a494d06c23d expref: 56 pid: 7614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366662.442316:0:7614:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9638a7404700) 00010000:00010000:2.0:1789366662.442318:0:7614:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1789366662.442320:0:7614:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9638902c9000, rc 0) 00000100:00100000:2.0:1789366662.442360:0:7614:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638bfefb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0ab23baa-a205-44ad-bf17-f7b47295d82b+56:11510:x1876286751450368:12345-192.168.202.23@tcp:101:lhsmtool_posix.0 Request processed in 234us (660us total) trans 0 rc 0/0 00000100:00100000:2.0:1789366662.442367:0:7614:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 176 00000100:00100000:0.0:1789366662.443677:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:2.0:1789366662.443944:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751450624 00000100:00100000:2.0:1789366662.443953:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751450624 00000100:00100000:2.0:1789366662.443994:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 177 00000100:00100000:2.0:1789366662.444003:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638b7353800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0ab23baa-a205-44ad-bf17-f7b47295d82b+56:11510:x1876286751450624:12345-192.168.202.23@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1789366662.444055:0:5816:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9200/0x8da3486b955f3c85 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366662.444066:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9200/0x8da3486b955f3c85 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366662.444073:0:5816:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9200/0x8da3486b955f3c85 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1789366662.444293:0:5816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].6, 88 off8648 00000004:00080000:2.0:1789366662.444301:0:5816:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 237908582000ns, next at 238908580575ns, rc = 0 00000004:00010000:2.0:1789366662.444362:0:5816:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000690f6c48 reply state 000000004fc2e983 transno 4294967454 ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9200/0x8da3486b955f3c85 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789366662.444369:0:5816:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789366662.444435:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638b7353800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0ab23baa-a205-44ad-bf17-f7b47295d82b+58:11510:x1876286751450624:12345-192.168.202.23@tcp:36:lhsmtool_posix.0 Request processed in 433us (762us total) trans 4294967454 rc 0/0 00000100:00100000:2.0:1789366662.444440:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 177 00010000:00010000:3.0:1789366662.445410:0:3270:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9200/0x8da3486b955f3c85 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366662.445421:0:3270:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9200/0x8da3486b955f3c85 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366662.445428:0:3270:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9200/0x8da3486b955f3c85 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366662.445434:0:3270:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9638902c9200 already unused, calling callback (ffffffffc20ee4f0) 00010000:00010000:3.0:1789366662.445439:0:3270:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9200/0x8da3486b955f3c85 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366662.445459:0:3270:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9200/0x8da3486b955f3c85 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366662.445471:0:3270:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9638a7404700) 00010000:00010000:3.0:1789366662.445474:0:3270:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1789366662.445479:0:3270:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9200/0x8da3486b955f3c85 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366662.445485:0:3270:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9200/0x8da3486b955f3c85 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789366662.445880:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:1.0:1789366662.445918:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751450752 00000100:00100000:1.0:1789366662.445924:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751450752 00000100:00100000:1.0:1789366662.445965:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 178 00000100:00100000:1.0:1789366662.445974:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638b7351500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0ab23baa-a205-44ad-bf17-f7b47295d82b+57:11510:x1876286751450752:12345-192.168.202.23@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789366662.445988:0:5815:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789366662.446002:0:5815:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9638b6ce2a00/0x8da3486b955f3c8c lrc: 2/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xda917a494d06c244 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366662.446043:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9638b6ce2a00/0x8da3486b955f3c8c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.23@tcp remote: 0xda917a494d06c244 expref: 58 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366662.446055:0:5815:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9638b6ce2a00/0x8da3486b955f3c8c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.23@tcp remote: 0xda917a494d06c244 expref: 58 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366662.446072:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9638a7404700) 00010000:00010000:1.0:1789366662.446074:0:5815:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789366662.446084:0:5815:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9638b6ce2a00, rc 0) 00000100:00100000:1.0:1789366662.446114:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638b7351500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0ab23baa-a205-44ad-bf17-f7b47295d82b+58:11510:x1876286751450752:12345-192.168.202.23@tcp:101:lhsmtool_posix.0 Request processed in 143us (236us total) trans 0 rc 0/0 00000100:00100000:1.0:1789366662.446119:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 178 00000100:00100000:0.0:1789366662.447287:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:2.0:1789366662.447323:0:8065:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751450880 00000100:00100000:2.0:1789366662.447328:0:8065:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751450880 00000100:00100000:2.0:1789366662.447399:0:8065:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 51 00000100:00100000:2.0:1789366662.447406:0:8065:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638b7350a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0ab23baa-a205-44ad-bf17-f7b47295d82b+6:2355:x1876286751450880:12345-192.168.202.23@tcp:2:lhsmtool_posix.0 00000100:00100000:2.0:1789366662.447677:0:8065:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638b7350a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0ab23baa-a205-44ad-bf17-f7b47295d82b+7:2355:x1876286751450880:12345-192.168.202.23@tcp:2:lhsmtool_posix.0 Request processed in 270us (391us total) trans 4294967313 rc 0/0 00000100:00100000:2.0:1789366662.447685:0:8065:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 51 00000100:00080000:1.0:1789366662.448301:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789366662.448885:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:2.0:1789366662.448919:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751451136 00000100:00100000:2.0:1789366662.448925:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751451136 00000100:00100000:2.0:1789366662.448959:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 46 00000100:00100000:2.0:1789366662.448967:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638bfefaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0ab23baa-a205-44ad-bf17-f7b47295d82b+58:11510:x1876286751451136:12345-192.168.202.23@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1789366662.449126:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638bfefaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0ab23baa-a205-44ad-bf17-f7b47295d82b+59:11510:x1876286751451136:12345-192.168.202.23@tcp:35:lhsmtool_posix.0 Request processed in 159us (244us total) trans 4294967455 rc 0/0 00000100:00100000:2.0:1789366662.449144:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 46 00000100:00100000:0.0:1789366662.450362:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:2.0:1789366662.450396:0:7614:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751451392 00000100:00100000:2.0:1789366662.450404:0:7614:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751451392 00000100:00100000:2.0:1789366662.450450:0:7614:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 179 00000100:00100000:2.0:1789366662.450459:0:7614:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638b7351180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0ab23baa-a205-44ad-bf17-f7b47295d82b+59:11510:x1876286751451392:12345-192.168.202.23@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1789366662.450542:0:7614:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638b7351180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0ab23baa-a205-44ad-bf17-f7b47295d82b+59:11510:x1876286751451392:12345-192.168.202.23@tcp:57:lhsmtool_posix.0 Request processed in 84us (182us total) trans 0 rc 0/0 00000100:00100000:2.0:1789366662.450551:0:7614:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 179 00000100:00100000:2.0:1789366662.452070:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:0.0:1789366662.452111:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751451520 00000100:00100000:0.0:1789366662.452118:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751451520 00000100:00100000:0.0:1789366662.452164:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 180 00000100:00100000:0.0:1789366662.452174:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638af2d4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0ab23baa-a205-44ad-bf17-f7b47295d82b+59:11510:x1876286751451520:12345-192.168.202.23@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789366662.452191:0:5816:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789366662.452211:0:5816:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720c400/0x8da3486b955f3c93 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xda917a494d06c24b expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366662.452283:0:5816:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720d600/0x8da3486b955f3c9a lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366662.452295:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720d600/0x8da3486b955f3c9a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366662.452307:0:5816:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720d600/0x8da3486b955f3c9a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789366662.452342:0:5816:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1789366662.452358:0:5816:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720d600/0x8da3486b955f3c9a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366662.452377:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720c400/0x8da3486b955f3c93 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.23@tcp remote: 0xda917a494d06c24b expref: 61 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366662.452388:0:5816:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720d600/0x8da3486b955f3c9a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.23@tcp remote: 0xda917a494d06c24b expref: 60 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366662.452394:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9638a7404700) 00010000:00010000:0.0:1789366662.452396:0:5816:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1789366662.452398:0:5816:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9638b720d600, rc 0) 00000100:00100000:0.0:1789366662.452454:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638af2d4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0ab23baa-a205-44ad-bf17-f7b47295d82b+60:11510:x1876286751451520:12345-192.168.202.23@tcp:101:lhsmtool_posix.0 Request processed in 281us (386us total) trans 0 rc 0/0 00000100:00100000:0.0:1789366662.452460:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 180 00000100:00100000:0.0:1789366662.454478:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:2.0:1789366662.456554:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751451648 00000100:00100000:2.0:1789366662.456568:0:6660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751451648 00000100:00100000:2.0:1789366662.456636:0:6660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 52 00000100:00100000:2.0:1789366662.456648:0:6660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638b7352680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0ab23baa-a205-44ad-bf17-f7b47295d82b+7:2354:x1876286751451648:12345-192.168.202.23@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789366662.456665:0:6660:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789366662.456688:0:6660:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000049d7092d/0x8da3486b955f3ca1 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda917a494d06c252 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789366662.456753:0:6660:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6aa79186, blocks: 0x1 00010000:00010000:2.0:1789366662.456772:0:6660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=237s v=(0 0) 00010000:00010000:2.0:1789366662.456776:0:6660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789366662.456799:0:6660:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000049d7092d/0x8da3486b955f3ca1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.23@tcp remote: 0xda917a494d06c252 expref: 8 pid: 6660 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366662.456818:0:6660:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000049d7092d/0x8da3486b955f3ca1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.23@tcp remote: 0xda917a494d06c252 expref: 8 pid: 6660 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366662.456832:0:6660:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9638902c9c00, rc 0) 00000100:00100000:2.0:1789366662.456896:0:6660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638b7352680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0ab23baa-a205-44ad-bf17-f7b47295d82b+8:2354:x1876286751451648:12345-192.168.202.23@tcp:101:lhsmtool_posix.0 Request processed in 250us (2424us total) trans 0 rc 0/0 00000100:00100000:2.0:1789366662.456904:0:6660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 52 00000100:00100000:1.0:1789366662.460230:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:2.0:1789366662.460363:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751451904 00000100:00100000:2.0:1789366662.460371:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751451904 00000100:00100000:2.0:1789366662.460420:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 181 00000100:00100000:2.0:1789366662.460430:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96389077dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0ab23baa-a205-44ad-bf17-f7b47295d82b+60:11510:x1876286751451904:12345-192.168.202.23@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1789366662.460546:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96389077dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0ab23baa-a205-44ad-bf17-f7b47295d82b+60:11510:x1876286751451904:12345-192.168.202.23@tcp:57:lhsmtool_posix.0 Request processed in 117us (322us total) trans 0 rc 0/0 00000100:00100000:2.0:1789366662.460553:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 181 00000100:00100000:0.0:1789366662.462416:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:3.0:1789366662.462525:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751452032 00000100:00100000:3.0:1789366662.462540:0:6659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751452032 00000100:00100000:3.0:1789366662.462597:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 53 00000100:00100000:3.0:1789366662.462605:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638aef23800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0ab23baa-a205-44ad-bf17-f7b47295d82b+8:11510:x1876286751452032:12345-192.168.202.23@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789366662.462619:0:6659:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789366662.462636:0:6659:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001e78ae4c/0x8da3486b955f3ca8 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda917a494d06c259 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366662.462663:0:6659:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000049d7092d/0x8da3486b955f3ca1 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.23@tcp remote: 0xda917a494d06c252 expref: 9 pid: 6660 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366662.462671:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789366662.462675:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789366662.462680:0:6659:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001e78ae4c/0x8da3486b955f3ca8 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.23@tcp remote: 0xda917a494d06c259 expref: 9 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366662.462751:0:6659:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000049d7092d/0x8da3486b955f3ca1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.23@tcp remote: 0xda917a494d06c252 expref: 9 pid: 6660 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366662.462765:0:6659:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000049d7092d/0x8da3486b955f3ca1 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.23@tcp remote: 0xda917a494d06c252 expref: 9 pid: 6660 timeout: 337 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789366662.462780:0:6659:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9638bfefb480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6659:1876286758780416:192.168.202.23@tcp:104: 00000100:00100000:3.0:1789366662.462877:0:6659:0:(client.c:2716:ptlrpc_set_wait()) set ffff9638a74926c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789366662.464837:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:0.0:1789366662.465227:0:6659:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9638bfefb480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6659:1876286758780416:192.168.202.23@tcp:104: 00010000:00010000:0.0:1789366662.465271:0:6659:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000001e78ae4c/0x8da3486b955f3ca8 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.23@tcp remote: 0xda917a494d06c259 expref: 9 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366662.465293:0:6659:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9638832d2000, rc 0) 00000100:00100000:0.0:1789366662.465346:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638aef23800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0ab23baa-a205-44ad-bf17-f7b47295d82b+9:11510:x1876286751452032:12345-192.168.202.23@tcp:101:lhsmtool_posix.0 Request processed in 2741us (2944us total) trans 0 rc 0/0 00000100:00100000:0.0:1789366662.465355:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 53 00000100:00100000:2.0:1789366662.466419:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751452160 00000100:00100000:2.0:1789366662.466431:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751452160 00010000:00010000:2.0:1789366662.466472:0:5802:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000049d7092d/0x8da3486b955f3ca1 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.23@tcp remote: 0xda917a494d06c252 expref: 9 pid: 6660 timeout: 337 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789366662.466511:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 69 00000100:00100000:2.0:1789366662.466522:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96389861e050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0ab23baa-a205-44ad-bf17-f7b47295d82b+9:2355:x1876286751452160:12345-192.168.202.23@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789366662.466535:0:5802:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789366662.466558:0:5802:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000049d7092d/0x8da3486b955f3ca1 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.23@tcp remote: 0xda917a494d06c252 expref: 9 pid: 6660 timeout: 337 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366662.466582:0:5802:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000049d7092d/0x8da3486b955f3ca1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.23@tcp remote: 0xda917a494d06c252 expref: 9 pid: 6660 timeout: 337 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366662.466607:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000049d7092d/0x8da3486b955f3ca1 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.23@tcp remote: 0xda917a494d06c252 expref: 9 pid: 6660 timeout: 337 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366662.466622:0:5802:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789366662.466626:0:5802:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789366662.466633:0:5802:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000001e78ae4c/0x8da3486b955f3ca8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.23@tcp remote: 0xda917a494d06c259 expref: 8 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366662.466643:0:5802:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001e78ae4c/0x8da3486b955f3ca8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.23@tcp remote: 0xda917a494d06c259 expref: 8 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366662.466680:0:5802:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000001e78ae4c/0x8da3486b955f3ca8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.23@tcp remote: 0xda917a494d06c259 expref: 8 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789366662.466695:0:5802:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff963882ee1c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:5802:1876286758780544:192.168.202.23@tcp:105: 00000100:00100000:2.0:1789366662.466820:0:5802:0:(client.c:2716:ptlrpc_set_wait()) set ffff963882efe480 going to sleep for 11 seconds 00000100:00100000:3.0:1789366662.470105:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:2.0:1789366662.470122:0:5802:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff963882ee1c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:5802:1876286758780544:192.168.202.23@tcp:105: 00000100:00100000:0.0:1789366662.470178:0:6666:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751452288 00000100:00100000:0.0:1789366662.470184:0:6666:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751452288 00002000:00100000:0.0:1789366662.470225:0:6666:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x5:0x0] (0->8) req@ffff9638bfefb480 x1876286751452288/t0(0) o4->0ab23baa-a205-44ad-bf17-f7b47295d82b@192.168.202.23@tcp:63/0 lens 504/0 e 0 to 0 dl 1789366673 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789366662.470232:0:6666:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9638bfefb480 with x1876286751452288 ext(0->8) 00002000:00010000:0.0:1789366662.470236:0:6666:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9638bfefb480 00000100:00100000:0.0:1789366662.470262:0:6666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 5 00000100:00100000:0.0:1789366662.470268:0:6666:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638bfefb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0ab23baa-a205-44ad-bf17-f7b47295d82b+9:2355:x1876286751452288:12345-192.168.202.23@tcp:4:lhsmtool_posix.0 00000100:00100000:0.0:1789366662.470675:0:6666:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638bfefb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0ab23baa-a205-44ad-bf17-f7b47295d82b+11:2355:x1876286751452288:12345-192.168.202.23@tcp:4:lhsmtool_posix.0 Request processed in 404us (578us total) trans 4294967314 rc 0/0 00000100:00100000:0.0:1789366662.470683:0:6666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 5 00002000:00100000:0.0:1789366662.470690:0:6666:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x5:0x0] (0->8) req@ffff9638bfefb480 x1876286751452288/t4294967314(0) o4->0ab23baa-a205-44ad-bf17-f7b47295d82b@192.168.202.23@tcp:63/0 lens 504/448 e 0 to 0 dl 1789366673 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789366662.470699:0:6666:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9638bfefb480 with x1876286751452288 ext(0->8) 00002000:00010000:0.0:1789366662.470702:0:6666:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9638bfefb480 00010000:00010000:2.0:1789366662.471009:0:5802:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789366662.471039:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96389861e050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0ab23baa-a205-44ad-bf17-f7b47295d82b+10:2355:x1876286751452160:12345-192.168.202.23@tcp:103:ldlm_bl.0 Request processed in 4519us (6209us total) trans 0 rc 0/0 00000100:00100000:2.0:1789366662.471048:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 69 00000100:00100000:3.0:1789366662.473040:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:0.0:1789366662.473089:0:7132:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751452416 00000100:00100000:0.0:1789366662.473096:0:7132:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751452416 00000100:00100000:0.0:1789366662.473171:0:7132:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 182 00000100:00100000:0.0:1789366662.473190:0:7132:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638bfef9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0ab23baa-a205-44ad-bf17-f7b47295d82b+60:11510:x1876286751452416:12345-192.168.202.23@tcp:44:lhsmtool_posix.0 00000001:00080000:3.0:1789366662.513964:0:5837:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967451 is committed 00000001:00080000:3.0:1789366662.514015:0:5837:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967452 is committed 00000001:00080000:3.0:1789366662.514034:0:5837:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967455 is committed 00000004:00080000:3.0:1789366662.514064:0:5837:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 7 committed 00000100:00100000:0.0:1789366662.514106:0:7132:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638bfef9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0ab23baa-a205-44ad-bf17-f7b47295d82b+34:11510:x1876286751452416:12345-192.168.202.23@tcp:44:lhsmtool_posix.0 Request processed in 40908us (41062us total) trans 0 rc 0/0 00000100:00100000:0.0:1789366662.514119:0:7132:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 182 00000004:00080000:3.0:1789366662.514125:0:5837:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 5 committed 00000020:00080000:3.0:1789366662.514165:0:5837:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff963882efef00 refcount 2 committed 0 result 0 batchid 5 00000020:00080000:3.0:1789366662.514170:0:5837:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9638bfe67c00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff963882efe000 00000020:00080000:3.0:1789366662.514174:0:5837:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9638bfe67200 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9638b729b800 00000020:00080000:3.0:1789366662.514212:0:5837:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 4 batchid updated 00000100:00100000:3.0:1789366662.514436:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9638bfef8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3284:1876286758780672:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1789366662.514506:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789366662.514593:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286758780672 00000100:00100000:3.0:1789366662.514601:0:6661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286758780672 00000020:00080000:0.0:1789366662.514767:0:5848:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 5 committed batchid 4 00000100:00100000:3.0:1789366662.514954:0:6661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1789366662.514964:0:6661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638bfef9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3284:x1876286758780672:12345-0@lo:6:osp-syn-1-0.0 00000020:00080000:0.0:1789366662.515008:0:5848:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00002000:00080000:3.0:1789366662.515038:0:6661:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:4 count 1 00002000:00010000:3.0:1789366662.515098:0:6661:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x4:0x0] initial LVB size: 13, mtime: 0x6aa79185, atime: 0x0, ctime: 0x6aa79185, blocks: 0xb 00010000:00010000:3.0:1789366662.515107:0:6661:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000082beeec3/0x8da3486b955f3caf lrc: 3/0,1 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366662.515124:0:6661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=237s v=(0 0) 00010000:00010000:3.0:1789366662.515192:0:6661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789366662.515201:0:6661:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000082beeec3/0x8da3486b955f3caf lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366662.515221:0:6661:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000082beeec3/0x8da3486b955f3caf lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366662.515233:0:6661:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000082beeec3/0x8da3486b955f3caf lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366662.515241:0:6661:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000082beeec3/0x8da3486b955f3caf lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366662.515267:0:6661:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789366662.515288:0:5804:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789366662.515297:0:5804:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000082beeec3/0x8da3486b955f3caf lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366662.515307:0:5804:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9638832d3600 already unused, calling callback (ffffffffc16df520) 00010000:00010000:0.0:1789366662.515312:0:5804:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000082beeec3/0x8da3486b955f3caf lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366662.515322:0:5804:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000082beeec3/0x8da3486b955f3caf lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366662.515341:0:5804:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000082beeec3/0x8da3486b955f3caf lrc: 1/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366662.515349:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000082beeec3/0x8da3486b955f3caf lrc: 0/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366662.515368:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789366662.515370:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789366662.515372:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789366662.515781:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96389077ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3285:1876286758780800:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1789366662.515902:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789366662.515910:0:6661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638bfef9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3284:x1876286758780672:12345-0@lo:6:osp-syn-1-0.0 Request processed in 945us (1401us total) trans 4294967307 rc 0/0 00000100:00100000:3.0:1789366662.515918:0:6661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1789366662.515941:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286758780800 00000100:00100000:3.0:1789366662.515946:0:6661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286758780800 00000100:00080000:1.0:1789366662.515973:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000004:00080000:0.0:1789366662.515987:0:3284:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9638bfef8000/2, rc 0, transno 4294967307 00000100:00100000:0.0:1789366662.515996:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9638bfef8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3284:1876286758780672:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1789366662.516041:0:6661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1789366662.516051:0:6661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638aef22a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3285:x1876286758780800:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1789366662.516232:0:6661:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:3.0:1789366662.516236:0:6661:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb mtime from disk: 0 -> 1789366662 00002000:00010000:3.0:1789366662.516239:0:6661:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1789366662.516241:0:6661:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb ctime from disk: 1789366662 -> 1789366662 00002000:00010000:3.0:1789366662.516243:0:6661:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:3.0:1789366662.516276:0:6661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638aef22a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3285:x1876286758780800:12345-0@lo:2:osp-syn-0-0.0 Request processed in 227us (376us total) trans 4294967315 rc 0/0 00000100:00100000:3.0:1789366662.516283:0:6661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000004:00080000:0.0:1789366662.516305:0:3285:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff96389077ed80/2, rc 0, transno 4294967315 00000100:00100000:0.0:1789366662.516313:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96389077ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3285:1876286758780800:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1789366662.517043:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:0.0:1789366662.517089:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751452544 00000100:00100000:0.0:1789366662.517095:0:6660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751452544 00000100:00100000:0.0:1789366662.517141:0:6660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 56 00000100:00100000:0.0:1789366662.517152:0:6660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638b7217100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0ab23baa-a205-44ad-bf17-f7b47295d82b+10:2357:x1876286751452544:12345-192.168.202.23@tcp:16:lhsmtool_posix.0 00000001:00080000:0.0:1789366662.549618:0:6685:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967314 is committed 00000100:00100000:1.0:1789366662.549642:0:6660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638b7217100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0ab23baa-a205-44ad-bf17-f7b47295d82b+8:2357:x1876286751452544:12345-192.168.202.23@tcp:16:lhsmtool_posix.0 Request processed in 32483us (32593us total) trans 0 rc 0/0 00000001:00080000:0.0:1789366662.549647:0:6685:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967315 is committed 00000100:00100000:1.0:1789366662.549658:0:6660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 56 00000100:00100000:3.0:1789366662.552375:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:2.0:1789366662.552521:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751452800 00000100:00100000:2.0:1789366662.552531:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751452800 00000100:00100000:2.0:1789366662.552595:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 183 00000100:00100000:2.0:1789366662.552607:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638a74c9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0ab23baa-a205-44ad-bf17-f7b47295d82b+19:11510:x1876286751452800:12345-192.168.202.23@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1789366662.552661:0:5816:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789366662.552689:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720d600/0x8da3486b955f3c9a lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.23@tcp remote: 0xda917a494d06c24b expref: 19 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366662.552708:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9638a7404700) 00010000:00010000:2.0:1789366662.552713:0:5816:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789366662.552764:0:5816:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9a00/0x8da3486b955f3cb6 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366662.552778:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9a00/0x8da3486b955f3cb6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366662.552788:0:5816:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9a00/0x8da3486b955f3cb6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789366662.553013:0:5816:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000b518738c reply state 000000009fd719af transno 4294967456 ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9a00/0x8da3486b955f3cb6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789366662.553024:0:5816:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789366662.553142:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638a74c9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0ab23baa-a205-44ad-bf17-f7b47295d82b+20:11510:x1876286751452800:12345-192.168.202.23@tcp:36:lhsmtool_posix.0 Request processed in 526us (762us total) trans 4294967456 rc 0/0 00000100:00100000:2.0:1789366662.553150:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 183 00010000:00010000:1.0:1789366662.556335:0:3271:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9a00/0x8da3486b955f3cb6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789366662.556458:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00010000:00010000:1.0:1789366662.556463:0:3271:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9a00/0x8da3486b955f3cb6 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366662.556473:0:3271:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9a00/0x8da3486b955f3cb6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366662.556480:0:3271:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9638902c9a00 already unused, calling callback (ffffffffc20ee4f0) 00010000:00010000:1.0:1789366662.556485:0:3271:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9a00/0x8da3486b955f3cb6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366662.556494:0:3271:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9a00/0x8da3486b955f3cb6 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366662.556510:0:3271:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9638a7404700) 00010000:00010000:1.0:1789366662.556514:0:3271:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789366662.556518:0:3271:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9a00/0x8da3486b955f3cb6 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366662.556539:0:3271:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9a00/0x8da3486b955f3cb6 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789366662.556548:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751452928 00000100:00100000:3.0:1789366662.556558:0:6659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751452928 00000100:00100000:3.0:1789366662.556617:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 57 00000100:00100000:3.0:1789366662.556627:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963882ee0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0ab23baa-a205-44ad-bf17-f7b47295d82b+7:2355:x1876286751452928:12345-192.168.202.23@tcp:2:lhsmtool_posix.0 00002000:00010000:3.0:1789366662.557051:0:6659:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:3.0:1789366662.557054:0:6659:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb mtime from disk: 1789366662 -> 1789366662 00002000:00010000:3.0:1789366662.557056:0:6659:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb atime from disk: 0 -> 1789366661 00002000:00010000:3.0:1789366662.557057:0:6659:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb ctime from disk: 1789366662 -> 1789366662 00002000:00010000:3.0:1789366662.557059:0:6659:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:3.0:1789366662.557104:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963882ee0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0ab23baa-a205-44ad-bf17-f7b47295d82b+8:2355:x1876286751452928:12345-192.168.202.23@tcp:2:lhsmtool_posix.0 Request processed in 478us (652us total) trans 4294967316 rc 0/0 00000100:00100000:3.0:1789366662.557108:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 57 00000100:00100000:1.0:1789366662.558595:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:2.0:1789366662.558754:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751453184 00000100:00100000:2.0:1789366662.558763:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751453184 00000100:00100000:2.0:1789366662.558813:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 184 00000100:00100000:2.0:1789366662.558833:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96389077fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0ab23baa-a205-44ad-bf17-f7b47295d82b+19:11510:x1876286751453184:12345-192.168.202.23@tcp:55:lhsmtool_posix.0 00010000:00010000:2.0:1789366662.558892:0:5815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9e00/0x8da3486b955f3cbd lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366662.558907:0:5815:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9000/0x8da3486b955f3c7e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.23@tcp remote: 0xda917a494d06c23d expref: 19 pid: 7614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366662.558918:0:5815:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9e00/0x8da3486b955f3cbd lrc: 4/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366662.558951:0:5815:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9000/0x8da3486b955f3c7e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.23@tcp remote: 0xda917a494d06c23d expref: 19 pid: 7614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366662.558967:0:5815:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9000/0x8da3486b955f3c7e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.23@tcp remote: 0xda917a494d06c23d expref: 19 pid: 7614 timeout: 338 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789366662.558981:0:5815:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff963882ee1c00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5815:1876286758780928:192.168.202.23@tcp:104: 00000100:00100000:2.0:1789366662.559052:0:5815:0:(client.c:2716:ptlrpc_set_wait()) set ffff9638900c6300 going to sleep for 11 seconds 00000100:00100000:2.0:1789366662.563044:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:0.0:1789366662.563204:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751453312 00000100:00100000:0.0:1789366662.563213:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751453312 00010000:00010000:0.0:1789366662.563251:0:5801:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9000/0x8da3486b955f3c7e lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.23@tcp remote: 0xda917a494d06c23d expref: 20 pid: 7614 timeout: 338 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789366662.563287:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 70 00000100:00100000:0.0:1789366662.563298:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963882ee0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0ab23baa-a205-44ad-bf17-f7b47295d82b+20:2355:x1876286751453312:12345-192.168.202.23@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789366662.563313:0:5801:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789366662.563320:0:5801:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9000/0x8da3486b955f3c7e lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.23@tcp remote: 0xda917a494d06c23d expref: 20 pid: 7614 timeout: 338 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366662.563334:0:5801:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9000/0x8da3486b955f3c7e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.23@tcp remote: 0xda917a494d06c23d expref: 20 pid: 7614 timeout: 338 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366662.563368:0:5801:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9638a7404700) 00010000:00010000:0.0:1789366662.563373:0:5801:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9e00/0x8da3486b955f3cbd lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366662.563382:0:5801:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9e00/0x8da3486b955f3cbd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366662.563390:0:5801:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9e00/0x8da3486b955f3cbd lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366662.563406:0:5801:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789366662.563452:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963882ee0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0ab23baa-a205-44ad-bf17-f7b47295d82b+20:2355:x1876286751453312:12345-192.168.202.23@tcp:103:ldlm_bl.0 Request processed in 156us (418us total) trans 0 rc 0/0 00000100:00100000:0.0:1789366662.563459:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 70 00010000:00010000:1.0:1789366662.566508:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9000/0x8da3486b955f3c7e lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.23@tcp remote: 0xda917a494d06c23d expref: 19 pid: 7614 timeout: 338 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789366662.566530:0:5815:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff963882ee1c00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5815:1876286758780928:192.168.202.23@tcp:104: 00010000:00010000:1.0:1789366662.566551:0:5815:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9e00/0x8da3486b955f3cbd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366662.566562:0:5815:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9e00/0x8da3486b955f3cbd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366662.566568:0:5815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9e00/0x8da3486b955f3cbd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366662.566596:0:5815:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9e00/0x8da3486b955f3cbd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366662.566602:0:5815:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9e00/0x8da3486b955f3cbd lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366662.566619:0:5815:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9e00/0x8da3486b955f3cbd lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366662.566626:0:5815:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9638902c9e00 already unused, calling callback (ffffffffc20ee4f0) 00010000:00010000:1.0:1789366662.566630:0:5815:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9e00/0x8da3486b955f3cbd lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366662.566649:0:5815:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9e00/0x8da3486b955f3cbd lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366662.566664:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9638a7404700) 00010000:00010000:1.0:1789366662.566667:0:5815:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:1.0:1789366662.566671:0:5815:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9e00/0x8da3486b955f3cbd lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366662.566677:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9e00/0x8da3486b955f3cbd lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789366662.566757:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96389077fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0ab23baa-a205-44ad-bf17-f7b47295d82b+18:11510:x1876286751453184:12345-192.168.202.23@tcp:55:lhsmtool_posix.0 Request processed in 7926us (8166us total) trans 0 rc -22/-22 00000100:00100000:1.0:1789366662.566767:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 184 00000100:00100000:3.0:1789366662.570089:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:1.0:1789366662.570122:0:8065:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751453440 00000100:00100000:1.0:1789366662.570143:0:8065:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751453440 00000100:00100000:1.0:1789366662.570197:0:8065:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 58 00000100:00100000:1.0:1789366662.570216:0:8065:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638b6cbe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0ab23baa-a205-44ad-bf17-f7b47295d82b+8:2354:x1876286751453440:12345-192.168.202.23@tcp:1:lhsmtool_posix.0 00010000:00010000:1.0:1789366662.570266:0:8065:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000d8dc1c1c/0x8da3486b955f3cc4 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366662.570288:0:8065:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000001e78ae4c/0x8da3486b955f3ca8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.23@tcp remote: 0xda917a494d06c259 expref: 8 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366662.570297:0:8065:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x5:0x0].0x0 since=1s v=(0 0) 00010000:00010000:1.0:1789366662.570303:0:8065:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789366662.570309:0:8065:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d8dc1c1c/0x8da3486b955f3cc4 lrc: 4/1,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366662.570425:0:8065:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000001e78ae4c/0x8da3486b955f3ca8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.23@tcp remote: 0xda917a494d06c259 expref: 8 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366662.570440:0:8065:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000001e78ae4c/0x8da3486b955f3ca8 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.23@tcp remote: 0xda917a494d06c259 expref: 8 pid: 6659 timeout: 338 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789366662.570456:0:8065:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9638b703b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8065:1876286758781056:192.168.202.23@tcp:104: 00000100:00100000:1.0:1789366662.570537:0:8065:0:(client.c:2716:ptlrpc_set_wait()) set ffff9638b72dc3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789366662.574526:0:8065:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9638b703b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8065:1876286758781056:192.168.202.23@tcp:104: 00010000:00010000:1.0:1789366662.574557:0:8065:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000d8dc1c1c/0x8da3486b955f3cc4 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789366662.574644:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:0.0:1789366662.574741:0:8419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751453568 00000100:00100000:0.0:1789366662.574748:0:8419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751453568 00010000:00010000:0.0:1789366662.574785:0:8419:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000001e78ae4c/0x8da3486b955f3ca8 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.23@tcp remote: 0xda917a494d06c259 expref: 9 pid: 6659 timeout: 338 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789366662.574828:0:8419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 71 00000100:00100000:0.0:1789366662.574839:0:8419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638b7036a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0ab23baa-a205-44ad-bf17-f7b47295d82b+9:2354:x1876286751453568:12345-192.168.202.23@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789366662.574856:0:8419:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789366662.574878:0:8419:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000001e78ae4c/0x8da3486b955f3ca8 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.23@tcp remote: 0xda917a494d06c259 expref: 9 pid: 6659 timeout: 338 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366662.574893:0:8419:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000001e78ae4c/0x8da3486b955f3ca8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.23@tcp remote: 0xda917a494d06c259 expref: 9 pid: 6659 timeout: 338 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366662.574931:0:8419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001e78ae4c/0x8da3486b955f3ca8 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.23@tcp remote: 0xda917a494d06c259 expref: 9 pid: 6659 timeout: 338 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366662.575172:0:8419:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789366662.575178:0:8419:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789366662.575185:0:8419:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000d8dc1c1c/0x8da3486b955f3cc4 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366662.575196:0:8419:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d8dc1c1c/0x8da3486b955f3cc4 lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366662.575230:0:8419:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789366662.575285:0:8419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638b7036a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0ab23baa-a205-44ad-bf17-f7b47295d82b+8:2354:x1876286751453568:12345-192.168.202.23@tcp:103:ldlm_bl.0 Request processed in 446us (642us total) trans 0 rc 0/0 00000100:00100000:0.0:1789366662.575305:0:8419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 71 00010000:00010000:1.0:1789366662.575425:0:8065:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000d8dc1c1c/0x8da3486b955f3cc4 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366662.575436:0:8065:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d8dc1c1c/0x8da3486b955f3cc4 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366662.575461:0:8065:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000d8dc1c1c/0x8da3486b955f3cc4 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366662.575471:0:8065:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d8dc1c1c/0x8da3486b955f3cc4 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366662.575491:0:8065:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d8dc1c1c/0x8da3486b955f3cc4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366662.575499:0:8065:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9638b6ce3400 already unused, calling callback (ffffffffc16df520) 00010000:00010000:1.0:1789366662.575504:0:8065:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d8dc1c1c/0x8da3486b955f3cc4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366662.575513:0:8065:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d8dc1c1c/0x8da3486b955f3cc4 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366662.575526:0:8065:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d8dc1c1c/0x8da3486b955f3cc4 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366662.575534:0:8065:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d8dc1c1c/0x8da3486b955f3cc4 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789366662.575591:0:8065:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638b6cbe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0ab23baa-a205-44ad-bf17-f7b47295d82b+7:2354:x1876286751453440:12345-192.168.202.23@tcp:1:lhsmtool_posix.0 Request processed in 5385us (5770us total) trans 0 rc 0/0 00000100:00100000:1.0:1789366662.575600:0:8065:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 58 00000100:00100000:3.0:1789366662.576859:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:0.0:1789366662.576910:0:7132:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751453824 00000100:00100000:0.0:1789366662.576917:0:7132:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751453824 00000100:00100000:0.0:1789366662.576964:0:7132:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 185 00000100:00100000:0.0:1789366662.576974:0:7132:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638b7037480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0ab23baa-a205-44ad-bf17-f7b47295d82b+18:11510:x1876286751453824:12345-192.168.202.23@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1789366662.577045:0:7132:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720c400/0x8da3486b955f3ccb lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366662.577061:0:7132:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720c400/0x8da3486b955f3ccb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366662.577073:0:7132:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720c400/0x8da3486b955f3ccb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366662.577298:0:7132:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720c000/0x8da3486b955f3cd2 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366662.577310:0:7132:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9638b6ce2a00/0x8da3486b955f3c8c lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.23@tcp remote: 0xda917a494d06c244 expref: 19 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366662.577317:0:7132:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720c000/0x8da3486b955f3cd2 lrc: 4/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366662.577352:0:7132:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9638b6ce2a00/0x8da3486b955f3c8c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.23@tcp remote: 0xda917a494d06c244 expref: 19 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366662.577365:0:7132:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9638b6ce2a00/0x8da3486b955f3c8c lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.23@tcp remote: 0xda917a494d06c244 expref: 19 pid: 5815 timeout: 338 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789366662.577378:0:7132:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9638aef23480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7132:1876286758781184:192.168.202.23@tcp:104: 00000100:00100000:0.0:1789366662.577451:0:7132:0:(client.c:2716:ptlrpc_set_wait()) set ffff9638af2e2cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1789366662.578777:0:7132:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9638aef23480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7132:1876286758781184:192.168.202.23@tcp:104: 00010000:00010000:0.0:1789366662.578800:0:7132:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720c000/0x8da3486b955f3cd2 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789366662.579219:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:3.0:1789366662.579257:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751453952 00000100:00100000:3.0:1789366662.579264:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751453952 00010000:00010000:3.0:1789366662.579296:0:5803:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9638b6ce2a00/0x8da3486b955f3c8c lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.23@tcp remote: 0xda917a494d06c244 expref: 20 pid: 5815 timeout: 338 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789366662.579331:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 72 00000100:00100000:3.0:1789366662.579341:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638aef23480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0ab23baa-a205-44ad-bf17-f7b47295d82b+20:2355:x1876286751453952:12345-192.168.202.23@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789366662.579353:0:5803:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789366662.579360:0:5803:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9638b6ce2a00/0x8da3486b955f3c8c lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.23@tcp remote: 0xda917a494d06c244 expref: 20 pid: 5815 timeout: 338 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366662.579373:0:5803:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9638b6ce2a00/0x8da3486b955f3c8c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.23@tcp remote: 0xda917a494d06c244 expref: 20 pid: 5815 timeout: 338 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366662.579393:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9638b6ce2a00/0x8da3486b955f3c8c lrc: 0/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.23@tcp remote: 0xda917a494d06c244 expref: 20 pid: 5815 timeout: 338 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366662.579406:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9638a7404700) 00010000:00010000:3.0:1789366662.579421:0:5803:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720c000/0x8da3486b955f3cd2 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366662.579429:0:5803:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720c000/0x8da3486b955f3cd2 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366662.579435:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720c000/0x8da3486b955f3cd2 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366662.579457:0:5803:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789366662.579479:0:7132:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720c000/0x8da3486b955f3cd2 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366662.579489:0:7132:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720c000/0x8da3486b955f3cd2 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789366662.579511:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638aef23480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0ab23baa-a205-44ad-bf17-f7b47295d82b+19:2355:x1876286751453952:12345-192.168.202.23@tcp:103:ldlm_bl.0 Request processed in 171us (293us total) trans 0 rc 0/0 00000100:00100000:3.0:1789366662.579527:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 72 00000001:00080000:0.0:1789366662.579696:0:7132:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967457 00000001:00080000:0.0:1789366662.579864:0:7132:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967458 00000001:00080000:0.0:1789366662.579924:0:7132:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967459 00000100:00100000:0.0:1789366662.580004:0:7132:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9638aef20000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:7132:1876286758781312:0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1789366662.580048:0:7132:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789366662.580083:0:7132:0:(client.c:2716:ptlrpc_set_wait()) set ffff9638af2e2540 going to sleep for 11 seconds 00000100:00100000:2.0:1789366662.580420:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286758781312 00000100:00100000:2.0:1789366662.580426:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286758781312 00000100:00100000:2.0:1789366662.580464:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1789366662.580473:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638aef21f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:7132:x1876286758781312:12345-0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1789366662.580560:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638aef21f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:7132:x1876286758781312:12345-0@lo:1000:mdt00_003.0 Request processed in 89us (512us total) trans 0 rc 0/0 00000100:00100000:2.0:1789366662.580568:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1789366662.580669:0:7132:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967315 gen 2 00000004:00080000:0.0:1789366662.580676:0:7132:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff96389077ed80, transno 4294967315 00000100:00100000:0.0:1789366662.580693:0:7132:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9638aef20000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:7132:1876286758781312:0@lo:1000:mdt00_003.0 00000001:00080000:0.0:1789366662.581219:0:7132:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967460 00000100:00100000:0.0:1789366662.581273:0:7132:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9638aef20000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:7132:1876286758781440:0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1789366662.581308:0:7132:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789366662.581335:0:7132:0:(client.c:2716:ptlrpc_set_wait()) set ffff9638af2e2cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1789366662.581353:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286758781440 00000100:00100000:3.0:1789366662.581360:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286758781440 00000100:00100000:3.0:1789366662.581399:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1789366662.581419:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638aef23b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:7132:x1876286758781440:12345-0@lo:1000:mdt00_003.0 00000100:00100000:3.0:1789366662.581631:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638aef23b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:7132:x1876286758781440:12345-0@lo:1000:mdt00_003.0 Request processed in 224us (323us total) trans 4294967317 rc 0/0 00000100:00100000:3.0:1789366662.581638:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1789366662.581715:0:7132:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9638aef20000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:7132:1876286758781440:0@lo:1000:mdt00_003.0 00010000:00010000:0.0:1789366662.581764:0:7132:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720c000/0x8da3486b955f3cd2 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366662.581775:0:7132:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720c000/0x8da3486b955f3cd2 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366662.581783:0:7132:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720c000/0x8da3486b955f3cd2 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366662.581793:0:7132:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9638b720c000 already unused, calling callback (ffffffffc20ee4f0) 00010000:00010000:0.0:1789366662.581799:0:7132:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720c000/0x8da3486b955f3cd2 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366662.581809:0:7132:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720c000/0x8da3486b955f3cd2 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366662.581830:0:7132:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9638a7404700) 00010000:00010000:0.0:1789366662.581833:0:7132:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1789366662.581839:0:7132:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720c000/0x8da3486b955f3cd2 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366662.581844:0:7132:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720c000/0x8da3486b955f3cd2 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366662.581873:0:7132:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9638832d3400/0x8da3486b955f3c07 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7614 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366662.581879:0:7132:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9638832d3400/0x8da3486b955f3c07 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7614 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366662.581885:0:7132:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9638832d3400/0x8da3486b955f3c07 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7614 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366662.581890:0:7132:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9638832d3400 already unused, calling callback (ffffffffc20ee4f0) 00010000:00010000:0.0:1789366662.581892:0:7132:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9638832d3400/0x8da3486b955f3c07 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7614 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366662.581898:0:7132:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9638832d3400/0x8da3486b955f3c07 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7614 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366662.581907:0:7132:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff96388c43fb00) 00010000:00010000:0.0:1789366662.581910:0:7132:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1789366662.581913:0:7132:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9638832d3400/0x8da3486b955f3c07 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7614 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366662.581919:0:7132:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9638832d3400/0x8da3486b955f3c07 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7614 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366662.581951:0:7132:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720dc00/0x8da3486b955f3cd9 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366662.581964:0:7132:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c8e00/0x8da3486b955f3c23 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.23@tcp remote: 0xda917a494d06c228 expref: 22 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366662.581974:0:7132:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720dc00/0x8da3486b955f3cd9 lrc: 4/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366662.582000:0:7132:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c8e00/0x8da3486b955f3c23 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.23@tcp remote: 0xda917a494d06c228 expref: 22 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366662.582014:0:7132:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c8e00/0x8da3486b955f3c23 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.23@tcp remote: 0xda917a494d06c228 expref: 22 pid: 5815 timeout: 338 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789366662.582026:0:7132:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9638aef21880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7132:1876286758781568:192.168.202.23@tcp:104: 00000100:00100000:0.0:1789366662.582100:0:7132:0:(client.c:2716:ptlrpc_set_wait()) set ffff9638af2e2cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1789366662.584113:0:7132:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9638aef21880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7132:1876286758781568:192.168.202.23@tcp:104: 00010000:00010000:0.0:1789366662.584147:0:7132:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720dc00/0x8da3486b955f3cd9 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789366662.584361:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:3.0:1789366662.584555:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751454080 00000100:00100000:3.0:1789366662.584572:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751454080 00010000:00010000:3.0:1789366662.584606:0:5802:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c8e00/0x8da3486b955f3c23 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.23@tcp remote: 0xda917a494d06c228 expref: 23 pid: 5815 timeout: 338 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789366662.584646:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 73 00000100:00100000:3.0:1789366662.584657:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638b703b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0ab23baa-a205-44ad-bf17-f7b47295d82b+23:2355:x1876286751454080:12345-192.168.202.23@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789366662.584670:0:5802:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789366662.584678:0:5802:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c8e00/0x8da3486b955f3c23 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.23@tcp remote: 0xda917a494d06c228 expref: 23 pid: 5815 timeout: 338 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366662.584692:0:5802:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c8e00/0x8da3486b955f3c23 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.23@tcp remote: 0xda917a494d06c228 expref: 23 pid: 5815 timeout: 338 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366662.584713:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c8e00/0x8da3486b955f3c23 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.23@tcp remote: 0xda917a494d06c228 expref: 23 pid: 5815 timeout: 338 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366662.584784:0:5802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff96388c43fb00) 00010000:00010000:3.0:1789366662.584797:0:5802:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720dc00/0x8da3486b955f3cd9 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366662.584807:0:5802:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720dc00/0x8da3486b955f3cd9 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366662.584826:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720dc00/0x8da3486b955f3cd9 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366662.584850:0:5802:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789366662.584873:0:7132:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720dc00/0x8da3486b955f3cd9 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366662.584883:0:7132:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720dc00/0x8da3486b955f3cd9 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366662.584896:0:7132:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720dc00/0x8da3486b955f3cd9 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789366662.584901:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638b703b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0ab23baa-a205-44ad-bf17-f7b47295d82b+22:2355:x1876286751454080:12345-192.168.202.23@tcp:103:ldlm_bl.0 Request processed in 246us (540us total) trans 0 rc 0/0 00010000:00010000:0.0:1789366662.584912:0:7132:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720dc00/0x8da3486b955f3cd9 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789366662.584926:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 73 00010000:00010000:0.0:1789366662.584926:0:7132:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720dc00/0x8da3486b955f3cd9 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366662.584935:0:7132:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9638b720dc00 already unused, calling callback (ffffffffc20ee4f0) 00010000:00010000:0.0:1789366662.584940:0:7132:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720dc00/0x8da3486b955f3cd9 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366662.584949:0:7132:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720dc00/0x8da3486b955f3cd9 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366662.584960:0:7132:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff96388c43fb00) 00010000:00010000:0.0:1789366662.584963:0:7132:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789366662.584968:0:7132:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720dc00/0x8da3486b955f3cd9 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366662.584975:0:7132:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720dc00/0x8da3486b955f3cd9 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366662.584987:0:7132:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720c400/0x8da3486b955f3ccb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366662.584993:0:7132:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720c400/0x8da3486b955f3ccb lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366662.584999:0:7132:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720c400/0x8da3486b955f3ccb lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366662.585005:0:7132:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9638b720c400 already unused, calling callback (ffffffffc20ee4f0) 00010000:00010000:0.0:1789366662.585013:0:7132:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720c400/0x8da3486b955f3ccb lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366662.585020:0:7132:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720c400/0x8da3486b955f3ccb lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366662.585028:0:7132:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff96388c43fb00) 00010000:00010000:0.0:1789366662.585031:0:7132:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1789366662.585033:0:7132:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720c400/0x8da3486b955f3ccb lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366662.585039:0:7132:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720c400/0x8da3486b955f3ccb lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789366662.585260:0:7132:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638b7037480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0ab23baa-a205-44ad-bf17-f7b47295d82b+21:11510:x1876286751453824:12345-192.168.202.23@tcp:57:lhsmtool_posix.0 Request processed in 8286us (8402us total) trans 4294967461 rc 0/0 00000100:00100000:0.0:1789366662.585269:0:7132:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 185 00000020:00080000:0.0:1789366662.585274:0:7132:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:0.0:1789366662.585529:0:11650:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1789366662.585607:0:11650:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1789366662.586200:0:11650:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:0.0:1789366662.586210:0:11650:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1789366662.587935:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:0.0:1789366662.587979:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751454336 00000100:00100000:0.0:1789366662.587988:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751454336 00000100:00100000:0.0:1789366662.588077:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 47 00000100:00100000:0.0:1789366662.588091:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638b7038000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0ab23baa-a205-44ad-bf17-f7b47295d82b+21:11510:x1876286751454336:12345-192.168.202.23@tcp:35:lhsmtool_posix.0 00000004:00080000:0.0:1789366662.588831:0:5819:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0xd:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:0.0:1789366662.588957:0:5819:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967462 00010000:00010000:0.0:1789366662.589012:0:5819:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720d000/0x8da3486b955f3ce0 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366662.589037:0:5819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720d000/0x8da3486b955f3ce0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366662.589048:0:5819:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720d000/0x8da3486b955f3ce0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366662.589057:0:5819:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720d000/0x8da3486b955f3ce0 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366662.589063:0:5819:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720d000/0x8da3486b955f3ce0 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366662.589069:0:5819:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720d000/0x8da3486b955f3ce0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366662.589085:0:5819:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1789366662.589174:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638b7038000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0ab23baa-a205-44ad-bf17-f7b47295d82b+23:11510:x1876286751454336:12345-192.168.202.23@tcp:35:lhsmtool_posix.0 Request processed in 1086us (1240us total) trans 4294967463 rc 0/0 00000100:00100000:0.0:1789366662.589182:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 47 00000020:00080000:0.0:1789366662.589187:0:5819:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1789366662.589996:0:6675:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789366662.590004:0:6675:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720d000/0x8da3486b955f3ce0 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366662.590012:0:6675:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9638b720d000 already unused, calling callback (ffffffffc16df520) 00010000:00010000:0.0:1789366662.590016:0:6675:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720d000/0x8da3486b955f3ce0 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366662.590025:0:6675:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720d000/0x8da3486b955f3ce0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366662.590049:0:6675:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff963890797300) 00010000:00010000:0.0:1789366662.590052:0:6675:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1789366662.590057:0:6675:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720d000/0x8da3486b955f3ce0 lrc: 1/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366662.590063:0:6675:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720d000/0x8da3486b955f3ce0 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366662.590076:0:6675:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789366662.590078:0:6675:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789366662.590079:0:6675:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1789366662.783605:0:12465:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1789366662.783614:0:12465:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1789366662.783651:0:12465:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 4 00000040:00080000:3.0:1789366662.783656:0:12465:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1789366662.841098:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:2.0:1789366662.841157:0:7614:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751454464 00000100:00100000:2.0:1789366662.841168:0:7614:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751454464 00000100:00100000:2.0:1789366662.841237:0:7614:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 186 00000100:00100000:2.0:1789366662.841257:0:7614:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638aef21880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0ab23baa-a205-44ad-bf17-f7b47295d82b+23:11520:x1876286751454464:12345-192.168.202.23@tcp:34:lfs.0 00010000:00010000:2.0:1789366662.841327:0:7614:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c8200/0x8da3486b955f3ce7 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7614 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366662.841345:0:7614:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c8200/0x8da3486b955f3ce7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7614 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366662.841357:0:7614:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c8200/0x8da3486b955f3ce7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7614 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366662.841371:0:7614:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9800/0x8da3486b955f3cee lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7614 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366662.841378:0:7614:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9800/0x8da3486b955f3cee lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7614 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366662.841385:0:7614:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9800/0x8da3486b955f3cee lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7614 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366662.841771:0:7614:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9600/0x8da3486b955f3cf5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7614 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366662.841780:0:7614:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9600/0x8da3486b955f3cf5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7614 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366662.841788:0:7614:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9600/0x8da3486b955f3cf5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7614 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789366662.841826:0:7614:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9600/0x8da3486b955f3cf5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7614 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366662.841838:0:7614:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c8200/0x8da3486b955f3ce7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7614 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366662.841851:0:7614:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c8200/0x8da3486b955f3ce7 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7614 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366662.841858:0:7614:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c8200/0x8da3486b955f3ce7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7614 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366662.841865:0:7614:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9638902c8200 already unused, calling callback (ffffffffc20ee4f0) 00010000:00010000:2.0:1789366662.841869:0:7614:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c8200/0x8da3486b955f3ce7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7614 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366662.841877:0:7614:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c8200/0x8da3486b955f3ce7 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7614 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366662.841890:0:7614:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff963890797800) 00010000:00010000:2.0:1789366662.841892:0:7614:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789366662.841898:0:7614:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c8200/0x8da3486b955f3ce7 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7614 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366662.841904:0:7614:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c8200/0x8da3486b955f3ce7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7614 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366662.841915:0:7614:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9800/0x8da3486b955f3cee lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7614 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366662.841921:0:7614:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9800/0x8da3486b955f3cee lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7614 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366662.841927:0:7614:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9800/0x8da3486b955f3cee lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7614 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366662.841931:0:7614:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9638902c9800 already unused, calling callback (ffffffffc20ee4f0) 00010000:00010000:2.0:1789366662.841939:0:7614:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9800/0x8da3486b955f3cee lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7614 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366662.841946:0:7614:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9800/0x8da3486b955f3cee lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7614 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366662.841953:0:7614:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9638a7404400) 00010000:00010000:2.0:1789366662.841955:0:7614:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789366662.841958:0:7614:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9800/0x8da3486b955f3cee lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7614 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366662.841963:0:7614:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9800/0x8da3486b955f3cee lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7614 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366662.842136:0:7614:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9600/0x8da3486b955f3cf5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7614 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366662.842143:0:7614:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9600/0x8da3486b955f3cf5 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7614 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366662.842148:0:7614:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9600/0x8da3486b955f3cf5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7614 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366662.842153:0:7614:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9638902c9600 already unused, calling callback (ffffffffc20ee4f0) 00010000:00010000:2.0:1789366662.842156:0:7614:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9600/0x8da3486b955f3cf5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7614 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366662.842162:0:7614:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9600/0x8da3486b955f3cf5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7614 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366662.842170:0:7614:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9638a7404700) 00010000:00010000:2.0:1789366662.842173:0:7614:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789366662.842182:0:7614:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9600/0x8da3486b955f3cf5 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7614 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366662.842188:0:7614:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9600/0x8da3486b955f3cf5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7614 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789366662.842305:0:7614:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638aef21880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0ab23baa-a205-44ad-bf17-f7b47295d82b+23:11520:x1876286751454464:12345-192.168.202.23@tcp:34:lfs.0 Request processed in 1049us (1213us total) trans 0 rc 0/0 00000100:00100000:2.0:1789366662.842313:0:7614:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 186 00000100:00100000:3.0:1789366662.860327:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:3.0:1789366662.860383:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:1.0:1789366662.860534:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751454592 00000100:00100000:1.0:1789366662.860545:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751454592 00000100:00100000:1.0:1789366662.860595:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 277 00000100:00100000:1.0:1789366662.860604:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638b4e81c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:14a2847b-91d8-4d87-b71b-010443acc91a+13:2355:x1876286751454592:12345-192.168.202.23@tcp:400:kworker.0 00000100:00100000:1.0:1789366662.860681:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638b4e81c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:14a2847b-91d8-4d87-b71b-010443acc91a+13:2355:x1876286751454592:12345-192.168.202.23@tcp:400:kworker.0 Request processed in 78us (296us total) trans 0 rc 0/0 00000100:00100000:1.0:1789366662.860690:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 277 00000100:00100000:3.0:1789366662.861016:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:3.0:1789366662.861050:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751454848 00000100:00100000:3.0:1789366662.861055:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751454848 00000100:00100000:3.0:1789366662.861100:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 117 00000100:00100000:3.0:1789366662.861109:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638b7035f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b9764435-e52f-45ac-a5f9-bab1231105ac+5:2355:x1876286751454848:12345-192.168.202.23@tcp:400:kworker.0 00000100:00100000:3.0:1789366662.861219:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638b7035f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b9764435-e52f-45ac-a5f9-bab1231105ac+5:2355:x1876286751454848:12345-192.168.202.23@tcp:400:kworker.0 Request processed in 110us (203us total) trans 0 rc 0/0 00000100:00100000:3.0:1789366662.861227:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 117 00000100:00100000:2.0:1789366662.861812:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751454720 00000100:00100000:2.0:1789366662.861819:0:6661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751454720 00000100:00100000:2.0:1789366662.861856:0:6661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 58 00000100:00100000:2.0:1789366662.861865:0:6661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638b7034000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0ab23baa-a205-44ad-bf17-f7b47295d82b+5:2354:x1876286751454720:12345-192.168.202.23@tcp:400:kworker.0 00000100:00100000:2.0:1789366662.861902:0:6661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638b7034000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0ab23baa-a205-44ad-bf17-f7b47295d82b+5:2354:x1876286751454720:12345-192.168.202.23@tcp:400:kworker.0 Request processed in 38us (1584us total) trans 0 rc 0/0 00000100:00100000:2.0:1789366662.861909:0:6661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 58 00000100:00100000:3.0:1789366662.868593:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:0.0:1789366662.868647:0:7132:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751455104 00000100:00100000:0.0:1789366662.868657:0:7132:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751455104 00000100:00100000:0.0:1789366662.868742:0:7132:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 187 00000100:00100000:0.0:1789366662.868754:0:7132:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638b7037b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0ab23baa-a205-44ad-bf17-f7b47295d82b+23:11523:x1876286751455104:12345-192.168.202.23@tcp:101:lfs.0 00010000:00010000:0.0:1789366662.868774:0:7132:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789366662.868793:0:7132:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720c400/0x8da3486b955f3cfc lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xda917a494d06c260 expref: -99 pid: 7132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366662.868858:0:7132:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720dc00/0x8da3486b955f3d03 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366662.868871:0:7132:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720dc00/0x8da3486b955f3d03 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366662.868882:0:7132:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720dc00/0x8da3486b955f3d03 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366662.868896:0:7132:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720ca00/0x8da3486b955f3d0a lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366662.868910:0:7132:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720ca00/0x8da3486b955f3d0a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366662.868918:0:7132:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720ca00/0x8da3486b955f3d0a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366662.869173:0:7132:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720cc00/0x8da3486b955f3d11 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366662.869182:0:7132:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720cc00/0x8da3486b955f3d11 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366662.869189:0:7132:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720cc00/0x8da3486b955f3d11 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789366662.869199:0:7132:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 9 00010000:00010000:0.0:1789366662.869288:0:7132:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720dc00/0x8da3486b955f3d03 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366662.869296:0:7132:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720dc00/0x8da3486b955f3d03 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366662.869303:0:7132:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720dc00/0x8da3486b955f3d03 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366662.869309:0:7132:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9638b720dc00 already unused, calling callback (ffffffffc20ee4f0) 00010000:00010000:0.0:1789366662.869313:0:7132:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720dc00/0x8da3486b955f3d03 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366662.869321:0:7132:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720dc00/0x8da3486b955f3d03 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366662.869343:0:7132:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff963890797800) 00010000:00010000:0.0:1789366662.869346:0:7132:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789366662.869351:0:7132:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720dc00/0x8da3486b955f3d03 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366662.869357:0:7132:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720dc00/0x8da3486b955f3d03 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366662.869368:0:7132:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720ca00/0x8da3486b955f3d0a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366662.869375:0:7132:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720ca00/0x8da3486b955f3d0a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366662.869381:0:7132:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720ca00/0x8da3486b955f3d0a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366662.869405:0:7132:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9638b720ca00 already unused, calling callback (ffffffffc20ee4f0) 00010000:00010000:0.0:1789366662.869407:0:7132:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720ca00/0x8da3486b955f3d0a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366662.869414:0:7132:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720ca00/0x8da3486b955f3d0a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366662.869423:0:7132:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff963890797300) 00010000:00010000:0.0:1789366662.869425:0:7132:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789366662.869429:0:7132:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720ca00/0x8da3486b955f3d0a lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366662.869435:0:7132:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720ca00/0x8da3486b955f3d0a lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366662.869486:0:7132:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720c400/0x8da3486b955f3cfc lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.23@tcp remote: 0xda917a494d06c260 expref: 26 pid: 7132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366662.869501:0:7132:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720cc00/0x8da3486b955f3d11 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.23@tcp remote: 0xda917a494d06c260 expref: 25 pid: 7132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366662.869508:0:7132:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff963890797500) 00010000:00010000:0.0:1789366662.869511:0:7132:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789366662.869513:0:7132:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9638b720cc00, rc 0) 00000100:00100000:0.0:1789366662.869581:0:7132:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638b7037b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0ab23baa-a205-44ad-bf17-f7b47295d82b+25:11523:x1876286751455104:12345-192.168.202.23@tcp:101:lfs.0 Request processed in 828us (992us total) trans 4294967464 rc 0/0 00000100:00100000:0.0:1789366662.869589:0:7132:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 187 00000100:00100000:1.0:1789366662.872113:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:3.0:1789366662.872167:0:7614:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751455232 00000100:00100000:3.0:1789366662.872180:0:7614:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751455232 00000100:00100000:3.0:1789366662.872224:0:7614:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 188 00000100:00100000:3.0:1789366662.872231:0:7614:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638b7039f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0ab23baa-a205-44ad-bf17-f7b47295d82b+25:11523:x1876286751455232:12345-192.168.202.23@tcp:54:lfs.0 00010000:00010000:3.0:1789366662.872277:0:7614:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9638832d3c00/0x8da3486b955f3d1f lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7614 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366662.872288:0:7614:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9638832d3c00/0x8da3486b955f3d1f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7614 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366662.872297:0:7614:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9638832d3c00/0x8da3486b955f3d1f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7614 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366662.872314:0:7614:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9638832d3c00/0x8da3486b955f3d1f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7614 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366662.872318:0:7614:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9638832d3c00/0x8da3486b955f3d1f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7614 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366662.872323:0:7614:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9638832d3c00/0x8da3486b955f3d1f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7614 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366662.872327:0:7614:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9638832d3c00 already unused, calling callback (ffffffffc20ee4f0) 00010000:00010000:3.0:1789366662.872330:0:7614:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9638832d3c00/0x8da3486b955f3d1f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7614 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366662.872334:0:7614:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9638832d3c00/0x8da3486b955f3d1f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7614 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366662.872341:0:7614:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff963890797500) 00010000:00010000:3.0:1789366662.872343:0:7614:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789366662.872346:0:7614:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9638832d3c00/0x8da3486b955f3d1f lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7614 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366662.872360:0:7614:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9638832d3c00/0x8da3486b955f3d1f lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7614 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789366662.872436:0:7614:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638b7039f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0ab23baa-a205-44ad-bf17-f7b47295d82b+25:11523:x1876286751455232:12345-192.168.202.23@tcp:54:lfs.0 Request processed in 205us (331us total) trans 0 rc 0/0 00000100:00100000:3.0:1789366662.872442:0:7614:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 188 00000100:00100000:1.0:1789366662.873839:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:3.0:1789366662.874016:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751455488 00000100:00100000:3.0:1789366662.874022:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751455488 00000100:00100000:3.0:1789366662.874058:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 48 00000100:00100000:3.0:1789366662.874066:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638b703bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0ab23baa-a205-44ad-bf17-f7b47295d82b+25:11523:x1876286751455488:12345-192.168.202.23@tcp:35:lfs.0 00000100:00100000:3.0:1789366662.874234:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638b703bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0ab23baa-a205-44ad-bf17-f7b47295d82b+26:11523:x1876286751455488:12345-192.168.202.23@tcp:35:lfs.0 Request processed in 168us (398us total) trans 4294967465 rc 0/0 00000100:00100000:3.0:1789366662.874240:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 48 00000100:00100000:0.0:1789366662.893912:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:1.0:1789366662.894866:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751455744 00000100:00100000:1.0:1789366662.894878:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751455744 00000100:00100000:1.0:1789366662.894939:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 189 00000100:00100000:1.0:1789366662.894950:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638aef20700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0ab23baa-a205-44ad-bf17-f7b47295d82b+26:11057:x1876286751455744:12345-192.168.202.23@tcp:101:bash.0 00010000:00010000:1.0:1789366662.894974:0:5816:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789366662.894996:0:5816:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9638b6ce3800/0x8da3486b955f3d26 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xda917a494d06c267 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366662.895095:0:5816:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9638b6ce2400/0x8da3486b955f3d2d lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366662.895110:0:5816:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720cc00/0x8da3486b955f3d11 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.23@tcp remote: 0xda917a494d06c260 expref: 27 pid: 7132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366662.895119:0:5816:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9638b6ce2400/0x8da3486b955f3d2d lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366662.895163:0:5816:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720cc00/0x8da3486b955f3d11 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.23@tcp remote: 0xda917a494d06c260 expref: 27 pid: 7132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366662.895177:0:5816:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720cc00/0x8da3486b955f3d11 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.23@tcp remote: 0xda917a494d06c260 expref: 27 pid: 7132 timeout: 338 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789366662.895206:0:5816:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9638b7039880 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5816:1876286758781696:192.168.202.23@tcp:104: 00000100:00100000:1.0:1789366662.895288:0:5816:0:(client.c:2716:ptlrpc_set_wait()) set ffff96388347a240 going to sleep for 11 seconds 00000100:00100000:1.0:1789366662.899504:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:0.0:1789366662.902021:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751455872 00000100:00100000:0.0:1789366662.902033:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751455872 00010000:00010000:0.0:1789366662.902074:0:5801:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720cc00/0x8da3486b955f3d11 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.23@tcp remote: 0xda917a494d06c260 expref: 28 pid: 7132 timeout: 338 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789366662.902122:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 74 00000100:00100000:0.0:1789366662.902142:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638b7038700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0ab23baa-a205-44ad-bf17-f7b47295d82b+28:2354:x1876286751455872:12345-192.168.202.23@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789366662.902157:0:5801:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789366662.902165:0:5801:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720cc00/0x8da3486b955f3d11 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.23@tcp remote: 0xda917a494d06c260 expref: 28 pid: 7132 timeout: 338 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366662.902178:0:5801:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720cc00/0x8da3486b955f3d11 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.23@tcp remote: 0xda917a494d06c260 expref: 28 pid: 7132 timeout: 338 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366662.902216:0:5801:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff963890797500) 00010000:00010000:0.0:1789366662.902222:0:5801:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9638b6ce2400/0x8da3486b955f3d2d lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366662.902232:0:5801:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9638b6ce2400/0x8da3486b955f3d2d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366662.902240:0:5801:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9638b6ce2400/0x8da3486b955f3d2d lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366662.902259:0:5801:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789366662.902315:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638b7038700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0ab23baa-a205-44ad-bf17-f7b47295d82b+28:2354:x1876286751455872:12345-192.168.202.23@tcp:103:ldlm_bl.0 Request processed in 175us (2816us total) trans 0 rc 0/0 00000100:00100000:0.0:1789366662.902323:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 74 00010000:00010000:0.0:1789366662.902465:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720cc00/0x8da3486b955f3d11 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.23@tcp remote: 0xda917a494d06c260 expref: 27 pid: 7132 timeout: 338 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789366662.902481:0:5816:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9638b7039880 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5816:1876286758781696:192.168.202.23@tcp:104: 00010000:00010000:0.0:1789366662.902500:0:5816:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9638b6ce2400/0x8da3486b955f3d2d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366662.902509:0:5816:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9638b6ce2400/0x8da3486b955f3d2d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366662.902515:0:5816:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9638b6ce2400/0x8da3486b955f3d2d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789366662.902532:0:5816:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 9 00010000:00010000:0.0:1789366662.902679:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9638b6ce3800/0x8da3486b955f3d26 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.23@tcp remote: 0xda917a494d06c267 expref: 28 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366662.902694:0:5816:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9638b6ce2400/0x8da3486b955f3d2d lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.23@tcp remote: 0xda917a494d06c267 expref: 27 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366662.902702:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff963890797500) 00010000:00010000:0.0:1789366662.902705:0:5816:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1789366662.902708:0:5816:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9638b6ce2400, rc 0) 00000100:00100000:0.0:1789366662.902808:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638aef20700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0ab23baa-a205-44ad-bf17-f7b47295d82b+27:11057:x1876286751455744:12345-192.168.202.23@tcp:101:bash.0 Request processed in 7860us (8904us total) trans 4294967466 rc 0/0 00000100:00100000:0.0:1789366662.902814:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 189 00000100:00100000:1.0:1789366662.907988:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:0.0:1789366662.908049:0:7132:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751456128 00000100:00100000:0.0:1789366662.908059:0:7132:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751456128 00000100:00100000:0.0:1789366662.908115:0:7132:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 190 00000100:00100000:0.0:1789366662.908134:0:7132:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638b703ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0ab23baa-a205-44ad-bf17-f7b47295d82b+27:11057:x1876286751456128:12345-192.168.202.23@tcp:36:bash.0 00010000:00010000:0.0:1789366662.908390:0:7132:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720dc00/0x8da3486b955f3d3b lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366662.908408:0:7132:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720dc00/0x8da3486b955f3d3b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366662.908420:0:7132:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720dc00/0x8da3486b955f3d3b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789366662.908466:0:7132:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967467 00000004:00010000:0.0:1789366662.908490:0:7132:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000068a0d196 reply state 00000000b69aac99 transno 4294967468 ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720dc00/0x8da3486b955f3d3b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789366662.908500:0:7132:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:0.0:1789366662.908563:0:7132:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967468 00000100:00100000:0.0:1789366662.908655:0:7132:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638b703ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0ab23baa-a205-44ad-bf17-f7b47295d82b+31:11057:x1876286751456128:12345-192.168.202.23@tcp:36:bash.0 Request processed in 531us (675us total) trans 4294967469 rc 0/0 00000100:00100000:0.0:1789366662.908662:0:7132:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 190 00000020:00080000:0.0:1789366662.908667:0:7132:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:1.0:1789366662.911963:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00010000:00010000:3.0:1789366662.915254:0:3270:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720dc00/0x8da3486b955f3d3b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366662.915272:0:3270:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720dc00/0x8da3486b955f3d3b lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366662.915280:0:3270:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720dc00/0x8da3486b955f3d3b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366662.915287:0:3270:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9638b720dc00 already unused, calling callback (ffffffffc20ee4f0) 00010000:00010000:3.0:1789366662.915292:0:3270:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720dc00/0x8da3486b955f3d3b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366662.915300:0:3270:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720dc00/0x8da3486b955f3d3b lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366662.915337:0:3270:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff963890797500) 00010000:00010000:3.0:1789366662.915340:0:3270:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789366662.915345:0:3270:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720dc00/0x8da3486b955f3d3b lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366662.915352:0:3270:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720dc00/0x8da3486b955f3d3b lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789366662.915388:0:7614:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751456256 00000100:00100000:3.0:1789366662.915398:0:7614:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751456256 00000100:00100000:3.0:1789366662.915462:0:7614:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 191 00000100:00100000:3.0:1789366662.915472:0:7614:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638b7038a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0ab23baa-a205-44ad-bf17-f7b47295d82b+30:11057:x1876286751456256:12345-192.168.202.23@tcp:101:bash.0 00010000:00010000:3.0:1789366662.915493:0:7614:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789366662.915510:0:7614:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9638832d3c00/0x8da3486b955f3d42 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xda917a494d06c26e expref: -99 pid: 7614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366662.915569:0:7614:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9638832d3c00/0x8da3486b955f3d42 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.23@tcp remote: 0xda917a494d06c26e expref: 31 pid: 7614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366662.915582:0:7614:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9638832d3c00/0x8da3486b955f3d42 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.23@tcp remote: 0xda917a494d06c26e expref: 31 pid: 7614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366662.915600:0:7614:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff963890797500) 00010000:00010000:3.0:1789366662.915603:0:7614:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1789366662.915606:0:7614:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9638832d3c00, rc 0) 00000100:00100000:3.0:1789366662.915666:0:7614:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638b7038a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0ab23baa-a205-44ad-bf17-f7b47295d82b+31:11057:x1876286751456256:12345-192.168.202.23@tcp:101:bash.0 Request processed in 196us (3712us total) trans 0 rc 0/0 00000100:00100000:3.0:1789366662.915673:0:7614:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 191 00000100:00100000:0.0:1789366662.917857:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:3.0:1789366662.917917:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751456384 00000100:00100000:3.0:1789366662.917924:0:6660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751456384 00000100:00100000:3.0:1789366662.917962:0:6660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 59 00000100:00100000:3.0:1789366662.917968:0:6660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638aef22d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0ab23baa-a205-44ad-bf17-f7b47295d82b+7:11057:x1876286751456384:12345-192.168.202.23@tcp:101:bash.0 00010000:00010000:3.0:1789366662.917980:0:6660:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789366662.917994:0:6660:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000082beeec3/0x8da3486b955f3d49 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda917a494d06c275 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789366662.918012:0:6660:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 9, mtime: 0x6aa79186, atime: 0x6aa79185, ctime: 0x6aa79186, blocks: 0xb 00010000:00010000:3.0:1789366662.918026:0:6660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=238s v=(0 0) 00010000:00010000:3.0:1789366662.918029:0:6660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789366662.918034:0:6660:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000082beeec3/0x8da3486b955f3d49 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.202.23@tcp remote: 0xda917a494d06c275 expref: 8 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366662.918044:0:6660:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000082beeec3/0x8da3486b955f3d49 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.202.23@tcp remote: 0xda917a494d06c275 expref: 8 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366662.918051:0:6660:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9638832d3600, rc 0) 00000100:00100000:3.0:1789366662.918089:0:6660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638aef22d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0ab23baa-a205-44ad-bf17-f7b47295d82b+8:11057:x1876286751456384:12345-192.168.202.23@tcp:101:bash.0 Request processed in 121us (237us total) trans 0 rc 0/0 00000100:00100000:3.0:1789366662.918093:0:6660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 59 00000100:00100000:3.0:1789366662.919700:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:1.0:1789366662.922200:0:6665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751456512 00000100:00100000:1.0:1789366662.922211:0:6665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751456512 00002000:00010000:1.0:1789366662.922251:0:6665:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/5 (0->18446744073709551615) 00002000:00100000:1.0:1789366662.922256:0:6665:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9638b7035880 with x1876286751456512 ext(0->18446744073709551615) 00002000:00010000:1.0:1789366662.922267:0:6665:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9638b7035880. 00000100:00100000:1.0:1789366662.922302:0:6665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 6 00000100:00100000:1.0:1789366662.922312:0:6665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638b7035880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0ab23baa-a205-44ad-bf17-f7b47295d82b+8:2355:x1876286751456512:12345-192.168.202.23@tcp:10:bash.0 00002000:00010000:1.0:1789366662.922548:0:6665:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:1.0:1789366662.922551:0:6665:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb mtime from disk: 1789366662 -> 1789366663 00002000:00010000:1.0:1789366662.922554:0:6665:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb atime from disk: 1789366661 -> 1789366661 00002000:00010000:1.0:1789366662.922556:0:6665:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb ctime from disk: 1789366662 -> 1789366663 00002000:00010000:1.0:1789366662.922558:0:6665:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 11 -> 11 00000100:00100000:1.0:1789366662.922614:0:6665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638b7035880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0ab23baa-a205-44ad-bf17-f7b47295d82b+9:2355:x1876286751456512:12345-192.168.202.23@tcp:10:bash.0 Request processed in 302us (2916us total) trans 4294967318 rc 0/0 00000100:00100000:1.0:1789366662.922622:0:6665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 6 00002000:00010000:1.0:1789366662.922626:0:6665:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/5 (0->18446744073709551615) 00002000:00100000:1.0:1789366662.922629:0:6665:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9638b7035880 with x1876286751456512 ext(0->18446744073709551615) 00002000:00010000:1.0:1789366662.922634:0:6665:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9638b7035880. 00000100:00100000:0.0:1789366662.962694:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:1.0:1789366662.962849:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751456640 00000100:00100000:1.0:1789366662.962869:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751456640 00000100:00100000:1.0:1789366662.962924:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 192 00000100:00100000:1.0:1789366662.962935:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638aef20a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0ab23baa-a205-44ad-bf17-f7b47295d82b+31:11537:x1876286751456640:12345-192.168.202.23@tcp:34:lfs.0 00010000:00010000:1.0:1789366662.963004:0:5816:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9638b6ce3e00/0x8da3486b955f3d50 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366662.963022:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9638b6ce3e00/0x8da3486b955f3d50 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366662.963034:0:5816:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9638b6ce3e00/0x8da3486b955f3d50 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366662.963049:0:5816:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9638b6ce2600/0x8da3486b955f3d57 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366662.963057:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9638b6ce2600/0x8da3486b955f3d57 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366662.963064:0:5816:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9638b6ce2600/0x8da3486b955f3d57 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366662.963275:0:5816:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9638b6ce3200/0x8da3486b955f3d5e lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366662.963284:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9638b6ce3200/0x8da3486b955f3d5e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366662.963291:0:5816:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9638b6ce3200/0x8da3486b955f3d5e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789366662.963331:0:5816:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9638b6ce3200/0x8da3486b955f3d5e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366662.963352:0:5816:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9638b6ce3e00/0x8da3486b955f3d50 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366662.963359:0:5816:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9638b6ce3e00/0x8da3486b955f3d50 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366662.963366:0:5816:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9638b6ce3e00/0x8da3486b955f3d50 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366662.963372:0:5816:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9638b6ce3e00 already unused, calling callback (ffffffffc20ee4f0) 00010000:00010000:1.0:1789366662.963376:0:5816:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9638b6ce3e00/0x8da3486b955f3d50 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366662.963384:0:5816:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9638b6ce3e00/0x8da3486b955f3d50 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366662.963396:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff963890797800) 00010000:00010000:1.0:1789366662.963399:0:5816:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789366662.963404:0:5816:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9638b6ce3e00/0x8da3486b955f3d50 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366662.963411:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9638b6ce3e00/0x8da3486b955f3d50 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366662.963423:0:5816:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9638b6ce2600/0x8da3486b955f3d57 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366662.963429:0:5816:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9638b6ce2600/0x8da3486b955f3d57 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366662.963435:0:5816:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9638b6ce2600/0x8da3486b955f3d57 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366662.963446:0:5816:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9638b6ce2600 already unused, calling callback (ffffffffc20ee4f0) 00010000:00010000:1.0:1789366662.963449:0:5816:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9638b6ce2600/0x8da3486b955f3d57 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366662.963456:0:5816:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9638b6ce2600/0x8da3486b955f3d57 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366662.963464:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff963887f88700) 00010000:00010000:1.0:1789366662.963466:0:5816:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789366662.963469:0:5816:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9638b6ce2600/0x8da3486b955f3d57 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366662.963475:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9638b6ce2600/0x8da3486b955f3d57 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366662.963489:0:5816:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9638b6ce3200/0x8da3486b955f3d5e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366662.963496:0:5816:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9638b6ce3200/0x8da3486b955f3d5e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366662.963501:0:5816:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9638b6ce3200/0x8da3486b955f3d5e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366662.963507:0:5816:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9638b6ce3200 already unused, calling callback (ffffffffc20ee4f0) 00010000:00010000:1.0:1789366662.963510:0:5816:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9638b6ce3200/0x8da3486b955f3d5e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366662.963516:0:5816:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9638b6ce3200/0x8da3486b955f3d5e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366662.963534:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff963890797500) 00010000:00010000:1.0:1789366662.963536:0:5816:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789366662.963540:0:5816:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9638b6ce3200/0x8da3486b955f3d5e lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366662.963545:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9638b6ce3200/0x8da3486b955f3d5e lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789366662.963764:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638aef20a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0ab23baa-a205-44ad-bf17-f7b47295d82b+31:11537:x1876286751456640:12345-192.168.202.23@tcp:34:lfs.0 Request processed in 829us (1077us total) trans 0 rc 0/0 00000100:00100000:1.0:1789366662.963772:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 192 00000100:00100000:3.0:1789366662.980951:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:1.0:1789366662.981154:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751456896 00000100:00100000:1.0:1789366662.981166:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751456896 00000100:00100000:1.0:1789366662.981228:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 193 00000100:00100000:1.0:1789366662.981239:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638b7034700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0ab23baa-a205-44ad-bf17-f7b47295d82b+31:11540:x1876286751456896:12345-192.168.202.23@tcp:101:lfs.0 00010000:00010000:1.0:1789366662.981265:0:5815:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789366662.981285:0:5815:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9638b6ce3200/0x8da3486b955f3d65 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xda917a494d06c27c expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366662.981351:0:5815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9638b6ce2600/0x8da3486b955f3d6c lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366662.981364:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9638b6ce2600/0x8da3486b955f3d6c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366662.981373:0:5815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9638b6ce2600/0x8da3486b955f3d6c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366662.981389:0:5815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9638b6ce3e00/0x8da3486b955f3d73 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366662.981409:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9638b6ce3e00/0x8da3486b955f3d73 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366662.981416:0:5815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9638b6ce3e00/0x8da3486b955f3d73 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366662.981626:0:5815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9638b6ce2200/0x8da3486b955f3d7a lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366662.981634:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9638b6ce2200/0x8da3486b955f3d7a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366662.981641:0:5815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9638b6ce2200/0x8da3486b955f3d7a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789366662.981649:0:5815:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:1.0:1789366662.981774:0:5815:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9638b6ce2600/0x8da3486b955f3d6c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366662.981782:0:5815:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9638b6ce2600/0x8da3486b955f3d6c lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366662.981789:0:5815:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9638b6ce2600/0x8da3486b955f3d6c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366662.981795:0:5815:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9638b6ce2600 already unused, calling callback (ffffffffc20ee4f0) 00010000:00010000:1.0:1789366662.981799:0:5815:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9638b6ce2600/0x8da3486b955f3d6c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366662.981807:0:5815:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9638b6ce2600/0x8da3486b955f3d6c lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366662.981829:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff963890797800) 00010000:00010000:1.0:1789366662.981832:0:5815:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789366662.981837:0:5815:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9638b6ce2600/0x8da3486b955f3d6c lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366662.981843:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9638b6ce2600/0x8da3486b955f3d6c lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366662.981853:0:5815:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9638b6ce3e00/0x8da3486b955f3d73 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366662.981856:0:5815:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9638b6ce3e00/0x8da3486b955f3d73 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366662.981860:0:5815:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9638b6ce3e00/0x8da3486b955f3d73 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366662.981863:0:5815:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9638b6ce3e00 already unused, calling callback (ffffffffc20ee4f0) 00010000:00010000:1.0:1789366662.981864:0:5815:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9638b6ce3e00/0x8da3486b955f3d73 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366662.981868:0:5815:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9638b6ce3e00/0x8da3486b955f3d73 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366662.981871:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff963887f88700) 00010000:00010000:1.0:1789366662.981873:0:5815:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789366662.981874:0:5815:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9638b6ce3e00/0x8da3486b955f3d73 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366662.981877:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9638b6ce3e00/0x8da3486b955f3d73 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366662.981911:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9638b6ce3200/0x8da3486b955f3d65 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.23@tcp remote: 0xda917a494d06c27c expref: 34 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366662.981920:0:5815:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9638b6ce2200/0x8da3486b955f3d7a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.23@tcp remote: 0xda917a494d06c27c expref: 33 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366662.981924:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff963890797500) 00010000:00010000:1.0:1789366662.981926:0:5815:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1789366662.981927:0:5815:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9638b6ce2200, rc 0) 00000100:00100000:1.0:1789366662.981967:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638b7034700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0ab23baa-a205-44ad-bf17-f7b47295d82b+33:11540:x1876286751456896:12345-192.168.202.23@tcp:101:lfs.0 Request processed in 732us (1027us total) trans 4294967470 rc 0/0 00000100:00100000:1.0:1789366662.981972:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 193 00000100:00100000:3.0:1789366662.985977:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:0.0:1789366662.986067:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751457024 00000100:00100000:0.0:1789366662.986077:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751457024 00000100:00100000:0.0:1789366662.986140:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 194 00000100:00100000:0.0:1789366662.986150:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638b7036d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0ab23baa-a205-44ad-bf17-f7b47295d82b+33:11540:x1876286751457024:12345-192.168.202.23@tcp:54:lfs.0 00010000:00010000:0.0:1789366662.986214:0:5817:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720da00/0x8da3486b955f3d88 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366662.986232:0:5817:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9638b6ce2400/0x8da3486b955f3d2d lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.23@tcp remote: 0xda917a494d06c267 expref: 33 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366662.986242:0:5817:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720da00/0x8da3486b955f3d88 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366662.986277:0:5817:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9638b6ce2400/0x8da3486b955f3d2d lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.23@tcp remote: 0xda917a494d06c267 expref: 33 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366662.986292:0:5817:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9638b6ce2400/0x8da3486b955f3d2d lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.23@tcp remote: 0xda917a494d06c267 expref: 33 pid: 5816 timeout: 338 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789366662.986305:0:5817:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9638aef22680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5817:1876286758781824:192.168.202.23@tcp:104: 00000100:00100000:0.0:1789366662.986400:0:5817:0:(client.c:2716:ptlrpc_set_wait()) set ffff9638af2e2180 going to sleep for 11 seconds 00000100:00100000:0.0:1789366662.989594:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:3.0:1789366662.989824:0:5817:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9638aef22680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5817:1876286758781824:192.168.202.23@tcp:104: 00010000:00010000:3.0:1789366662.989905:0:5817:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720da00/0x8da3486b955f3d88 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789366662.991466:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751457280 00000100:00100000:2.0:1789366662.991477:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751457280 00000100:00100000:2.0:1789366662.991535:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 49 00000100:00100000:2.0:1789366662.991547:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638aef21c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0ab23baa-a205-44ad-bf17-f7b47295d82b+34:5581:x1876286751457280:12345-192.168.202.23@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1789366662.991881:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638aef21c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0ab23baa-a205-44ad-bf17-f7b47295d82b+35:5581:x1876286751457280:12345-192.168.202.23@tcp:35:ldlm_bl.0 Request processed in 336us (2293us total) trans 4294967471 rc 0/0 00000100:00100000:2.0:1789366662.991890:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 49 00000100:00100000:3.0:1789366662.995542:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:0.0:1789366662.995643:0:8419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751457408 00000100:00100000:0.0:1789366662.995652:0:8419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751457408 00010000:00010000:0.0:1789366662.995688:0:8419:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9638b6ce2400/0x8da3486b955f3d2d lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.23@tcp remote: 0xda917a494d06c267 expref: 35 pid: 5816 timeout: 338 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789366662.995829:0:8419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 75 00000100:00100000:0.0:1789366662.995839:0:8419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638b7034a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0ab23baa-a205-44ad-bf17-f7b47295d82b+35:2354:x1876286751457408:12345-192.168.202.23@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789366662.995864:0:8419:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789366662.995872:0:8419:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9638b6ce2400/0x8da3486b955f3d2d lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.23@tcp remote: 0xda917a494d06c267 expref: 35 pid: 5816 timeout: 338 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366662.995886:0:8419:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9638b6ce2400/0x8da3486b955f3d2d lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.23@tcp remote: 0xda917a494d06c267 expref: 35 pid: 5816 timeout: 338 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366662.995907:0:8419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9638b6ce2400/0x8da3486b955f3d2d lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.23@tcp remote: 0xda917a494d06c267 expref: 35 pid: 5816 timeout: 338 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366662.995924:0:8419:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff963890797500) 00010000:00010000:0.0:1789366662.995929:0:8419:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720da00/0x8da3486b955f3d88 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366662.995939:0:8419:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720da00/0x8da3486b955f3d88 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366662.995947:0:8419:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720da00/0x8da3486b955f3d88 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366662.995980:0:8419:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789366662.996008:0:5817:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720da00/0x8da3486b955f3d88 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366662.996028:0:5817:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720da00/0x8da3486b955f3d88 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789366662.996045:0:8419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638b7034a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0ab23baa-a205-44ad-bf17-f7b47295d82b+34:2354:x1876286751457408:12345-192.168.202.23@tcp:103:ldlm_bl.0 Request processed in 206us (1059us total) trans 0 rc 0/0 00010000:00010000:1.0:1789366662.996055:0:5817:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720da00/0x8da3486b955f3d88 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366662.996072:0:5817:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720da00/0x8da3486b955f3d88 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366662.996079:0:5817:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720da00/0x8da3486b955f3d88 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789366662.996086:0:8419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 75 00010000:00010000:1.0:1789366662.996088:0:5817:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9638b720da00 already unused, calling callback (ffffffffc20ee4f0) 00010000:00010000:1.0:1789366662.996094:0:5817:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720da00/0x8da3486b955f3d88 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366662.996109:0:5817:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720da00/0x8da3486b955f3d88 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366662.996119:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff963890797500) 00010000:00010000:1.0:1789366662.996122:0:5817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1789366662.996136:0:5817:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720da00/0x8da3486b955f3d88 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366662.996143:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720da00/0x8da3486b955f3d88 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789366662.996183:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638b7036d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0ab23baa-a205-44ad-bf17-f7b47295d82b+33:11540:x1876286751457024:12345-192.168.202.23@tcp:54:lfs.0 Request processed in 10034us (10213us total) trans 0 rc 0/0 00000100:00100000:1.0:1789366662.996190:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 194 00000100:00100000:0.0:1789366663.003295:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:3.0:1789366663.003481:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751457664 00000100:00100000:3.0:1789366663.003492:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751457664 00000100:00100000:3.0:1789366663.003592:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 50 00000100:00100000:3.0:1789366663.003603:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963888cba450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0ab23baa-a205-44ad-bf17-f7b47295d82b+33:11540:x1876286751457664:12345-192.168.202.23@tcp:35:lfs.0 00000100:00100000:3.0:1789366663.003867:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963888cba450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0ab23baa-a205-44ad-bf17-f7b47295d82b+34:11540:x1876286751457664:12345-192.168.202.23@tcp:35:lfs.0 Request processed in 265us (582us total) trans 4294967472 rc 0/0 00000100:00100000:3.0:1789366663.003875:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 50 00000100:00100000:2.0:1789366663.048283:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:0.0:1789366663.048337:0:7132:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751457920 00000100:00100000:0.0:1789366663.048356:0:7132:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751457920 00000100:00100000:0.0:1789366663.048471:0:7132:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 195 00000100:00100000:0.0:1789366663.048484:0:7132:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963882ee1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0ab23baa-a205-44ad-bf17-f7b47295d82b+34:11551:x1876286751457920:12345-192.168.202.23@tcp:101:cat.0 00010000:00010000:0.0:1789366663.048512:0:7132:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789366663.048531:0:7132:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720c000/0x8da3486b955f3d8f lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xda917a494d06c283 expref: -99 pid: 7132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366663.048598:0:7132:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720de00/0x8da3486b955f3d96 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366663.048617:0:7132:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720de00/0x8da3486b955f3d96 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366663.048629:0:7132:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720de00/0x8da3486b955f3d96 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366663.048642:0:7132:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720d600/0x8da3486b955f3d9d lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366663.048649:0:7132:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720d600/0x8da3486b955f3d9d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366663.048655:0:7132:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720d600/0x8da3486b955f3d9d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366663.048924:0:7132:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720d200/0x8da3486b955f3da4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366663.048940:0:7132:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720d200/0x8da3486b955f3da4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366663.048948:0:7132:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720d200/0x8da3486b955f3da4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789366663.048958:0:7132:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 8 00010000:00010000:0.0:1789366663.049046:0:7132:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720de00/0x8da3486b955f3d96 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366663.049055:0:7132:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720de00/0x8da3486b955f3d96 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366663.049062:0:7132:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720de00/0x8da3486b955f3d96 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366663.049066:0:7132:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9638b720de00 already unused, calling callback (ffffffffc20ee4f0) 00010000:00010000:0.0:1789366663.049070:0:7132:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720de00/0x8da3486b955f3d96 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366663.049075:0:7132:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720de00/0x8da3486b955f3d96 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366663.049084:0:7132:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff963890797800) 00010000:00010000:0.0:1789366663.049087:0:7132:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789366663.049090:0:7132:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720de00/0x8da3486b955f3d96 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366663.049095:0:7132:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720de00/0x8da3486b955f3d96 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366663.049110:0:7132:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720d600/0x8da3486b955f3d9d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366663.049121:0:7132:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720d600/0x8da3486b955f3d9d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366663.049139:0:7132:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720d600/0x8da3486b955f3d9d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366663.049144:0:7132:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9638b720d600 already unused, calling callback (ffffffffc20ee4f0) 00010000:00010000:0.0:1789366663.049147:0:7132:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720d600/0x8da3486b955f3d9d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366663.049154:0:7132:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720d600/0x8da3486b955f3d9d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366663.049162:0:7132:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff963890797300) 00010000:00010000:0.0:1789366663.049164:0:7132:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789366663.049167:0:7132:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720d600/0x8da3486b955f3d9d lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366663.049174:0:7132:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720d600/0x8da3486b955f3d9d lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366663.049208:0:7132:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720c000/0x8da3486b955f3d8f lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.23@tcp remote: 0xda917a494d06c283 expref: 37 pid: 7132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366663.049217:0:7132:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720d200/0x8da3486b955f3da4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.23@tcp remote: 0xda917a494d06c283 expref: 36 pid: 7132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366663.049222:0:7132:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff963890797500) 00010000:00010000:0.0:1789366663.049224:0:7132:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789366663.049230:0:7132:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9638b720d200, rc 0) 00000100:00100000:0.0:1789366663.049275:0:7132:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963882ee1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0ab23baa-a205-44ad-bf17-f7b47295d82b+36:11551:x1876286751457920:12345-192.168.202.23@tcp:101:cat.0 Request processed in 795us (1000us total) trans 4294967473 rc 0/0 00000100:00100000:0.0:1789366663.049280:0:7132:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 195 00000100:00100000:0.0:1789366663.052148:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:2.0:1789366663.052207:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751458176 00000100:00100000:2.0:1789366663.052216:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751458176 00000100:00100000:2.0:1789366663.052271:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 51 00000100:00100000:2.0:1789366663.052281:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638aef21180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0ab23baa-a205-44ad-bf17-f7b47295d82b+36:11551:x1876286751458176:12345-192.168.202.23@tcp:35:cat.0 00000100:00100000:2.0:1789366663.052516:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638aef21180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0ab23baa-a205-44ad-bf17-f7b47295d82b+37:11551:x1876286751458176:12345-192.168.202.23@tcp:35:cat.0 Request processed in 236us (377us total) trans 4294967474 rc 0/0 00000100:00100000:2.0:1789366663.052523:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 51 00000100:00100000:3.0:1789366663.065591:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:0.0:1789366663.065661:0:7614:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751458432 00000100:00100000:0.0:1789366663.065671:0:7614:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751458432 00000100:00100000:0.0:1789366663.065804:0:7614:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 196 00000100:00100000:0.0:1789366663.065816:0:7614:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638b7036680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0ab23baa-a205-44ad-bf17-f7b47295d82b+37:11552:x1876286751458432:12345-192.168.202.23@tcp:36:rm.0 00010000:00010000:0.0:1789366663.065882:0:7614:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:0.0:1789366663.065906:0:7614:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720d200/0x8da3486b955f3da4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.23@tcp remote: 0xda917a494d06c283 expref: 37 pid: 7132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366663.065930:0:7614:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9638b6ce2200/0x8da3486b955f3d7a lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.23@tcp remote: 0xda917a494d06c27c expref: 36 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366663.065944:0:7614:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9638832d3c00/0x8da3486b955f3d42 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.23@tcp remote: 0xda917a494d06c26e expref: 35 pid: 7614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366663.065954:0:7614:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff963890797500) 00010000:00010000:0.0:1789366663.065965:0:7614:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789366663.065985:0:7614:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720c000/0x8da3486b955f3db2 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7614 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366663.065998:0:7614:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720c000/0x8da3486b955f3db2 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7614 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366663.066008:0:7614:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720c000/0x8da3486b955f3db2 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7614 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366663.066039:0:7614:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720d600/0x8da3486b955f3db9 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7614 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366663.066047:0:7614:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720d600/0x8da3486b955f3db9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7614 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366663.066053:0:7614:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720d600/0x8da3486b955f3db9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7614 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366663.066300:0:7614:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720de00/0x8da3486b955f3dc0 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7614 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366663.066309:0:7614:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720de00/0x8da3486b955f3dc0 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7614 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366663.066317:0:7614:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720de00/0x8da3486b955f3dc0 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7614 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1789366663.066796:0:7614:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].7, 64 off8712 00010000:00010000:0.0:1789366663.066840:0:7614:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720c600/0x8da3486b955f3dc7 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7614 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366663.066846:0:7614:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720c600/0x8da3486b955f3dc7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 7614 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366663.066851:0:7614:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720c600/0x8da3486b955f3dc7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 7614 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366663.066856:0:7614:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720c600/0x8da3486b955f3dc7 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 7614 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366663.066860:0:7614:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720c600/0x8da3486b955f3dc7 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 7614 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366663.066869:0:7614:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720c600/0x8da3486b955f3dc7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 7614 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366663.066889:0:7614:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789366663.066903:0:7614:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720de00/0x8da3486b955f3dc0 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7614 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366663.066907:0:7614:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720de00/0x8da3486b955f3dc0 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7614 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366663.066911:0:7614:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720de00/0x8da3486b955f3dc0 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7614 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366663.066915:0:7614:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9638b720de00 already unused, calling callback (ffffffffc20ee4f0) 00010000:00010000:0.0:1789366663.066918:0:7614:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720de00/0x8da3486b955f3dc0 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7614 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366663.066922:0:7614:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720de00/0x8da3486b955f3dc0 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7614 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366663.066928:0:7614:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff963890797600) 00010000:00010000:0.0:1789366663.066929:0:7614:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1789366663.066932:0:7614:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720de00/0x8da3486b955f3dc0 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7614 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366663.066935:0:7614:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720de00/0x8da3486b955f3dc0 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7614 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366663.066944:0:7614:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720c000/0x8da3486b955f3db2 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7614 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366663.066948:0:7614:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720c000/0x8da3486b955f3db2 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7614 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366663.066955:0:7614:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720c000/0x8da3486b955f3db2 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7614 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366663.066959:0:7614:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9638b720c000 already unused, calling callback (ffffffffc20ee4f0) 00010000:00010000:0.0:1789366663.066960:0:7614:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720c000/0x8da3486b955f3db2 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7614 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366663.066963:0:7614:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720c000/0x8da3486b955f3db2 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7614 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366663.066967:0:7614:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff963890797800) 00010000:00010000:0.0:1789366663.066969:0:7614:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789366663.066970:0:7614:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720c000/0x8da3486b955f3db2 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7614 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366663.066973:0:7614:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720c000/0x8da3486b955f3db2 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7614 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789366663.066978:0:7614:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000001f6562cb reply state 00000000453b914b transno 4294967475 ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720d600/0x8da3486b955f3db9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7614 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789366663.066984:0:7614:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789366663.067038:0:7614:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638b7036680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0ab23baa-a205-44ad-bf17-f7b47295d82b+36:11552:x1876286751458432:12345-192.168.202.23@tcp:36:rm.0 Request processed in 1226us (1458us total) trans 4294967475 rc 0/0 00000100:00100000:0.0:1789366663.067043:0:7614:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 196 00010000:00010000:3.0:1789366663.067157:0:5805:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789366663.067163:0:5805:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720c600/0x8da3486b955f3dc7 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 7614 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366663.067168:0:5805:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9638b720c600 already unused, calling callback (ffffffffc16df520) 00010000:00010000:3.0:1789366663.067171:0:5805:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720c600/0x8da3486b955f3dc7 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 7614 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366663.067176:0:5805:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720c600/0x8da3486b955f3dc7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 7614 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366663.067183:0:5805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff963890797600) 00010000:00010000:3.0:1789366663.067185:0:5805:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1789366663.067187:0:5805:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720c600/0x8da3486b955f3dc7 lrc: 1/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 7614 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366663.067191:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720c600/0x8da3486b955f3dc7 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 7614 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366663.067201:0:5805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789366663.067207:0:5805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789366663.067208:0:5805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789366663.069479:0:3271:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720d600/0x8da3486b955f3db9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7614 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366663.069495:0:3271:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720d600/0x8da3486b955f3db9 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7614 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366663.069502:0:3271:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720d600/0x8da3486b955f3db9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7614 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366663.069508:0:3271:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9638b720d600 already unused, calling callback (ffffffffc20ee4f0) 00010000:00010000:1.0:1789366663.069513:0:3271:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720d600/0x8da3486b955f3db9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7614 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366663.069520:0:3271:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720d600/0x8da3486b955f3db9 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7614 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366663.069551:0:3271:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff963890797300) 00010000:00010000:1.0:1789366663.069554:0:3271:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789366663.069558:0:3271:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720d600/0x8da3486b955f3db9 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7614 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366663.069564:0:3271:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720d600/0x8da3486b955f3db9 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7614 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789366663.087983:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:1.0:1789366663.088045:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751458688 00000100:00100000:1.0:1789366663.088055:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751458688 00000100:00100000:1.0:1789366663.088169:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 197 00000100:00100000:1.0:1789366663.088180:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638b7035c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0ab23baa-a205-44ad-bf17-f7b47295d82b+35:11558:x1876286751458688:12345-192.168.202.23@tcp:101:bash.0 00010000:00010000:1.0:1789366663.088205:0:5817:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789366663.088227:0:5817:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9638b6ce3e00/0x8da3486b955f3dce lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xda917a494d06c28a expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366663.088339:0:5817:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9638b6ce2600/0x8da3486b955f3dd5 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366663.088368:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9638b6ce2600/0x8da3486b955f3dd5 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366663.088380:0:5817:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9638b6ce2600/0x8da3486b955f3dd5 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366663.088394:0:5817:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9638b6ce2000/0x8da3486b955f3ddc lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366663.088402:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9638b6ce2000/0x8da3486b955f3ddc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366663.088421:0:5817:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9638b6ce2000/0x8da3486b955f3ddc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1789366663.088941:0:5817:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x5:0x0], index 1: 0 00010000:00010000:1.0:1789366663.089053:0:5817:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9638b6ce2800/0x8da3486b955f3de3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366663.089060:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9638b6ce2800/0x8da3486b955f3de3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366663.089065:0:5817:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9638b6ce2800/0x8da3486b955f3de3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366663.089088:0:5817:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9638b6ce2600/0x8da3486b955f3dd5 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366663.089092:0:5817:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9638b6ce2600/0x8da3486b955f3dd5 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366663.089097:0:5817:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9638b6ce2600/0x8da3486b955f3dd5 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366663.089101:0:5817:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9638b6ce2600 already unused, calling callback (ffffffffc20ee4f0) 00010000:00010000:1.0:1789366663.089104:0:5817:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9638b6ce2600/0x8da3486b955f3dd5 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366663.089111:0:5817:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9638b6ce2600/0x8da3486b955f3dd5 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366663.089122:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff963890797800) 00010000:00010000:1.0:1789366663.089136:0:5817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789366663.089147:0:5817:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9638b6ce2600/0x8da3486b955f3dd5 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366663.089154:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9638b6ce2600/0x8da3486b955f3dd5 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789366663.089168:0:5817:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000af2bdf8d reply state 000000001fcfbe86 transno 4294967476 ns: mdt-lustre-MDT0000_UUID lock: ffff9638b6ce2000/0x8da3486b955f3ddc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789366663.089176:0:5817:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1789366663.089203:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9638b6ce3e00/0x8da3486b955f3dce lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.23@tcp remote: 0xda917a494d06c28a expref: 38 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366663.089214:0:5817:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9638b6ce2800/0x8da3486b955f3de3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.23@tcp remote: 0xda917a494d06c28a expref: 37 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366663.089219:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff963887f88d00) 00010000:00010000:1.0:1789366663.089221:0:5817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789366663.089222:0:5817:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9638b6ce2800, rc 0) 00000100:00100000:1.0:1789366663.089269:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638b7035c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0ab23baa-a205-44ad-bf17-f7b47295d82b+38:11558:x1876286751458688:12345-192.168.202.23@tcp:101:bash.0 Request processed in 1093us (1296us total) trans 4294967476 rc 0/0 00000100:00100000:1.0:1789366663.089274:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 197 00010000:00010000:3.0:1789366663.091552:0:3270:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9638b6ce2000/0x8da3486b955f3ddc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366663.091566:0:3270:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9638b6ce2000/0x8da3486b955f3ddc lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366663.091572:0:3270:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9638b6ce2000/0x8da3486b955f3ddc lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366663.091577:0:3270:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9638b6ce2000 already unused, calling callback (ffffffffc20ee4f0) 00010000:00010000:3.0:1789366663.091581:0:3270:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9638b6ce2000/0x8da3486b955f3ddc lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366663.091588:0:3270:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9638b6ce2000/0x8da3486b955f3ddc lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366663.091602:0:3270:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff963887f88700) 00010000:00010000:3.0:1789366663.091605:0:3270:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789366663.091608:0:3270:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9638b6ce2000/0x8da3486b955f3ddc lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366663.091614:0:3270:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9638b6ce2000/0x8da3486b955f3ddc lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789366663.091883:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:0.0:1789366663.092001:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751458816 00000100:00100000:0.0:1789366663.092010:0:6659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751458816 00000100:00100000:0.0:1789366663.092096:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 60 00000100:00100000:0.0:1789366663.092106:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638b7035180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0ab23baa-a205-44ad-bf17-f7b47295d82b+5:2357:x1876286751458816:12345-192.168.202.23@tcp:101:bash.0 00010000:00010000:0.0:1789366663.092169:0:6659:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789366663.092188:0:6659:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000932df588/0x8da3486b955f3df1 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda917a494d06c291 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789366663.092210:0:6659:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789366663.092228:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=238s v=(0 0) 00010000:00010000:0.0:1789366663.092232:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789366663.092239:0:6659:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000932df588/0x8da3486b955f3df1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.23@tcp remote: 0xda917a494d06c291 expref: 6 pid: 6659 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366663.092254:0:6659:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000932df588/0x8da3486b955f3df1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.23@tcp remote: 0xda917a494d06c291 expref: 6 pid: 6659 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366663.092265:0:6659:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9638b720de00, rc 0) 00000100:00100000:0.0:1789366663.092319:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638b7035180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0ab23baa-a205-44ad-bf17-f7b47295d82b+6:2357:x1876286751458816:12345-192.168.202.23@tcp:101:bash.0 Request processed in 214us (438us total) trans 0 rc 0/0 00000100:00100000:0.0:1789366663.092325:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 60 00000100:00080000:1.0:1789366663.092648:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789366663.093933:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:1.0:1789366663.094014:0:8065:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751458944 00000100:00100000:1.0:1789366663.094021:0:8065:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751458944 00000100:00100000:1.0:1789366663.094097:0:8065:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 61 00000100:00100000:1.0:1789366663.094112:0:8065:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638aef21500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0ab23baa-a205-44ad-bf17-f7b47295d82b+6:11558:x1876286751458944:12345-192.168.202.23@tcp:101:bash.0 00010000:00010000:1.0:1789366663.094134:0:8065:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789366663.094147:0:8065:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d8dc1c1c/0x8da3486b955f3df8 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda917a494d06c298 expref: -99 pid: 8065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366663.094188:0:8065:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000932df588/0x8da3486b955f3df1 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.23@tcp remote: 0xda917a494d06c291 expref: 7 pid: 6659 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366663.094196:0:8065:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789366663.094200:0:8065:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789366663.094205:0:8065:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d8dc1c1c/0x8da3486b955f3df8 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.23@tcp remote: 0xda917a494d06c298 expref: 7 pid: 8065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366663.094239:0:8065:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000932df588/0x8da3486b955f3df1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.23@tcp remote: 0xda917a494d06c291 expref: 7 pid: 6659 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366663.094253:0:8065:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000932df588/0x8da3486b955f3df1 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.23@tcp remote: 0xda917a494d06c291 expref: 7 pid: 6659 timeout: 338 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789366663.094265:0:8065:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9638b703a680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8065:1876286758781952:192.168.202.23@tcp:104: 00000100:00100000:1.0:1789366663.094387:0:8065:0:(client.c:2716:ptlrpc_set_wait()) set ffff96388347a000 going to sleep for 11 seconds 00000100:00100000:0.0:1789366663.096066:0:3286:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9638b7352a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8cde4528-5832-4854-a387-4adacc3dd0ab:3286:1876286758782080:0@lo:400:kworker.0 00000100:00100000:0.0:1789366663.096133:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789366663.096238:0:3287:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9638b73f8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3287:1876286758782208:0@lo:400:kworker.0 00000100:00100000:1.0:1789366663.096274:0:3287:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789366663.096278:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286758782080 00000100:00100000:3.0:1789366663.096284:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286758782080 00000100:00100000:3.0:1789366663.096319:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 278 00000100:00100000:3.0:1789366663.096325:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638b4e83850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8cde4528-5832-4854-a387-4adacc3dd0ab+19:3286:x1876286758782080:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789366663.096365:0:7132:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286758782208 00000100:00100000:0.0:1789366663.096371:0:7132:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286758782208 00000100:00100000:0.0:1789366663.096409:0:7132:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:0.0:1789366663.096415:0:7132:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638b7039c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3287:x1876286758782208:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789366663.096435:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638b4e83850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8cde4528-5832-4854-a387-4adacc3dd0ab+19:3286:x1876286758782080:12345-0@lo:400:kworker.0 Request processed in 108us (311us total) trans 0 rc 0/0 00000100:00100000:3.0:1789366663.096442:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 278 00000100:00100000:0.0:1789366663.096448:0:7132:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638b7039c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3287:x1876286758782208:12345-0@lo:400:kworker.0 Request processed in 34us (175us total) trans 0 rc 0/0 00000100:00100000:0.0:1789366663.096461:0:7132:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:0.0:1789366663.096494:0:3287:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9638b73f8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3287:1876286758782208:0@lo:400:kworker.0 00000100:00100000:3.0:1789366663.096544:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:3.0:1789366663.096574:0:8065:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9638b703a680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8065:1876286758781952:192.168.202.23@tcp:104: 00010000:00010000:3.0:1789366663.096596:0:8065:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000d8dc1c1c/0x8da3486b955f3df8 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.23@tcp remote: 0xda917a494d06c298 expref: 7 pid: 8065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366663.096613:0:8065:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9638b6ce3400, rc 0) 00000100:00100000:3.0:1789366663.096641:0:8065:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638aef21500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0ab23baa-a205-44ad-bf17-f7b47295d82b+7:11558:x1876286751458944:12345-192.168.202.23@tcp:101:bash.0 Request processed in 2537us (2713us total) trans 0 rc 0/0 00000100:00100000:3.0:1789366663.096646:0:8065:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 61 00000100:00100000:0.0:1789366663.096648:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751459072 00000100:00100000:0.0:1789366663.096653:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751459072 00010000:00010000:0.0:1789366663.096676:0:5801:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000932df588/0x8da3486b955f3df1 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.23@tcp remote: 0xda917a494d06c291 expref: 7 pid: 6659 timeout: 338 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789366663.096703:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 76 00000100:00100000:0.0:1789366663.096711:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96389861e850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0ab23baa-a205-44ad-bf17-f7b47295d82b+7:2355:x1876286751459072:12345-192.168.202.23@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789366663.096744:0:5801:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789366663.096764:0:5801:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000932df588/0x8da3486b955f3df1 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.23@tcp remote: 0xda917a494d06c291 expref: 7 pid: 6659 timeout: 338 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366663.096776:0:5801:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000932df588/0x8da3486b955f3df1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.23@tcp remote: 0xda917a494d06c291 expref: 7 pid: 6659 timeout: 338 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366663.096795:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000932df588/0x8da3486b955f3df1 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.23@tcp remote: 0xda917a494d06c291 expref: 7 pid: 6659 timeout: 338 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366663.096805:0:5801:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789366663.096809:0:5801:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789366663.096815:0:5801:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000d8dc1c1c/0x8da3486b955f3df8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.23@tcp remote: 0xda917a494d06c298 expref: 6 pid: 8065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366663.096825:0:5801:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d8dc1c1c/0x8da3486b955f3df8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.23@tcp remote: 0xda917a494d06c298 expref: 6 pid: 8065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366663.096857:0:5801:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000d8dc1c1c/0x8da3486b955f3df8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.23@tcp remote: 0xda917a494d06c298 expref: 6 pid: 8065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789366663.096867:0:5801:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9638aef20e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5801:1876286758782336:192.168.202.23@tcp:105: 00000100:00100000:0.0:1789366663.096912:0:5801:0:(client.c:2716:ptlrpc_set_wait()) set ffff9638af2e2e40 going to sleep for 11 seconds 00000100:00100000:1.0:1789366663.097400:0:3286:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9638b7352a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8cde4528-5832-4854-a387-4adacc3dd0ab:3286:1876286758782080:0@lo:400:kworker.0 00000100:00100000:2.0:1789366663.098386:0:3287:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789366663.098397:0:3287:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9638b73f8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3287:1876286758782720:0@lo:400:kworker.0 00000100:00100000:2.0:1789366663.098436:0:3287:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789366663.098469:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286758782720 00000100:00100000:2.0:1789366663.098474:0:6659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286758782720 00000100:00100000:2.0:1789366663.098515:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1789366663.098522:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963883308a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3287:x1876286758782720:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789366663.098578:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963883308a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3287:x1876286758782720:12345-0@lo:400:kworker.0 Request processed in 55us (140us total) trans 0 rc 0/0 00000100:00100000:2.0:1789366663.098585:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00080000:2.0:1789366663.098606:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789366663.098628:0:3287:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9638b73f8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3287:1876286758782720:0@lo:400:kworker.0 00000100:00100000:1.0:1789366663.098681:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9638b73fa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3284:1876286758782464:0@lo:400:kworker.0 00000100:00100000:1.0:1789366663.098710:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789366663.098755:0:3284:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789366663.098761:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9638b73f9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3284:1876286758782592:0@lo:400:kworker.0 00000100:00100000:1.0:1789366663.098792:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789366663.098976:0:7614:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286758782464 00000100:00100000:2.0:1789366663.098981:0:7614:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286758782464 00000100:00100000:2.0:1789366663.099022:0:7614:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286758782592 00000100:00100000:2.0:1789366663.099026:0:7614:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286758782592 00000100:00100000:2.0:1789366663.099045:0:7614:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:2.0:1789366663.099051:0:7614:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638b7039180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3284:x1876286758782464:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789366663.099085:0:7614:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638b7039180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3284:x1876286758782464:12345-0@lo:400:kworker.0 Request processed in 34us (374us total) trans 0 rc 0/0 00000100:00100000:2.0:1789366663.099091:0:7614:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:2.0:1789366663.099103:0:7614:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:2.0:1789366663.099109:0:7614:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638b7039500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3284:x1876286758782592:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789366663.099152:0:7614:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638b7039500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3284:x1876286758782592:12345-0@lo:400:kworker.0 Request processed in 43us (359us total) trans 0 rc 0/0 00000100:00100000:2.0:1789366663.099158:0:7614:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00080000:1.0:1789366663.099242:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789366663.099260:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9638b73f9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3284:1876286758782592:0@lo:400:kworker.0 00000100:00100000:1.0:1789366663.099268:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9638b73fa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3284:1876286758782464:0@lo:400:kworker.0 00000100:00100000:1.0:1789366663.099744:0:3286:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789366663.099754:0:3286:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9638b7035500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3286:1876286758782848:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789366663.099782:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789366663.099852:0:6662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286758782848 00000100:00100000:3.0:1789366663.099857:0:6662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286758782848 00000100:00100000:3.0:1789366663.099889:0:6662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1789366663.099897:0:6662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638b7038e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3286:x1876286758782848:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789366663.099925:0:6662:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 49348608 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789366663.099964:0:6662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638b7038e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3286:x1876286758782848:12345-0@lo:13:osp-pre-1-0.0 Request processed in 68us (181us total) trans 0 rc 0/0 00000100:00100000:3.0:1789366663.099971:0:6662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1789366663.100001:0:3286:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9638b7035500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3286:1876286758782848:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789366663.100310:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:3.0:1789366663.100613:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751459328 00000100:00100000:3.0:1789366663.100618:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751459328 00000100:00100000:3.0:1789366663.100653:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 52 00000100:00100000:3.0:1789366663.100661:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638aef22300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0ab23baa-a205-44ad-bf17-f7b47295d82b+37:11558:x1876286751459328:12345-192.168.202.23@tcp:35:bash.0 00000100:00100000:3.0:1789366663.101003:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638aef22300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0ab23baa-a205-44ad-bf17-f7b47295d82b+38:11558:x1876286751459328:12345-192.168.202.23@tcp:35:bash.0 Request processed in 341us (693us total) trans 4294967477 rc 0/0 00000100:00100000:3.0:1789366663.101009:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 52 00000100:00100000:2.0:1789366663.101571:0:5801:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9638aef20e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5801:1876286758782336:192.168.202.23@tcp:105: 00010000:00010000:2.0:1789366663.101586:0:5801:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789366663.101612:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96389861e850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0ab23baa-a205-44ad-bf17-f7b47295d82b+6:2355:x1876286751459072:12345-192.168.202.23@tcp:103:ldlm_bl.0 Request processed in 4903us (5068us total) trans 0 rc 0/0 00000100:00100000:2.0:1789366663.101620:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 76 00000100:00100000:0.0:1789366663.195839:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:1.0:1789366663.195930:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751459456 00000100:00100000:1.0:1789366663.195940:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751459456 00000100:00100000:1.0:1789366663.196000:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 198 00000100:00100000:1.0:1789366663.196009:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638aef23100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0ab23baa-a205-44ad-bf17-f7b47295d82b+38:11574:x1876286751459456:12345-192.168.202.23@tcp:101:lfs.0 00010000:00010000:1.0:1789366663.196032:0:5816:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789366663.196054:0:5816:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9638b6ce3e00/0x8da3486b955f3dff lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xda917a494d06c29f expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366663.196114:0:5816:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9638b6ce2600/0x8da3486b955f3e06 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366663.196139:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9638b6ce2600/0x8da3486b955f3e06 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366663.196152:0:5816:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9638b6ce2600/0x8da3486b955f3e06 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789366663.196186:0:5816:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00000004:00200000:1.0:1789366663.196189:0:5816:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1789366663.196205:0:5816:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9638b6ce2600/0x8da3486b955f3e06 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366663.196259:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9638b6ce3e00/0x8da3486b955f3dff lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.23@tcp remote: 0xda917a494d06c29f expref: 40 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366663.196277:0:5816:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9638b6ce2600/0x8da3486b955f3e06 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.23@tcp remote: 0xda917a494d06c29f expref: 39 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366663.196285:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff963890797800) 00010000:00010000:1.0:1789366663.196288:0:5816:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789366663.196292:0:5816:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9638b6ce2600, rc 0) 00000100:00100000:1.0:1789366663.196351:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638aef23100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0ab23baa-a205-44ad-bf17-f7b47295d82b+39:11574:x1876286751459456:12345-192.168.202.23@tcp:101:lfs.0 Request processed in 342us (520us total) trans 0 rc 0/0 00000100:00100000:1.0:1789366663.196358:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 198 00000100:00100000:0.0:1789366663.203007:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:1.0:1789366663.203119:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751459712 00000100:00100000:1.0:1789366663.203140:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751459712 00000100:00100000:1.0:1789366663.203201:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 199 00000100:00100000:1.0:1789366663.203210:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638aef20380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0ab23baa-a205-44ad-bf17-f7b47295d82b+39:11574:x1876286751459712:12345-192.168.202.23@tcp:101:lfs.0 00010000:00010000:1.0:1789366663.203230:0:5817:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789366663.203251:0:5817:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9638b6ce2a00/0x8da3486b955f3e0d lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xda917a494d06c2a6 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366663.203358:0:5817:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9638b6ce3a00/0x8da3486b955f3e14 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366663.203386:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9638b6ce3a00/0x8da3486b955f3e14 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366663.203398:0:5817:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9638b6ce3a00/0x8da3486b955f3e14 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789366663.203422:0:5817:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:1.0:1789366663.203549:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9638b6ce2a00/0x8da3486b955f3e0d lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.23@tcp remote: 0xda917a494d06c2a6 expref: 42 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366663.203577:0:5817:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9638b6ce3a00/0x8da3486b955f3e14 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.23@tcp remote: 0xda917a494d06c2a6 expref: 41 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366663.203586:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff963887f88d00) 00010000:00010000:1.0:1789366663.203589:0:5817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789366663.203593:0:5817:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9638b6ce3a00, rc 0) 00000100:00100000:1.0:1789366663.203874:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638aef20380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0ab23baa-a205-44ad-bf17-f7b47295d82b+41:11574:x1876286751459712:12345-192.168.202.23@tcp:101:lfs.0 Request processed in 664us (873us total) trans 4294967478 rc 0/0 00000100:00100000:1.0:1789366663.203882:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 199 00000100:00100000:0.0:1789366663.207598:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:0.0:1789366663.207688:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:2.0:1789366663.207782:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751459968 00000100:00100000:2.0:1789366663.207790:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751459968 00000100:00100000:2.0:1789366663.207836:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 200 00000100:00100000:2.0:1789366663.207845:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638aef23480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0ab23baa-a205-44ad-bf17-f7b47295d82b+41:11574:x1876286751459968:12345-192.168.202.23@tcp:101:lfs.0 00010000:00010000:2.0:1789366663.207876:0:5815:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789366663.207896:0:5815:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c8a00/0x8da3486b955f3e22 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xda917a494d06c2ad expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366663.207972:0:5815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c8200/0x8da3486b955f3e29 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366663.207985:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c8200/0x8da3486b955f3e29 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366663.207993:0:5815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c8200/0x8da3486b955f3e29 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789366663.208001:0:5815:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:2.0:1789366663.208083:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c8a00/0x8da3486b955f3e22 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.23@tcp remote: 0xda917a494d06c2ad expref: 44 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366663.208108:0:5815:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c8200/0x8da3486b955f3e29 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.23@tcp remote: 0xda917a494d06c2ad expref: 43 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366663.208114:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff963887f88d00) 00010000:00010000:2.0:1789366663.208117:0:5815:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1789366663.208119:0:5815:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9638902c8200, rc 0) 00000100:00100000:2.0:1789366663.208221:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638aef23480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0ab23baa-a205-44ad-bf17-f7b47295d82b+43:11574:x1876286751459968:12345-192.168.202.23@tcp:101:lfs.0 Request processed in 377us (633us total) trans 4294967479 rc 0/0 00000100:00100000:2.0:1789366663.208226:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 200 00000100:00100000:3.0:1789366663.208275:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751460096 00000100:00100000:3.0:1789366663.208278:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751460096 00000100:00100000:3.0:1789366663.208305:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 14 00000100:00100000:3.0:1789366663.208312:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638aef20e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0ab23baa-a205-44ad-bf17-f7b47295d82b+43:2356:x1876286751460096:12345-192.168.202.23@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789366663.208321:0:5802:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789366663.208335:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9638b6ce3a00/0x8da3486b955f3e14 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.23@tcp remote: 0xda917a494d06c2a6 expref: 43 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366663.208346:0:5802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff963887f88d00) 00010000:00010000:3.0:1789366663.208350:0:5802:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789366663.208365:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638aef20e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0ab23baa-a205-44ad-bf17-f7b47295d82b+42:2356:x1876286751460096:12345-192.168.202.23@tcp:103:ldlm_bl.0 Request processed in 55us (679us total) trans 0 rc 0/0 00000100:00100000:3.0:1789366663.208369:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 14 00000100:00100000:3.0:1789366663.211363:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:1.0:1789366663.211796:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751460224 00000100:00100000:1.0:1789366663.211805:0:6660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751460224 00000100:00100000:1.0:1789366663.211852:0:6660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 62 00000100:00100000:1.0:1789366663.211862:0:6660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638b7035500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0ab23baa-a205-44ad-bf17-f7b47295d82b+6:2354:x1876286751460224:12345-192.168.202.23@tcp:1:lfs.0 00010000:00010000:1.0:1789366663.211902:0:6660:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003ac13bbc/0x8da3486b955f3e37 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366663.211923:0:6660:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000d8dc1c1c/0x8da3486b955f3df8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.23@tcp remote: 0xda917a494d06c298 expref: 6 pid: 8065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366663.211931:0:6660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789366663.211934:0:6660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789366663.211937:0:6660:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003ac13bbc/0x8da3486b955f3e37 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366663.211977:0:6660:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000d8dc1c1c/0x8da3486b955f3df8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.23@tcp remote: 0xda917a494d06c298 expref: 6 pid: 8065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366663.211987:0:6660:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000d8dc1c1c/0x8da3486b955f3df8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.23@tcp remote: 0xda917a494d06c298 expref: 6 pid: 8065 timeout: 338 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789366663.211998:0:6660:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9638b703a300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6660:1876286758782976:192.168.202.23@tcp:104: 00000100:00100000:1.0:1789366663.212076:0:6660:0:(client.c:2716:ptlrpc_set_wait()) set ffff96388347a9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789366663.213675:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:0.0:1789366663.213749:0:6664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751460352 00000100:00100000:0.0:1789366663.213755:0:6664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751460352 00002000:00100000:0.0:1789366663.213790:0:6664:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x5:0x0] (0->8) req@ffff9638b703b100 x1876286751460352/t0(0) o4->0ab23baa-a205-44ad-bf17-f7b47295d82b@192.168.202.23@tcp:64/0 lens 504/0 e 0 to 0 dl 1789366674 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789366663.213802:0:6664:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9638b703b100 with x1876286751460352 ext(0->8) 00010000:00010000:0.0:1789366663.213810:0:6664:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000d8dc1c1c/0x8da3486b955f3df8 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.23@tcp remote: 0xda917a494d06c298 expref: 7 pid: 8065 timeout: 338 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366663.213825:0:6664:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000d8dc1c1c/0x8da3486b955f3df8 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.23@tcp remote: 0xda917a494d06c298 expref: 7 pid: 8065 timeout: 338 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789366663.213834:0:6664:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9638b703b100 00000100:00100000:0.0:1789366663.213853:0:6664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 2 00000100:00100000:0.0:1789366663.213861:0:6664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638b703b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0ab23baa-a205-44ad-bf17-f7b47295d82b+7:2354:x1876286751460352:12345-192.168.202.23@tcp:4:lfs.0 00000100:00100000:3.0:1789366663.213871:0:6660:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9638b703a300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6660:1876286758782976:192.168.202.23@tcp:104: 00010000:00010000:3.0:1789366663.213908:0:6660:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000003ac13bbc/0x8da3486b955f3e37 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789366663.214758:0:6664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638b703b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0ab23baa-a205-44ad-bf17-f7b47295d82b+9:2354:x1876286751460352:12345-192.168.202.23@tcp:4:lfs.0 Request processed in 896us (1086us total) trans 4294967308 rc 0/0 00000100:00100000:0.0:1789366663.214767:0:6664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 2 00002000:00100000:0.0:1789366663.214776:0:6664:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x5:0x0] (0->8) req@ffff9638b703b100 x1876286751460352/t4294967308(0) o4->0ab23baa-a205-44ad-bf17-f7b47295d82b@192.168.202.23@tcp:64/0 lens 504/448 e 0 to 0 dl 1789366674 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789366663.214783:0:6664:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9638b703b100 with x1876286751460352 ext(0->8) 00010000:00010000:0.0:1789366663.214793:0:6664:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000d8dc1c1c/0x8da3486b955f3df8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.23@tcp remote: 0xda917a494d06c298 expref: 9 pid: 8065 timeout: 338 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366663.214806:0:6664:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000d8dc1c1c/0x8da3486b955f3df8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.23@tcp remote: 0xda917a494d06c298 expref: 9 pid: 8065 timeout: 338 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789366663.214813:0:6664:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9638b703b100 00000100:00100000:0.0:1789366663.216207:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:2.0:1789366663.216256:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751460480 00000100:00100000:2.0:1789366663.216264:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751460480 00010000:00010000:2.0:1789366663.216293:0:5803:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000d8dc1c1c/0x8da3486b955f3df8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.23@tcp remote: 0xda917a494d06c298 expref: 9 pid: 8065 timeout: 338 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789366663.216334:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 77 00000100:00100000:2.0:1789366663.216343:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638aef21c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0ab23baa-a205-44ad-bf17-f7b47295d82b+9:2354:x1876286751460480:12345-192.168.202.23@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789366663.216355:0:5803:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1789366663.216380:0:5803:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:2.0:1789366663.216383:0:5803:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb mtime from disk: 0 -> 1789366663 00002000:00010000:2.0:1789366663.216386:0:5803:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb atime from disk: 0 -> 1789366663 00002000:00010000:2.0:1789366663.216388:0:5803:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb ctime from disk: 0 -> 1789366663 00010000:00010000:2.0:1789366663.216393:0:5803:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000d8dc1c1c/0x8da3486b955f3df8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.23@tcp remote: 0xda917a494d06c298 expref: 9 pid: 8065 timeout: 338 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366663.216405:0:5803:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000d8dc1c1c/0x8da3486b955f3df8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.23@tcp remote: 0xda917a494d06c298 expref: 9 pid: 8065 timeout: 338 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366663.216447:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d8dc1c1c/0x8da3486b955f3df8 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.23@tcp remote: 0xda917a494d06c298 expref: 9 pid: 8065 timeout: 338 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366663.216462:0:5803:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789366663.216467:0:5803:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789366663.216472:0:5803:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000003ac13bbc/0x8da3486b955f3e37 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366663.216489:0:5803:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003ac13bbc/0x8da3486b955f3e37 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366663.216517:0:5803:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789366663.216541:0:6660:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000003ac13bbc/0x8da3486b955f3e37 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366663.216553:0:6660:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003ac13bbc/0x8da3486b955f3e37 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789366663.216563:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638aef21c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0ab23baa-a205-44ad-bf17-f7b47295d82b+8:2354:x1876286751460480:12345-192.168.202.23@tcp:103:ldlm_bl.0 Request processed in 220us (358us total) trans 0 rc 0/0 00000100:00100000:2.0:1789366663.216578:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 77 00010000:00010000:3.0:1789366663.216594:0:6660:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003ac13bbc/0x8da3486b955f3e37 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366663.216605:0:6660:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003ac13bbc/0x8da3486b955f3e37 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366663.216614:0:6660:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003ac13bbc/0x8da3486b955f3e37 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366663.216621:0:6660:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9638b6ce3600 already unused, calling callback (ffffffffc16df520) 00010000:00010000:3.0:1789366663.216627:0:6660:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003ac13bbc/0x8da3486b955f3e37 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366663.216637:0:6660:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003ac13bbc/0x8da3486b955f3e37 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366663.216651:0:6660:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003ac13bbc/0x8da3486b955f3e37 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366663.216672:0:6660:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003ac13bbc/0x8da3486b955f3e37 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789366663.216823:0:6660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638b7035500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0ab23baa-a205-44ad-bf17-f7b47295d82b+7:2354:x1876286751460224:12345-192.168.202.23@tcp:1:lfs.0 Request processed in 4961us (5479us total) trans 0 rc 0/0 00000100:00100000:3.0:1789366663.216832:0:6660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 62 00000100:00100000:0.0:1789366663.217898:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:3.0:1789366663.217939:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751460736 00000100:00100000:3.0:1789366663.217946:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751460736 00000100:00100000:3.0:1789366663.218046:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 53 00000100:00100000:3.0:1789366663.218056:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638aef22680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0ab23baa-a205-44ad-bf17-f7b47295d82b+42:11574:x1876286751460736:12345-192.168.202.23@tcp:35:lfs.0 00000004:00010000:3.0:1789366663.218117:0:5819:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0xe:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c8200/0x8da3486b955f3e29 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.23@tcp remote: 0xda917a494d06c2ad expref: 42 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789366663.218374:0:5819:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967480 00000001:00080000:3.0:1789366663.218423:0:5819:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967481 00000001:00080000:3.0:1789366663.220406:0:5819:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967482 00010000:00010000:3.0:1789366663.220463:0:5819:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9638832d2000/0x8da3486b955f3e3e lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366663.220477:0:5819:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9638b6ce2800/0x8da3486b955f3de3 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.23@tcp remote: 0xda917a494d06c28a expref: 46 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366663.220484:0:5819:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9638832d2000/0x8da3486b955f3e3e lrc: 4/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366663.220526:0:5819:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9638b6ce2800/0x8da3486b955f3de3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.23@tcp remote: 0xda917a494d06c28a expref: 46 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366663.220537:0:5819:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9638b6ce2800/0x8da3486b955f3de3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.23@tcp remote: 0xda917a494d06c28a expref: 46 pid: 5817 timeout: 338 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789366663.220547:0:5819:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9638b7034e00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5819:1876286758783104:192.168.202.23@tcp:104: 00000100:00100000:3.0:1789366663.220649:0:5819:0:(client.c:2716:ptlrpc_set_wait()) set ffff9638a74929c0 going to sleep for 11 seconds 00010000:00010000:1.0:1789366663.226443:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789366663.226478:0:5819:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9638b7034e00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5819:1876286758783104:192.168.202.23@tcp:104: 00010000:00010000:3.0:1789366663.226521:0:5819:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9638832d2000/0x8da3486b955f3e3e lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789366663.226777:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:3.0:1789366663.227169:0:8419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751460864 00000100:00100000:3.0:1789366663.227176:0:8419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751460864 00010000:00010000:3.0:1789366663.227213:0:8419:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9638b6ce2800/0x8da3486b955f3de3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.23@tcp remote: 0xda917a494d06c28a expref: 47 pid: 5817 timeout: 338 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789366663.227249:0:8419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 78 00000100:00100000:3.0:1789366663.227259:0:8419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638af2eaa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0ab23baa-a205-44ad-bf17-f7b47295d82b+47:2355:x1876286751460864:12345-192.168.202.23@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789366663.227274:0:8419:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789366663.227282:0:8419:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9638b6ce2800/0x8da3486b955f3de3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.23@tcp remote: 0xda917a494d06c28a expref: 47 pid: 5817 timeout: 338 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366663.227295:0:8419:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9638b6ce2800/0x8da3486b955f3de3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.23@tcp remote: 0xda917a494d06c28a expref: 47 pid: 5817 timeout: 338 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366663.227316:0:8419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9638b6ce2800/0x8da3486b955f3de3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.23@tcp remote: 0xda917a494d06c28a expref: 47 pid: 5817 timeout: 338 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366663.227331:0:8419:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff963887f88d00) 00010000:00010000:3.0:1789366663.227336:0:8419:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9638832d2000/0x8da3486b955f3e3e lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366663.227346:0:8419:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9638832d2000/0x8da3486b955f3e3e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366663.227354:0:8419:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9638832d2000/0x8da3486b955f3e3e lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366663.227392:0:8419:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789366663.227445:0:8419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638af2eaa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0ab23baa-a205-44ad-bf17-f7b47295d82b+46:2355:x1876286751460864:12345-192.168.202.23@tcp:103:ldlm_bl.0 Request processed in 187us (670us total) trans 0 rc 0/0 00000100:00100000:3.0:1789366663.227453:0:8419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 78 00010000:00010000:2.0:1789366663.227519:0:5819:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9638832d2000/0x8da3486b955f3e3e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366663.227526:0:5819:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9638832d2000/0x8da3486b955f3e3e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789366663.227629:0:5819:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967483 00000001:00080000:2.0:1789366663.227865:0:5819:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967484 00000100:00100000:2.0:1789366663.227948:0:5819:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff963882ee0380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5819:1876286758783232:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1789366663.227985:0:5819:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789366663.228031:0:5819:0:(client.c:2716:ptlrpc_set_wait()) set ffff9638b72dc6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789366663.228034:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286758783232 00000100:00100000:1.0:1789366663.228041:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286758783232 00000100:00100000:1.0:1789366663.228084:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1789366663.228093:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638b73fa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:5819:x1876286758783232:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1789366663.228181:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638b73fa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:5819:x1876286758783232:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 89us (193us total) trans 0 rc 0/0 00000100:00100000:1.0:1789366663.228189:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1789366663.228271:0:5819:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff963882ee0380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5819:1876286758783232:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:2.0:1789366663.228550:0:5819:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967485 00000100:00100000:2.0:1789366663.228583:0:5819:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9638b73f9500 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5819:1876286758783360:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1789366663.228601:0:5819:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789366663.228623:0:5819:0:(client.c:2716:ptlrpc_set_wait()) set ffff9638b72dc840 going to sleep for 11 seconds 00000100:00100000:1.0:1789366663.228737:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286758783360 00000100:00100000:1.0:1789366663.228741:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286758783360 00000100:00100000:1.0:1789366663.228765:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1789366663.228772:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638b73f8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:5819:x1876286758783360:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1789366663.228928:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638b73f8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+8:5819:x1876286758783360:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 156us (324us total) trans 4294967309 rc 0/0 00000100:00100000:1.0:1789366663.228935:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1789366663.228984:0:5819:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9638b73f9500 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5819:1876286758783360:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:2.0:1789366663.229015:0:5819:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967486 00010000:00010000:2.0:1789366663.229045:0:5819:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9638832d2000/0x8da3486b955f3e3e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366663.229054:0:5819:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9638832d2000/0x8da3486b955f3e3e lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366663.229062:0:5819:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9638832d2000/0x8da3486b955f3e3e lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366663.229068:0:5819:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9638832d2000 already unused, calling callback (ffffffffc20ee4f0) 00010000:00010000:2.0:1789366663.229073:0:5819:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9638832d2000/0x8da3486b955f3e3e lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366663.229082:0:5819:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9638832d2000/0x8da3486b955f3e3e lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366663.229094:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff963887f88d00) 00010000:00010000:2.0:1789366663.229097:0:5819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:2.0:1789366663.229101:0:5819:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9638832d2000/0x8da3486b955f3e3e lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366663.229108:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9638832d2000/0x8da3486b955f3e3e lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1789366663.229262:0:5819:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0xf:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:2.0:1789366663.229354:0:5819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].5, 64 off8512 00000004:00080000:2.0:1789366663.229365:0:5819:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 238693646229ns, next at 239693643875ns, rc = 0 00000001:00080000:2.0:1789366663.229371:0:5819:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967487 00010000:00010000:2.0:1789366663.229397:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff963887f88d00) 00010000:00010000:2.0:1789366663.229400:0:5819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1789366663.229406:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c8200/0x8da3486b955f3e29 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.23@tcp remote: 0xda917a494d06c2ad expref: 50 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789366663.229478:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638aef22680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0ab23baa-a205-44ad-bf17-f7b47295d82b+49:11574:x1876286751460736:12345-192.168.202.23@tcp:35:lfs.0 Request processed in 11425us (11583us total) trans 4294967488 rc 0/0 00000100:00100000:2.0:1789366663.229484:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 53 00000020:00080000:2.0:1789366663.229486:0:5819:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:0.0:1789366663.231786:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:2.0:1789366663.231910:0:7614:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751460992 00000100:00100000:2.0:1789366663.231917:0:7614:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751460992 00000100:00100000:2.0:1789366663.231953:0:7614:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 201 00000100:00100000:2.0:1789366663.231960:0:7614:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638af2eb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0ab23baa-a205-44ad-bf17-f7b47295d82b+49:11574:x1876286751460992:12345-192.168.202.23@tcp:101:lfs.0 00010000:00010000:2.0:1789366663.231977:0:7614:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789366663.231992:0:7614:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c8a00/0x8da3486b955f3e45 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xda917a494d06c2b4 expref: -99 pid: 7614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366663.232042:0:7614:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c8a00/0x8da3486b955f3e45 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.23@tcp remote: 0xda917a494d06c2b4 expref: 50 pid: 7614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366663.232056:0:7614:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c8a00/0x8da3486b955f3e45 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.23@tcp remote: 0xda917a494d06c2b4 expref: 50 pid: 7614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366663.232075:0:7614:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9638a7404700) 00010000:00010000:2.0:1789366663.232078:0:7614:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789366663.232093:0:7614:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9638902c8a00, rc 0) 00000100:00100000:2.0:1789366663.232178:0:7614:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638af2eb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0ab23baa-a205-44ad-bf17-f7b47295d82b+50:11574:x1876286751460992:12345-192.168.202.23@tcp:101:lfs.0 Request processed in 217us (397us total) trans 0 rc 0/0 00000100:00100000:2.0:1789366663.232185:0:7614:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 201 00000100:00100000:0.0:1789366663.235431:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:1.0:1789366663.235547:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751461248 00000100:00100000:1.0:1789366663.235564:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751461248 00000100:00100000:1.0:1789366663.235608:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 54 00000100:00100000:1.0:1789366663.235618:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638af2e8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0ab23baa-a205-44ad-bf17-f7b47295d82b+50:11574:x1876286751461248:12345-192.168.202.23@tcp:35:lfs.0 00000100:00100000:1.0:1789366663.235861:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638af2e8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0ab23baa-a205-44ad-bf17-f7b47295d82b+51:11574:x1876286751461248:12345-192.168.202.23@tcp:35:lfs.0 Request processed in 244us (435us total) trans 4294967489 rc 0/0 00000100:00100000:1.0:1789366663.235869:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 54 00000100:00100000:3.0:1789366663.275037:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:1.0:1789366663.275234:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751461376 00000100:00100000:1.0:1789366663.275245:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751461376 00000100:00100000:1.0:1789366663.275307:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 202 00000100:00100000:1.0:1789366663.275317:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638b7034e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0ab23baa-a205-44ad-bf17-f7b47295d82b+51:11584:x1876286751461376:12345-192.168.202.23@tcp:34:lfs.0 00010000:00010000:1.0:1789366663.275563:0:5817:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9638b6ce2e00/0x8da3486b955f3e4c lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366663.275581:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9638b6ce2e00/0x8da3486b955f3e4c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366663.275593:0:5817:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9638b6ce2e00/0x8da3486b955f3e4c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366663.275607:0:5817:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9638b6ce3000/0x8da3486b955f3e53 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366663.275615:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9638b6ce3000/0x8da3486b955f3e53 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366663.275622:0:5817:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9638b6ce3000/0x8da3486b955f3e53 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366663.275714:0:5817:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9638b6ce2800/0x8da3486b955f3e5a lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366663.275761:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9638b6ce2800/0x8da3486b955f3e5a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366663.275769:0:5817:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9638b6ce2800/0x8da3486b955f3e5a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789366663.275809:0:5817:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9638b6ce2800/0x8da3486b955f3e5a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366663.275829:0:5817:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9638b6ce2e00/0x8da3486b955f3e4c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366663.275836:0:5817:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9638b6ce2e00/0x8da3486b955f3e4c lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366663.275842:0:5817:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9638b6ce2e00/0x8da3486b955f3e4c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366663.275848:0:5817:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9638b6ce2e00 already unused, calling callback (ffffffffc20ee4f0) 00010000:00010000:1.0:1789366663.275852:0:5817:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9638b6ce2e00/0x8da3486b955f3e4c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366663.275860:0:5817:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9638b6ce2e00/0x8da3486b955f3e4c lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366663.275871:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff963890797800) 00010000:00010000:1.0:1789366663.275874:0:5817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789366663.275878:0:5817:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9638b6ce2e00/0x8da3486b955f3e4c lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366663.275885:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9638b6ce2e00/0x8da3486b955f3e4c lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366663.275907:0:5817:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9638b6ce3000/0x8da3486b955f3e53 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366663.275912:0:5817:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9638b6ce3000/0x8da3486b955f3e53 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366663.275918:0:5817:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9638b6ce3000/0x8da3486b955f3e53 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366663.275924:0:5817:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9638b6ce3000 already unused, calling callback (ffffffffc20ee4f0) 00010000:00010000:1.0:1789366663.275927:0:5817:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9638b6ce3000/0x8da3486b955f3e53 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366663.275932:0:5817:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9638b6ce3000/0x8da3486b955f3e53 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366663.275940:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff963887f88000) 00010000:00010000:1.0:1789366663.275943:0:5817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789366663.275946:0:5817:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9638b6ce3000/0x8da3486b955f3e53 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366663.275952:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9638b6ce3000/0x8da3486b955f3e53 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366663.275966:0:5817:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9638b6ce2800/0x8da3486b955f3e5a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366663.275972:0:5817:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9638b6ce2800/0x8da3486b955f3e5a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366663.275977:0:5817:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9638b6ce2800/0x8da3486b955f3e5a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366663.275988:0:5817:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9638b6ce2800 already unused, calling callback (ffffffffc20ee4f0) 00010000:00010000:1.0:1789366663.275991:0:5817:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9638b6ce2800/0x8da3486b955f3e5a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366663.275997:0:5817:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9638b6ce2800/0x8da3486b955f3e5a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366663.276005:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9638a7404700) 00010000:00010000:1.0:1789366663.276007:0:5817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789366663.276010:0:5817:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9638b6ce2800/0x8da3486b955f3e5a lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366663.276016:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9638b6ce2800/0x8da3486b955f3e5a lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789366663.276793:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638b7034e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0ab23baa-a205-44ad-bf17-f7b47295d82b+51:11584:x1876286751461376:12345-192.168.202.23@tcp:34:lfs.0 Request processed in 1475us (1763us total) trans 0 rc 0/0 00000100:00100000:1.0:1789366663.276803:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 202 00000100:00100000:0.0:1789366663.297030:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:2.0:1789366663.297100:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751461632 00000100:00100000:2.0:1789366663.297111:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751461632 00000100:00100000:2.0:1789366663.297196:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 203 00000100:00100000:2.0:1789366663.297208:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638af2e9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0ab23baa-a205-44ad-bf17-f7b47295d82b+51:11587:x1876286751461632:12345-192.168.202.23@tcp:101:lfs.0 00010000:00010000:2.0:1789366663.297228:0:5815:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789366663.297248:0:5815:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c8200/0x8da3486b955f3e61 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xda917a494d06c2bb expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366663.297319:0:5815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9800/0x8da3486b955f3e68 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366663.297337:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9800/0x8da3486b955f3e68 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366663.297358:0:5815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9800/0x8da3486b955f3e68 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366663.297372:0:5815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9600/0x8da3486b955f3e6f lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366663.297380:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9600/0x8da3486b955f3e6f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366663.297386:0:5815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9600/0x8da3486b955f3e6f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366663.297529:0:5815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c8e00/0x8da3486b955f3e76 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366663.297550:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c8e00/0x8da3486b955f3e76 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366663.297558:0:5815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c8e00/0x8da3486b955f3e76 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789366663.297568:0:5815:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:2.0:1789366663.297672:0:5815:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9800/0x8da3486b955f3e68 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366663.297679:0:5815:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9800/0x8da3486b955f3e68 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366663.297686:0:5815:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9800/0x8da3486b955f3e68 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366663.297691:0:5815:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9638902c9800 already unused, calling callback (ffffffffc20ee4f0) 00010000:00010000:2.0:1789366663.297695:0:5815:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9800/0x8da3486b955f3e68 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366663.297703:0:5815:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9800/0x8da3486b955f3e68 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366663.297743:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff963890797800) 00010000:00010000:2.0:1789366663.297747:0:5815:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789366663.297752:0:5815:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9800/0x8da3486b955f3e68 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366663.297759:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9800/0x8da3486b955f3e68 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366663.297772:0:5815:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9600/0x8da3486b955f3e6f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366663.297783:0:5815:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9600/0x8da3486b955f3e6f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366663.297789:0:5815:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9600/0x8da3486b955f3e6f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366663.297794:0:5815:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9638902c9600 already unused, calling callback (ffffffffc20ee4f0) 00010000:00010000:2.0:1789366663.297798:0:5815:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9600/0x8da3486b955f3e6f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366663.297803:0:5815:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9600/0x8da3486b955f3e6f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366663.297819:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9638a7404400) 00010000:00010000:2.0:1789366663.297830:0:5815:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789366663.297833:0:5815:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9600/0x8da3486b955f3e6f lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366663.297839:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9600/0x8da3486b955f3e6f lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366663.297877:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c8200/0x8da3486b955f3e61 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.23@tcp remote: 0xda917a494d06c2bb expref: 54 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366663.297891:0:5815:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c8e00/0x8da3486b955f3e76 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.23@tcp remote: 0xda917a494d06c2bb expref: 53 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366663.297897:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9638a7404700) 00010000:00010000:2.0:1789366663.297900:0:5815:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789366663.297908:0:5815:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9638902c8e00, rc 0) 00000100:00100000:2.0:1789366663.297966:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638af2e9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0ab23baa-a205-44ad-bf17-f7b47295d82b+53:11587:x1876286751461632:12345-192.168.202.23@tcp:101:lfs.0 Request processed in 760us (945us total) trans 4294967490 rc 0/0 00000100:00100000:2.0:1789366663.297973:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 203 00000100:00100000:0.0:1789366663.300013:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:2.0:1789366663.300089:0:7132:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751461760 00000100:00100000:2.0:1789366663.300097:0:7132:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751461760 00000100:00100000:2.0:1789366663.300175:0:7132:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 204 00000100:00100000:2.0:1789366663.300186:0:7132:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638af2ebb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0ab23baa-a205-44ad-bf17-f7b47295d82b+53:11587:x1876286751461760:12345-192.168.202.23@tcp:54:lfs.0 00010000:00010000:2.0:1789366663.300244:0:7132:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9e00/0x8da3486b955f3e84 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366663.300255:0:7132:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9e00/0x8da3486b955f3e84 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366663.300263:0:7132:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9e00/0x8da3486b955f3e84 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366663.300282:0:7132:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9e00/0x8da3486b955f3e84 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366663.300287:0:7132:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9e00/0x8da3486b955f3e84 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366663.300302:0:7132:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9e00/0x8da3486b955f3e84 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366663.300310:0:7132:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9638902c9e00 already unused, calling callback (ffffffffc20ee4f0) 00010000:00010000:2.0:1789366663.300313:0:7132:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9e00/0x8da3486b955f3e84 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366663.300318:0:7132:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9e00/0x8da3486b955f3e84 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366663.300334:0:7132:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9638a7404700) 00010000:00010000:2.0:1789366663.300336:0:7132:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789366663.300339:0:7132:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9e00/0x8da3486b955f3e84 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366663.300344:0:7132:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9e00/0x8da3486b955f3e84 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789366663.300409:0:7132:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638af2ebb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0ab23baa-a205-44ad-bf17-f7b47295d82b+53:11587:x1876286751461760:12345-192.168.202.23@tcp:54:lfs.0 Request processed in 225us (404us total) trans 0 rc 0/0 00000100:00100000:2.0:1789366663.300419:0:7132:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 204 00000100:00100000:0.0:1789366663.302506:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:2.0:1789366663.302559:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751462016 00000100:00100000:2.0:1789366663.302567:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751462016 00000100:00100000:2.0:1789366663.302624:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 55 00000100:00100000:2.0:1789366663.302633:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963888cba050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0ab23baa-a205-44ad-bf17-f7b47295d82b+53:11587:x1876286751462016:12345-192.168.202.23@tcp:35:lfs.0 00000100:00100000:2.0:1789366663.302872:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963888cba050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0ab23baa-a205-44ad-bf17-f7b47295d82b+54:11587:x1876286751462016:12345-192.168.202.23@tcp:35:lfs.0 Request processed in 239us (374us total) trans 4294967491 rc 0/0 00000100:00100000:2.0:1789366663.302879:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 55 00000100:00100000:3.0:1789366663.344822:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:1.0:1789366663.345288:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751462272 00000100:00100000:1.0:1789366663.345297:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751462272 00000100:00100000:1.0:1789366663.345414:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 205 00000100:00100000:1.0:1789366663.345436:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638b7036300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0ab23baa-a205-44ad-bf17-f7b47295d82b+54:11597:x1876286751462272:12345-192.168.202.23@tcp:101:bash.0 00010000:00010000:1.0:1789366663.345465:0:5817:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789366663.345468:0:5817:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1789366663.345493:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9638b6ce2600/0x8da3486b955f3e06 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.23@tcp remote: 0xda917a494d06c29f expref: 54 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366663.345513:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff963890797800) 00010000:00010000:1.0:1789366663.345530:0:5817:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789366663.345544:0:5817:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9638b6ce2800/0x8da3486b955f3e8b lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xda917a494d06c2c2 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366663.345637:0:5817:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9638b6ce3000/0x8da3486b955f3e92 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366663.345647:0:5817:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c8e00/0x8da3486b955f3e76 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.23@tcp remote: 0xda917a494d06c2bb expref: 54 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366663.345652:0:5817:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9638b6ce3000/0x8da3486b955f3e92 lrc: 4/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366663.345676:0:5817:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c8e00/0x8da3486b955f3e76 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.23@tcp remote: 0xda917a494d06c2bb expref: 54 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366663.345685:0:5817:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c8e00/0x8da3486b955f3e76 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.23@tcp remote: 0xda917a494d06c2bb expref: 54 pid: 5815 timeout: 338 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789366663.345694:0:5817:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9638b7038380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5817:1876286758783488:192.168.202.23@tcp:104: 00000100:00100000:1.0:1789366663.345850:0:5817:0:(client.c:2716:ptlrpc_set_wait()) set ffff96388347acc0 going to sleep for 11 seconds 00000100:00100000:1.0:1789366663.349321:0:5817:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9638b7038380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5817:1876286758783488:192.168.202.23@tcp:104: 00000100:00100000:0.0:1789366663.349322:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00010000:00010000:1.0:1789366663.349352:0:5817:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9638b6ce3000/0x8da3486b955f3e92 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789366663.349381:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751462400 00000100:00100000:2.0:1789366663.349389:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751462400 00010000:00010000:2.0:1789366663.349424:0:5803:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c8e00/0x8da3486b955f3e76 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.23@tcp remote: 0xda917a494d06c2bb expref: 55 pid: 5815 timeout: 338 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789366663.349673:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 79 00000100:00100000:2.0:1789366663.349683:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638af2e9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0ab23baa-a205-44ad-bf17-f7b47295d82b+55:2354:x1876286751462400:12345-192.168.202.23@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789366663.349697:0:5803:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789366663.349746:0:5803:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c8e00/0x8da3486b955f3e76 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.23@tcp remote: 0xda917a494d06c2bb expref: 55 pid: 5815 timeout: 338 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366663.349760:0:5803:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c8e00/0x8da3486b955f3e76 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.23@tcp remote: 0xda917a494d06c2bb expref: 55 pid: 5815 timeout: 338 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366663.349783:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c8e00/0x8da3486b955f3e76 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.23@tcp remote: 0xda917a494d06c2bb expref: 55 pid: 5815 timeout: 338 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366663.349798:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9638a7404700) 00010000:00010000:2.0:1789366663.349804:0:5803:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9638b6ce3000/0x8da3486b955f3e92 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366663.349814:0:5803:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9638b6ce3000/0x8da3486b955f3e92 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366663.349823:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9638b6ce3000/0x8da3486b955f3e92 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366663.349847:0:5803:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789366663.349895:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638af2e9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0ab23baa-a205-44ad-bf17-f7b47295d82b+54:2354:x1876286751462400:12345-192.168.202.23@tcp:103:ldlm_bl.0 Request processed in 214us (580us total) trans 0 rc 0/0 00000100:00100000:2.0:1789366663.349903:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 79 00010000:00010000:1.0:1789366663.349956:0:5817:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9638b6ce3000/0x8da3486b955f3e92 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366663.349963:0:5817:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9638b6ce3000/0x8da3486b955f3e92 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789366663.349985:0:5817:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:1.0:1789366663.350114:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9638b6ce2800/0x8da3486b955f3e8b lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.23@tcp remote: 0xda917a494d06c2c2 expref: 55 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366663.350142:0:5817:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9638b6ce3000/0x8da3486b955f3e92 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.23@tcp remote: 0xda917a494d06c2c2 expref: 54 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366663.350150:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9638a7404700) 00010000:00010000:1.0:1789366663.350153:0:5817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1789366663.350155:0:5817:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9638b6ce3000, rc 0) 00000100:00100000:1.0:1789366663.350177:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638b7036300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0ab23baa-a205-44ad-bf17-f7b47295d82b+54:11597:x1876286751462272:12345-192.168.202.23@tcp:101:bash.0 Request processed in 4745us (5367us total) trans 4294967492 rc 0/0 00000100:00100000:1.0:1789366663.350184:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 205 00000100:00100000:2.0:1789366663.353874:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:3.0:1789366663.353961:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751462656 00000100:00100000:3.0:1789366663.353972:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751462656 00000100:00100000:3.0:1789366663.354023:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 206 00000100:00100000:3.0:1789366663.354033:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638aef21180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0ab23baa-a205-44ad-bf17-f7b47295d82b+54:11597:x1876286751462656:12345-192.168.202.23@tcp:36:bash.0 00010000:00010000:3.0:1789366663.354275:0:5815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9638832d3400/0x8da3486b955f3ea0 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366663.354291:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9638832d3400/0x8da3486b955f3ea0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366663.354302:0:5815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9638832d3400/0x8da3486b955f3ea0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789366663.354347:0:5815:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967493 00000004:00010000:3.0:1789366663.354367:0:5815:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000dcd61c41 reply state 000000004a31a455 transno 4294967494 ns: mdt-lustre-MDT0000_UUID lock: ffff9638832d3400/0x8da3486b955f3ea0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789366663.354375:0:5815:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789366663.354755:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638aef21180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0ab23baa-a205-44ad-bf17-f7b47295d82b+57:11597:x1876286751462656:12345-192.168.202.23@tcp:36:bash.0 Request processed in 722us (891us total) trans 4294967494 rc 0/0 00000100:00100000:3.0:1789366663.354763:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 206 00000020:00080000:3.0:1789366663.354768:0:5815:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1789366663.361434:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00010000:00010000:1.0:1789366663.361506:0:3271:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9638832d3400/0x8da3486b955f3ea0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366663.361520:0:3271:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9638832d3400/0x8da3486b955f3ea0 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789366663.361524:0:7132:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751462784 00010000:00010000:1.0:1789366663.361528:0:3271:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9638832d3400/0x8da3486b955f3ea0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366663.361535:0:3271:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9638832d3400 already unused, calling callback (ffffffffc20ee4f0) 00000100:00100000:2.0:1789366663.361536:0:7132:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751462784 00010000:00010000:1.0:1789366663.361541:0:3271:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9638832d3400/0x8da3486b955f3ea0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366663.361551:0:3271:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9638832d3400/0x8da3486b955f3ea0 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366663.361582:0:3271:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9638a7404700) 00010000:00010000:1.0:1789366663.361585:0:3271:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789366663.361590:0:3271:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9638832d3400/0x8da3486b955f3ea0 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366663.361597:0:3271:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9638832d3400/0x8da3486b955f3ea0 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789366663.361611:0:7132:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 207 00000100:00100000:2.0:1789366663.361624:0:7132:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638b7037100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0ab23baa-a205-44ad-bf17-f7b47295d82b+56:11597:x1876286751462784:12345-192.168.202.23@tcp:101:bash.0 00010000:00010000:2.0:1789366663.361646:0:7132:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789366663.361669:0:7132:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c8200/0x8da3486b955f3ea7 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xda917a494d06c2c9 expref: -99 pid: 7132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366663.361759:0:7132:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9600/0x8da3486b955f3eae lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366663.361773:0:7132:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9638b6ce3000/0x8da3486b955f3e92 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.23@tcp remote: 0xda917a494d06c2c2 expref: 57 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366663.361781:0:7132:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9600/0x8da3486b955f3eae lrc: 4/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366663.362395:0:7132:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9638b6ce3000/0x8da3486b955f3e92 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.23@tcp remote: 0xda917a494d06c2c2 expref: 57 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366663.362412:0:7132:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9638b6ce3000/0x8da3486b955f3e92 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.23@tcp remote: 0xda917a494d06c2c2 expref: 57 pid: 5817 timeout: 338 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789366663.362426:0:7132:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9638aef22300 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7132:1876286758783616:192.168.202.23@tcp:104: 00000100:00100000:2.0:1789366663.362679:0:7132:0:(client.c:2716:ptlrpc_set_wait()) set ffff9638b72dcb40 going to sleep for 11 seconds 00000100:00100000:2.0:1789366663.365252:0:7132:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9638aef22300 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7132:1876286758783616:192.168.202.23@tcp:104: 00010000:00010000:2.0:1789366663.365281:0:7132:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9600/0x8da3486b955f3eae lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789366663.365768:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:1.0:1789366663.365913:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751462912 00000100:00100000:1.0:1789366663.365921:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751462912 00010000:00010000:1.0:1789366663.365960:0:5802:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9638b6ce3000/0x8da3486b955f3e92 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.23@tcp remote: 0xda917a494d06c2c2 expref: 58 pid: 5817 timeout: 338 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789366663.365995:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 80 00000100:00100000:1.0:1789366663.366005:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638b7034380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0ab23baa-a205-44ad-bf17-f7b47295d82b+58:2355:x1876286751462912:12345-192.168.202.23@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789366663.366019:0:5802:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789366663.366027:0:5802:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9638b6ce3000/0x8da3486b955f3e92 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.23@tcp remote: 0xda917a494d06c2c2 expref: 58 pid: 5817 timeout: 338 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366663.366039:0:5802:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9638b6ce3000/0x8da3486b955f3e92 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.23@tcp remote: 0xda917a494d06c2c2 expref: 58 pid: 5817 timeout: 338 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366663.366061:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9638b6ce3000/0x8da3486b955f3e92 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.23@tcp remote: 0xda917a494d06c2c2 expref: 58 pid: 5817 timeout: 338 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366663.366076:0:5802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9638a7404700) 00010000:00010000:1.0:1789366663.366081:0:5802:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9600/0x8da3486b955f3eae lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366663.366117:0:5802:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9600/0x8da3486b955f3eae lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366663.366134:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9600/0x8da3486b955f3eae lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366663.366164:0:5802:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789366663.366282:0:7132:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9600/0x8da3486b955f3eae lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366663.366290:0:7132:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9600/0x8da3486b955f3eae lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789366663.366341:0:7132:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:2.0:1789366663.366358:0:7132:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1789366663.366379:0:7132:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9600/0x8da3486b955f3eae lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366663.366407:0:7132:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c8200/0x8da3486b955f3ea7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.23@tcp remote: 0xda917a494d06c2c9 expref: 58 pid: 7132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366663.366421:0:7132:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9600/0x8da3486b955f3eae lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.23@tcp remote: 0xda917a494d06c2c9 expref: 57 pid: 7132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366663.366428:0:7132:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9638a7404700) 00010000:00010000:2.0:1789366663.366430:0:7132:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789366663.366433:0:7132:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9638902c9600, rc 0) 00000100:00100000:1.0:1789366663.366476:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638b7034380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0ab23baa-a205-44ad-bf17-f7b47295d82b+57:2355:x1876286751462912:12345-192.168.202.23@tcp:103:ldlm_bl.0 Request processed in 472us (708us total) trans 0 rc 0/0 00000100:00100000:1.0:1789366663.366484:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 80 00000100:00100000:2.0:1789366663.368150:0:7132:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638b7037100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0ab23baa-a205-44ad-bf17-f7b47295d82b+56:11597:x1876286751462784:12345-192.168.202.23@tcp:101:bash.0 Request processed in 6521us (6716us total) trans 0 rc 0/0 00000100:00100000:2.0:1789366663.368161:0:7132:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 207 00000100:00100000:1.0:1789366663.372611:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:2.0:1789366663.372885:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751463168 00000100:00100000:2.0:1789366663.372896:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751463168 00000100:00100000:2.0:1789366663.372984:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 56 00000100:00100000:2.0:1789366663.372996:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638b7038380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0ab23baa-a205-44ad-bf17-f7b47295d82b+56:11597:x1876286751463168:12345-192.168.202.23@tcp:35:bash.0 00000100:00100000:2.0:1789366663.373243:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638b7038380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0ab23baa-a205-44ad-bf17-f7b47295d82b+57:11597:x1876286751463168:12345-192.168.202.23@tcp:35:bash.0 Request processed in 249us (639us total) trans 4294967495 rc 0/0 00000100:00100000:2.0:1789366663.373251:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 56 00000100:00100000:0.0:1789366663.425404:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:1.0:1789366663.425531:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751463296 00000100:00100000:1.0:1789366663.425541:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751463296 00000100:00100000:1.0:1789366663.426215:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 208 00000100:00100000:1.0:1789366663.426228:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638af2e8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0ab23baa-a205-44ad-bf17-f7b47295d82b+57:11603:x1876286751463296:12345-192.168.202.23@tcp:101:lfs.0 00010000:00010000:1.0:1789366663.426252:0:5817:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789366663.426272:0:5817:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9638b6ce3000/0x8da3486b955f3eb5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xda917a494d06c2d0 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366663.426334:0:5817:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9638b6ce2800/0x8da3486b955f3ebc lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366663.426362:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9638b6ce2800/0x8da3486b955f3ebc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366663.426375:0:5817:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9638b6ce2800/0x8da3486b955f3ebc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789366663.426409:0:5817:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00000004:00200000:1.0:1789366663.426426:0:5817:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1789366663.426446:0:5817:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9638b6ce2800/0x8da3486b955f3ebc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366663.426471:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9638b6ce3000/0x8da3486b955f3eb5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.23@tcp remote: 0xda917a494d06c2d0 expref: 59 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366663.426492:0:5817:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9638b6ce2800/0x8da3486b955f3ebc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.23@tcp remote: 0xda917a494d06c2d0 expref: 58 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366663.426502:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff963890797800) 00010000:00010000:1.0:1789366663.426505:0:5817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789366663.426509:0:5817:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9638b6ce2800, rc 0) 00000100:00100000:1.0:1789366663.426572:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638af2e8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0ab23baa-a205-44ad-bf17-f7b47295d82b+58:11603:x1876286751463296:12345-192.168.202.23@tcp:101:lfs.0 Request processed in 348us (1179us total) trans 0 rc 0/0 00000100:00100000:1.0:1789366663.426580:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 208 00000100:00100000:3.0:1789366663.429232:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:2.0:1789366663.429337:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751463424 00000100:00100000:2.0:1789366663.429344:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751463424 00000100:00100000:2.0:1789366663.429509:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 209 00000100:00100000:2.0:1789366663.429517:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638b7037800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0ab23baa-a205-44ad-bf17-f7b47295d82b+58:11603:x1876286751463424:12345-192.168.202.23@tcp:101:lfs.0 00010000:00010000:2.0:1789366663.429535:0:5815:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789366663.429548:0:5815:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c8e00/0x8da3486b955f3ec3 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xda917a494d06c2d7 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366663.429592:0:5815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9800/0x8da3486b955f3eca lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366663.429602:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9800/0x8da3486b955f3eca lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366663.429610:0:5815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9800/0x8da3486b955f3eca lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366663.429618:0:5815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9000/0x8da3486b955f3ed1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366663.429622:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9000/0x8da3486b955f3ed1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366663.429626:0:5815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9000/0x8da3486b955f3ed1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366663.429692:0:5815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9a00/0x8da3486b955f3ed8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366663.429696:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9a00/0x8da3486b955f3ed8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366663.429700:0:5815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9a00/0x8da3486b955f3ed8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789366663.429751:0:5815:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:2.0:1789366663.429755:0:5815:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1789366663.429767:0:5815:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9a00/0x8da3486b955f3ed8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366663.429775:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9a00/0x8da3486b955f3ed8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366663.429780:0:5815:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9800/0x8da3486b955f3eca lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366663.429784:0:5815:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9800/0x8da3486b955f3eca lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366663.429789:0:5815:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9800/0x8da3486b955f3eca lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366663.429792:0:5815:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9638902c9800 already unused, calling callback (ffffffffc20ee4f0) 00010000:00010000:2.0:1789366663.429796:0:5815:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9800/0x8da3486b955f3eca lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366663.429800:0:5815:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9800/0x8da3486b955f3eca lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366663.429808:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff963890797800) 00010000:00010000:2.0:1789366663.429809:0:5815:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789366663.429813:0:5815:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9800/0x8da3486b955f3eca lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366663.429819:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9800/0x8da3486b955f3eca lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366663.429842:0:5815:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9000/0x8da3486b955f3ed1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366663.429848:0:5815:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9000/0x8da3486b955f3ed1 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366663.429865:0:5815:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9000/0x8da3486b955f3ed1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366663.429871:0:5815:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9638902c9000 already unused, calling callback (ffffffffc20ee4f0) 00010000:00010000:2.0:1789366663.429874:0:5815:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9000/0x8da3486b955f3ed1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366663.429878:0:5815:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9000/0x8da3486b955f3ed1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366663.429883:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9638a7404400) 00010000:00010000:2.0:1789366663.429885:0:5815:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789366663.429886:0:5815:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9000/0x8da3486b955f3ed1 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366663.429890:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9000/0x8da3486b955f3ed1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366663.429913:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c8e00/0x8da3486b955f3ec3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.23@tcp remote: 0xda917a494d06c2d7 expref: 60 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366663.429921:0:5815:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9a00/0x8da3486b955f3ed8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.23@tcp remote: 0xda917a494d06c2d7 expref: 59 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366663.429933:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9638a7404700) 00010000:00010000:2.0:1789366663.429935:0:5815:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789366663.429937:0:5815:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9638902c9a00, rc 0) 00000100:00100000:2.0:1789366663.429983:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638b7037800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0ab23baa-a205-44ad-bf17-f7b47295d82b+59:11603:x1876286751463424:12345-192.168.202.23@tcp:101:lfs.0 Request processed in 467us (758us total) trans 0 rc 0/0 00000100:00100000:2.0:1789366663.429988:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 209 00000100:00100000:2.0:1789366663.437639:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:2.0:1789366663.437687:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:1.0:1789366663.437746:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751463808 00000100:00100000:1.0:1789366663.437756:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751463808 00000100:00100000:0.0:1789366663.437778:0:7132:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751463680 00000100:00100000:0.0:1789366663.437784:0:7132:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751463680 00000100:00100000:0.0:1789366663.437837:0:7132:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 210 00000100:00100000:1.0:1789366663.437855:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 15 00000100:00100000:0.0:1789366663.437863:0:7132:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638aef22300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0ab23baa-a205-44ad-bf17-f7b47295d82b+60:11603:x1876286751463680:12345-192.168.202.23@tcp:101:lfs.0 00000100:00100000:1.0:1789366663.437869:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638aef22680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0ab23baa-a205-44ad-bf17-f7b47295d82b+60:2354:x1876286751463808:12345-192.168.202.23@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789366663.437883:0:5801:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789366663.437884:0:7132:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789366663.437904:0:7132:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720d000/0x8da3486b955f3edf lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xda917a494d06c2de expref: -99 pid: 7132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366663.437906:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9a00/0x8da3486b955f3ed8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.23@tcp remote: 0xda917a494d06c2d7 expref: 60 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366663.437931:0:5801:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9638a7404700) 00010000:00010000:1.0:1789366663.437937:0:5801:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789366663.437981:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638aef22680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0ab23baa-a205-44ad-bf17-f7b47295d82b+60:2354:x1876286751463808:12345-192.168.202.23@tcp:103:ldlm_bl.0 Request processed in 119us (294us total) trans 0 rc 0/0 00000100:00100000:1.0:1789366663.437999:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 15 00010000:00010000:0.0:1789366663.438002:0:7132:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720d200/0x8da3486b955f3ee6 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366663.438016:0:7132:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9600/0x8da3486b955f3eae lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.23@tcp remote: 0xda917a494d06c2c9 expref: 59 pid: 7132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366663.438024:0:7132:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720d200/0x8da3486b955f3ee6 lrc: 4/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366663.438055:0:7132:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9600/0x8da3486b955f3eae lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.23@tcp remote: 0xda917a494d06c2c9 expref: 59 pid: 7132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366663.438069:0:7132:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9600/0x8da3486b955f3eae lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.23@tcp remote: 0xda917a494d06c2c9 expref: 59 pid: 7132 timeout: 338 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789366663.438082:0:7132:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9638af2ead80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7132:1876286758783744:192.168.202.23@tcp:104: 00000100:00100000:0.0:1789366663.438160:0:7132:0:(client.c:2716:ptlrpc_set_wait()) set ffff9638af2e2600 going to sleep for 11 seconds 00000100:00100000:0.0:1789366663.441926:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:2.0:1789366663.443191:0:7132:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9638af2ead80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7132:1876286758783744:192.168.202.23@tcp:104: 00010000:00010000:2.0:1789366663.443219:0:7132:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720d200/0x8da3486b955f3ee6 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789366663.445880:0:8419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751463936 00000100:00100000:3.0:1789366663.445896:0:8419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751463936 00010000:00010000:3.0:1789366663.445951:0:8419:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9600/0x8da3486b955f3eae lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.23@tcp remote: 0xda917a494d06c2c9 expref: 60 pid: 7132 timeout: 338 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789366663.445998:0:8419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 81 00000100:00100000:3.0:1789366663.446009:0:8419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638986c6c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0ab23baa-a205-44ad-bf17-f7b47295d82b+60:2355:x1876286751463936:12345-192.168.202.23@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789366663.446023:0:8419:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789366663.446030:0:8419:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9600/0x8da3486b955f3eae lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.23@tcp remote: 0xda917a494d06c2c9 expref: 60 pid: 7132 timeout: 338 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366663.446044:0:8419:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9600/0x8da3486b955f3eae lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.23@tcp remote: 0xda917a494d06c2c9 expref: 60 pid: 7132 timeout: 338 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366663.446070:0:8419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9600/0x8da3486b955f3eae lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.23@tcp remote: 0xda917a494d06c2c9 expref: 60 pid: 7132 timeout: 338 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366663.446086:0:8419:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9638a7404700) 00010000:00010000:3.0:1789366663.446092:0:8419:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720d200/0x8da3486b955f3ee6 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366663.446102:0:8419:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720d200/0x8da3486b955f3ee6 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366663.446110:0:8419:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720d200/0x8da3486b955f3ee6 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366663.446180:0:8419:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789366663.446251:0:8419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638986c6c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0ab23baa-a205-44ad-bf17-f7b47295d82b+59:2355:x1876286751463936:12345-192.168.202.23@tcp:103:ldlm_bl.0 Request processed in 243us (4334us total) trans 0 rc 0/0 00000100:00100000:3.0:1789366663.446260:0:8419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 81 00010000:00010000:2.0:1789366663.446271:0:7132:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720d200/0x8da3486b955f3ee6 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366663.446280:0:7132:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720d200/0x8da3486b955f3ee6 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789366663.446303:0:7132:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:2.0:1789366663.446444:0:7132:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720d000/0x8da3486b955f3edf lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.23@tcp remote: 0xda917a494d06c2de expref: 60 pid: 7132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366663.446456:0:7132:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720d200/0x8da3486b955f3ee6 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.23@tcp remote: 0xda917a494d06c2de expref: 59 pid: 7132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366663.446462:0:7132:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9638a7404700) 00010000:00010000:2.0:1789366663.446464:0:7132:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1789366663.446471:0:7132:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9638b720d200, rc 0) 00000100:00100000:2.0:1789366663.446491:0:7132:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638aef22300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0ab23baa-a205-44ad-bf17-f7b47295d82b+59:11603:x1876286751463680:12345-192.168.202.23@tcp:101:lfs.0 Request processed in 8634us (8865us total) trans 4294967496 rc 0/0 00000100:00100000:2.0:1789366663.446496:0:7132:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 210 00000100:00100000:3.0:1789366663.449205:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:2.0:1789366663.449281:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751464192 00000100:00100000:2.0:1789366663.449298:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751464192 00000100:00100000:2.0:1789366663.449357:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 16 00000100:00100000:2.0:1789366663.449367:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638b7034380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0ab23baa-a205-44ad-bf17-f7b47295d82b+59:11603:x1876286751464192:12345-192.168.202.23@tcp:103:lfs.0 00010000:00010000:2.0:1789366663.449381:0:5803:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789366663.449404:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c8a00/0x8da3486b955f3e45 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.23@tcp remote: 0xda917a494d06c2b4 expref: 59 pid: 7614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366663.449421:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9638a7404700) 00010000:00010000:2.0:1789366663.449425:0:5803:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789366663.449468:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638b7034380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0ab23baa-a205-44ad-bf17-f7b47295d82b+58:11603:x1876286751464192:12345-192.168.202.23@tcp:103:lfs.0 Request processed in 103us (272us total) trans 0 rc 0/0 00000100:00100000:2.0:1789366663.449473:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 16 00000100:00100000:1.0:1789366663.453845:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:0.0:1789366663.453916:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751464320 00000100:00100000:0.0:1789366663.453924:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751464320 00000100:00100000:0.0:1789366663.453975:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 211 00000100:00100000:0.0:1789366663.453982:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638b703b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0ab23baa-a205-44ad-bf17-f7b47295d82b+58:11603:x1876286751464320:12345-192.168.202.23@tcp:58:lfs.0 00010000:00010000:0.0:1789366663.454068:0:5816:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720c600/0x8da3486b955f3ef4 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366663.454089:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720c600/0x8da3486b955f3ef4 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366663.454104:0:5816:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720c600/0x8da3486b955f3ef4 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1789366663.454276:0:5816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5, 136 off8872 00000100:00100000:0.0:1789366663.454355:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638b703b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0ab23baa-a205-44ad-bf17-f7b47295d82b+58:11603:x1876286751464320:12345-192.168.202.23@tcp:58:lfs.0 Request processed in 373us (517us total) trans 0 rc 0/0 00000100:00100000:0.0:1789366663.454363:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 211 00000100:00100000:0.0:1789366663.456867:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:2.0:1789366663.456960:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751464448 00000100:00100000:2.0:1789366663.456968:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751464448 00000100:00100000:2.0:1789366663.457011:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 212 00000100:00100000:2.0:1789366663.457025:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638af2e8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0ab23baa-a205-44ad-bf17-f7b47295d82b+58:11603:x1876286751464448:12345-192.168.202.23@tcp:101:lfs.0 00010000:00010000:2.0:1789366663.457040:0:5815:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789366663.457055:0:5815:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c8e00/0x8da3486b955f3efb lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xda917a494d06c2e5 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366663.457097:0:5815:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720c600/0x8da3486b955f3ef4 lrc: 2/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366663.457132:0:5815:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c8e00/0x8da3486b955f3efb lrc: 4/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.23@tcp remote: 0xda917a494d06c2e5 expref: 59 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366663.457151:0:5815:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720c600/0x8da3486b955f3ef4 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366663.457166:0:5815:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c8e00/0x8da3486b955f3efb lrc: 3/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.23@tcp remote: 0xda917a494d06c2e5 expref: 59 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366663.457181:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9638a7404700) 00010000:00010000:2.0:1789366663.457184:0:5815:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789366663.457188:0:5815:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c8e00/0x8da3486b955f3efb lrc: 3/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.23@tcp remote: 0xda917a494d06c2e5 expref: 59 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366663.457195:0:5815:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9638902c8e00, rc 0) 00000100:00100000:2.0:1789366663.457239:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638af2e8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0ab23baa-a205-44ad-bf17-f7b47295d82b+59:11603:x1876286751464448:12345-192.168.202.23@tcp:101:lfs.0 Request processed in 221us (379us total) trans 0 rc 0/0 00000100:00100000:2.0:1789366663.457243:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 212 00000040:00080000:0.0:1789366663.607973:0:11650:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1789366663.607982:0:11650:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1789366663.608030:0:11650:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 5 00000040:00080000:0.0:1789366663.608037:0:11650:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1789366663.608168:0:11650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9638af2ea680 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11650:1876286758783872:192.168.202.23@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1789366663.608281:0:11650:0:(client.c:2716:ptlrpc_set_wait()) set ffff9638af2e2180 going to sleep for 11 seconds 00000100:00100000:0.0:1789366663.610905:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:3.0:1789366663.610939:0:11650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9638af2ea680 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11650:1876286758783872:192.168.202.23@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1789366663.611040:0:7132:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751464576 00000100:00100000:2.0:1789366663.611046:0:7132:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751464576 00000100:00100000:2.0:1789366663.611098:0:7132:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 213 00000100:00100000:2.0:1789366663.611110:0:7132:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638af2e9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0ab23baa-a205-44ad-bf17-f7b47295d82b+59:11604:x1876286751464576:12345-192.168.202.23@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1789366663.611149:0:7132:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1789366663.611232:0:7132:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638af2e9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0ab23baa-a205-44ad-bf17-f7b47295d82b+59:11604:x1876286751464576:12345-192.168.202.23@tcp:53:lhsmtool_posix.0 Request processed in 124us (334us total) trans 0 rc 0/0 00000100:00100000:2.0:1789366663.611239:0:7132:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 213 00000100:00100000:3.0:1789366663.613363:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:0.0:1789366663.613964:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751464704 00000100:00100000:0.0:1789366663.613973:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751464704 00000100:00100000:0.0:1789366663.614022:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 214 00000100:00100000:0.0:1789366663.614031:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638b7036a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0ab23baa-a205-44ad-bf17-f7b47295d82b+59:11604:x1876286751464704:12345-192.168.202.23@tcp:34:lhsmtool_posix.0 00010000:00010000:0.0:1789366663.614096:0:5816:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720d600/0x8da3486b955f3f02 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366663.614112:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720d600/0x8da3486b955f3f02 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366663.614151:0:5816:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720d600/0x8da3486b955f3f02 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366663.614168:0:5816:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720c000/0x8da3486b955f3f09 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366663.614174:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720c000/0x8da3486b955f3f09 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366663.614181:0:5816:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720c000/0x8da3486b955f3f09 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366663.614203:0:5816:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720d000/0x8da3486b955f3f10 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366663.614210:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720d000/0x8da3486b955f3f10 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366663.614217:0:5816:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720d000/0x8da3486b955f3f10 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789366663.614250:0:5816:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:0.0:1789366663.614254:0:5816:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1789366663.614267:0:5816:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720d000/0x8da3486b955f3f10 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366663.614278:0:5816:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720d600/0x8da3486b955f3f02 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366663.614284:0:5816:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720d600/0x8da3486b955f3f02 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366663.614302:0:5816:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720d600/0x8da3486b955f3f02 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366663.614308:0:5816:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9638b720d600 already unused, calling callback (ffffffffc20ee4f0) 00010000:00010000:0.0:1789366663.614312:0:5816:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720d600/0x8da3486b955f3f02 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366663.614320:0:5816:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720d600/0x8da3486b955f3f02 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366663.614332:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9638a7404100) 00010000:00010000:0.0:1789366663.614335:0:5816:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789366663.614340:0:5816:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720d600/0x8da3486b955f3f02 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366663.614346:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720d600/0x8da3486b955f3f02 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366663.614359:0:5816:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720c000/0x8da3486b955f3f09 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366663.614365:0:5816:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720c000/0x8da3486b955f3f09 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366663.614371:0:5816:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720c000/0x8da3486b955f3f09 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366663.614376:0:5816:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9638b720c000 already unused, calling callback (ffffffffc20ee4f0) 00010000:00010000:0.0:1789366663.614379:0:5816:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720c000/0x8da3486b955f3f09 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366663.614396:0:5816:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720c000/0x8da3486b955f3f09 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366663.614404:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0xafd4eada (ffff963890797500) 00010000:00010000:0.0:1789366663.614407:0:5816:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789366663.614411:0:5816:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720c000/0x8da3486b955f3f09 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366663.614417:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720c000/0x8da3486b955f3f09 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366663.614432:0:5816:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720d000/0x8da3486b955f3f10 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366663.614438:0:5816:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720d000/0x8da3486b955f3f10 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366663.614444:0:5816:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720d000/0x8da3486b955f3f10 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366663.614449:0:5816:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9638b720d000 already unused, calling callback (ffffffffc20ee4f0) 00010000:00010000:0.0:1789366663.614452:0:5816:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720d000/0x8da3486b955f3f10 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366663.614458:0:5816:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720d000/0x8da3486b955f3f10 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366663.614465:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9638a7404700) 00010000:00010000:0.0:1789366663.614468:0:5816:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789366663.614471:0:5816:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720d000/0x8da3486b955f3f10 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366663.614487:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720d000/0x8da3486b955f3f10 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789366663.614561:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638b7036a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0ab23baa-a205-44ad-bf17-f7b47295d82b+59:11604:x1876286751464704:12345-192.168.202.23@tcp:34:lhsmtool_posix.0 Request processed in 530us (1222us total) trans 0 rc 0/0 00000100:00100000:0.0:1789366663.614568:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 214 00000100:00100000:1.0:1789366663.620162:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:2.0:1789366663.620231:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751464960 00000100:00100000:2.0:1789366663.620241:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751464960 00000100:00100000:2.0:1789366663.620304:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 215 00000100:00100000:2.0:1789366663.620315:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638b703aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0ab23baa-a205-44ad-bf17-f7b47295d82b+59:11604:x1876286751464960:12345-192.168.202.23@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789366663.620335:0:5815:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789366663.620357:0:5815:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9000/0x8da3486b955f3f17 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xda917a494d06c2ec expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366663.620450:0:5815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9800/0x8da3486b955f3f1e lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366663.620466:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9800/0x8da3486b955f3f1e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366663.620477:0:5815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9800/0x8da3486b955f3f1e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789366663.620488:0:5815:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:2.0:1789366663.620576:0:5815:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9800/0x8da3486b955f3f1e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366663.620584:0:5815:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9800/0x8da3486b955f3f1e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366663.620591:0:5815:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9800/0x8da3486b955f3f1e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366663.620598:0:5815:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9638902c9800 already unused, calling callback (ffffffffc20ee4f0) 00010000:00010000:2.0:1789366663.620602:0:5815:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9800/0x8da3486b955f3f1e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366663.620610:0:5815:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9800/0x8da3486b955f3f1e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366663.620634:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9638a7404700) 00010000:00010000:2.0:1789366663.620637:0:5815:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1789366663.620642:0:5815:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9800/0x8da3486b955f3f1e lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366663.620648:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9800/0x8da3486b955f3f1e lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366663.620685:0:5815:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9000/0x8da3486b955f3f17 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.23@tcp remote: 0xda917a494d06c2ec expref: 61 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366663.620694:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9638a7404100) 00010000:00010000:2.0:1789366663.620697:0:5815:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789366663.620701:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9000/0x8da3486b955f3f17 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.23@tcp remote: 0xda917a494d06c2ec expref: 61 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366663.620710:0:5815:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9638902c9000, rc 0) 00000100:00100000:2.0:1789366663.620894:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638b703aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0ab23baa-a205-44ad-bf17-f7b47295d82b+60:11604:x1876286751464960:12345-192.168.202.23@tcp:101:lhsmtool_posix.0 Request processed in 581us (740us total) trans 4294967497 rc 301/301 00000100:00100000:2.0:1789366663.620902:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 215 00000100:00100000:2.0:1789366663.623361:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:0.0:1789366663.623443:0:7132:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751465088 00000100:00100000:0.0:1789366663.623452:0:7132:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751465088 00000100:00100000:0.0:1789366663.623504:0:7132:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 216 00000100:00100000:0.0:1789366663.623513:0:7132:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638aef20e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0ab23baa-a205-44ad-bf17-f7b47295d82b+60:11604:x1876286751465088:12345-192.168.202.23@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1789366663.623545:0:7132:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1789366663.623628:0:7132:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638aef20e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0ab23baa-a205-44ad-bf17-f7b47295d82b+60:11604:x1876286751465088:12345-192.168.202.23@tcp:53:lhsmtool_posix.0 Request processed in 116us (273us total) trans 0 rc 0/0 00000100:00100000:0.0:1789366663.623637:0:7132:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 216 00000100:00100000:1.0:1789366663.629886:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:3.0:1789366663.630068:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751465344 00000100:00100000:3.0:1789366663.630078:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751465344 00000100:00100000:3.0:1789366663.630149:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 217 00000100:00100000:3.0:1789366663.630159:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638b703a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0ab23baa-a205-44ad-bf17-f7b47295d82b+60:11604:x1876286751465344:12345-192.168.202.23@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789366663.630183:0:5817:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789366663.630187:0:5817:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1789366663.630213:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9638b6ce2800/0x8da3486b955f3ebc lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.23@tcp remote: 0xda917a494d06c2d0 expref: 60 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366663.630231:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff963890797800) 00010000:00010000:3.0:1789366663.630236:0:5817:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789366663.630249:0:5817:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9638832d2000/0x8da3486b955f3f2c lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xda917a494d06c2f3 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1789366663.630663:0:5817:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x6:0x0], index 0: 0 00010000:00010000:3.0:1789366663.630907:0:5817:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9638832d3400/0x8da3486b955f3f33 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366663.630919:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9638832d3400/0x8da3486b955f3f33 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366663.630940:0:5817:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9638832d3400/0x8da3486b955f3f33 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366663.630986:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9638832d2000/0x8da3486b955f3f2c lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.23@tcp remote: 0xda917a494d06c2f3 expref: 62 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366663.631002:0:5817:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9638832d3400/0x8da3486b955f3f33 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.23@tcp remote: 0xda917a494d06c2f3 expref: 61 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366663.631010:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff96388c43f100) 00010000:00010000:3.0:1789366663.631013:0:5817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789366663.631015:0:5817:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9638832d3400, rc 0) 00000100:00100000:3.0:1789366663.631077:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638b703a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0ab23baa-a205-44ad-bf17-f7b47295d82b+61:11604:x1876286751465344:12345-192.168.202.23@tcp:101:lhsmtool_posix.0 Request processed in 920us (1201us total) trans 4294967498 rc 0/0 00000100:00100000:3.0:1789366663.631084:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 217 00000100:00100000:1.0:1789366663.635870:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:2.0:1789366663.635941:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751465600 00000100:00100000:2.0:1789366663.635951:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751465600 00000100:00100000:2.0:1789366663.636014:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 218 00000100:00100000:2.0:1789366663.636025:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638b703b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0ab23baa-a205-44ad-bf17-f7b47295d82b+61:11604:x1876286751465600:12345-192.168.202.23@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1789366663.636082:0:5815:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789366663.636107:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9638832d3400/0x8da3486b955f3f33 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.23@tcp remote: 0xda917a494d06c2f3 expref: 61 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366663.636146:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff96388c43f100) 00010000:00010000:2.0:1789366663.636159:0:5815:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789366663.636182:0:5815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9800/0x8da3486b955f3f41 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366663.636200:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9800/0x8da3486b955f3f41 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366663.636210:0:5815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9800/0x8da3486b955f3f41 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366663.636224:0:5815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c8400/0x8da3486b955f3f48 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x3682d032 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366663.636231:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c8400/0x8da3486b955f3f48 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x3682d032 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366663.636237:0:5815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c8400/0x8da3486b955f3f48 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x3682d032 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366663.636299:0:5815:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9800/0x8da3486b955f3f41 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366663.636307:0:5815:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9800/0x8da3486b955f3f41 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366663.636314:0:5815:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9800/0x8da3486b955f3f41 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366663.636320:0:5815:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9638902c9800 already unused, calling callback (ffffffffc20ee4f0) 00010000:00010000:2.0:1789366663.636325:0:5815:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9800/0x8da3486b955f3f41 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366663.636339:0:5815:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9800/0x8da3486b955f3f41 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366663.636347:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff963890797800) 00010000:00010000:2.0:1789366663.636350:0:5815:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789366663.636354:0:5815:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9800/0x8da3486b955f3f41 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366663.636359:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9800/0x8da3486b955f3f41 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366663.636369:0:5815:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c8400/0x8da3486b955f3f48 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x3682d032 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366663.636375:0:5815:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c8400/0x8da3486b955f3f48 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x3682d032 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366663.636382:0:5815:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c8400/0x8da3486b955f3f48 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x3682d032 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366663.636386:0:5815:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9638902c8400 already unused, calling callback (ffffffffc20ee4f0) 00010000:00010000:2.0:1789366663.636389:0:5815:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c8400/0x8da3486b955f3f48 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x3682d032 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366663.636395:0:5815:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c8400/0x8da3486b955f3f48 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x3682d032 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366663.636402:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x3682d032 (ffff9638a7404400) 00010000:00010000:2.0:1789366663.636404:0:5815:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789366663.636407:0:5815:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c8400/0x8da3486b955f3f48 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x3682d032 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366663.636422:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c8400/0x8da3486b955f3f48 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x3682d032 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789366663.636562:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638b703b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0ab23baa-a205-44ad-bf17-f7b47295d82b+60:11604:x1876286751465600:12345-192.168.202.23@tcp:36:lhsmtool_posix.0 Request processed in 539us (701us total) trans 0 rc -2/-2 00000100:00100000:2.0:1789366663.636570:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 218 00000100:00100000:2.0:1789366663.639277:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:0.0:1789366663.639322:0:7132:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751465728 00000100:00100000:0.0:1789366663.639332:0:7132:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751465728 00000100:00100000:0.0:1789366663.639382:0:7132:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 219 00000100:00100000:0.0:1789366663.639392:0:7132:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638aef21c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0ab23baa-a205-44ad-bf17-f7b47295d82b+60:11604:x1876286751465728:12345-192.168.202.23@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789366663.639411:0:7132:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789366663.639428:0:7132:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720d000/0x8da3486b955f3f4f lrc: 2/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xda917a494d06c2fa expref: -99 pid: 7132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366663.639456:0:7132:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720c000/0x8da3486b955f3f56 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366663.639466:0:7132:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720c000/0x8da3486b955f3f56 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366663.639482:0:7132:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720c000/0x8da3486b955f3f56 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366663.639575:0:7132:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720d000/0x8da3486b955f3f4f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.23@tcp remote: 0xda917a494d06c2fa expref: 62 pid: 7132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366663.639591:0:7132:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720c000/0x8da3486b955f3f56 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.23@tcp remote: 0xda917a494d06c2fa expref: 61 pid: 7132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366663.639599:0:7132:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff963890797500) 00010000:00010000:0.0:1789366663.639602:0:7132:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1789366663.639605:0:7132:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9638b720c000, rc 0) 00000100:00100000:0.0:1789366663.639654:0:7132:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638aef21c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0ab23baa-a205-44ad-bf17-f7b47295d82b+61:11604:x1876286751465728:12345-192.168.202.23@tcp:101:lhsmtool_posix.0 Request processed in 263us (384us total) trans 0 rc 0/0 00000100:00100000:0.0:1789366663.639661:0:7132:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 219 00000100:00100000:1.0:1789366663.644117:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:0.0:1789366663.645925:0:7614:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751465984 00000100:00100000:0.0:1789366663.645939:0:7614:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751465984 00000100:00100000:0.0:1789366663.646004:0:7614:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 220 00000100:00100000:0.0:1789366663.646016:0:7614:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638b7038700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0ab23baa-a205-44ad-bf17-f7b47295d82b+61:11604:x1876286751465984:12345-192.168.202.23@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1789366663.646093:0:7614:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720d600/0x8da3486b955f3f5d lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7614 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366663.646108:0:7614:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720d600/0x8da3486b955f3f5d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7614 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366663.646130:0:7614:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720d600/0x8da3486b955f3f5d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7614 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1789366663.646366:0:7614:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].8, 88 off8800 00000004:00080000:0.0:1789366663.646374:0:7614:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 239110655289ns, next at 240110652596ns, rc = 0 00000004:00010000:0.0:1789366663.646456:0:7614:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000009de55a7e reply state 0000000004254f5e transno 4294967499 ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720d600/0x8da3486b955f3f5d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7614 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789366663.646465:0:7614:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789366663.646566:0:7614:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638b7038700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0ab23baa-a205-44ad-bf17-f7b47295d82b+63:11604:x1876286751465984:12345-192.168.202.23@tcp:36:lhsmtool_posix.0 Request processed in 552us (2458us total) trans 4294967499 rc 0/0 00000100:00100000:0.0:1789366663.646573:0:7614:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 220 00010000:00010000:3.0:1789366663.649173:0:3270:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720d600/0x8da3486b955f3f5d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7614 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366663.649190:0:3270:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720d600/0x8da3486b955f3f5d lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7614 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366663.649198:0:3270:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720d600/0x8da3486b955f3f5d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7614 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366663.649204:0:3270:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9638b720d600 already unused, calling callback (ffffffffc20ee4f0) 00010000:00010000:3.0:1789366663.649209:0:3270:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720d600/0x8da3486b955f3f5d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7614 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366663.649217:0:3270:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720d600/0x8da3486b955f3f5d lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7614 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366663.649246:0:3270:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff963890797500) 00010000:00010000:3.0:1789366663.649249:0:3270:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1789366663.649254:0:3270:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720d600/0x8da3486b955f3f5d lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7614 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366663.649261:0:3270:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720d600/0x8da3486b955f3f5d lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7614 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789366663.655496:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:2.0:1789366663.655804:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751466112 00000100:00100000:2.0:1789366663.655814:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751466112 00000100:00100000:2.0:1789366663.655909:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 221 00000100:00100000:2.0:1789366663.655919:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638b703a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0ab23baa-a205-44ad-bf17-f7b47295d82b+62:11604:x1876286751466112:12345-192.168.202.23@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789366663.655942:0:5815:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789366663.655961:0:5815:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9800/0x8da3486b955f3f64 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xda917a494d06c301 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366663.656037:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9800/0x8da3486b955f3f64 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.23@tcp remote: 0xda917a494d06c301 expref: 63 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366663.656051:0:5815:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9800/0x8da3486b955f3f64 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.23@tcp remote: 0xda917a494d06c301 expref: 63 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366663.656070:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff963890797500) 00010000:00010000:2.0:1789366663.656073:0:5815:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789366663.656077:0:5815:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9638902c9800, rc 0) 00000100:00100000:2.0:1789366663.656155:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638b703a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0ab23baa-a205-44ad-bf17-f7b47295d82b+63:11604:x1876286751466112:12345-192.168.202.23@tcp:101:lhsmtool_posix.0 Request processed in 237us (669us total) trans 0 rc 0/0 00000100:00100000:2.0:1789366663.656179:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 221 00000100:00100000:1.0:1789366663.659191:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:0.0:1789366663.659324:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751466240 00000100:00100000:0.0:1789366663.659332:0:6659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751466240 00000100:00100000:0.0:1789366663.659412:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 63 00000100:00100000:0.0:1789366663.659422:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638b7038000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0ab23baa-a205-44ad-bf17-f7b47295d82b+9:2354:x1876286751466240:12345-192.168.202.23@tcp:2:lhsmtool_posix.0 00000100:00100000:0.0:1789366663.659710:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638b7038000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0ab23baa-a205-44ad-bf17-f7b47295d82b+10:2354:x1876286751466240:12345-192.168.202.23@tcp:2:lhsmtool_posix.0 Request processed in 289us (528us total) trans 4294967319 rc 0/0 00000100:00100000:0.0:1789366663.659732:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 63 00000100:00100000:0.0:1789366663.666515:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:1.0:1789366663.666698:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751466496 00000100:00100000:1.0:1789366663.666706:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751466496 00000100:00100000:1.0:1789366663.666847:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 57 00000100:00100000:1.0:1789366663.666859:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638af2e9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0ab23baa-a205-44ad-bf17-f7b47295d82b+63:11604:x1876286751466496:12345-192.168.202.23@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1789366663.667104:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638af2e9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0ab23baa-a205-44ad-bf17-f7b47295d82b+64:11604:x1876286751466496:12345-192.168.202.23@tcp:35:lhsmtool_posix.0 Request processed in 247us (597us total) trans 4294967500 rc 0/0 00000100:00100000:1.0:1789366663.667109:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 57 00000100:00100000:1.0:1789366663.679693:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:0.0:1789366663.679904:0:7132:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751466752 00000100:00100000:0.0:1789366663.679912:0:7132:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751466752 00000100:00100000:0.0:1789366663.680005:0:7132:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 222 00000100:00100000:0.0:1789366663.680014:0:7132:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638b703bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0ab23baa-a205-44ad-bf17-f7b47295d82b+64:11604:x1876286751466752:12345-192.168.202.23@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1789366663.680151:0:7132:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638b703bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0ab23baa-a205-44ad-bf17-f7b47295d82b+64:11604:x1876286751466752:12345-192.168.202.23@tcp:57:lhsmtool_posix.0 Request processed in 137us (466us total) trans 0 rc 0/0 00000100:00100000:0.0:1789366663.680160:0:7132:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 222 00000100:00100000:3.0:1789366663.686398:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:0.0:1789366663.687949:0:7614:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751466880 00000100:00100000:0.0:1789366663.687974:0:7614:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751466880 00000100:00100000:0.0:1789366663.688045:0:7614:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 223 00000100:00100000:0.0:1789366663.688056:0:7614:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638b7034a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0ab23baa-a205-44ad-bf17-f7b47295d82b+64:11604:x1876286751466880:12345-192.168.202.23@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789366663.688075:0:7614:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789366663.688096:0:7614:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720de00/0x8da3486b955f3f6b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xda917a494d06c308 expref: -99 pid: 7614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366663.688173:0:7614:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720da00/0x8da3486b955f3f72 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7614 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366663.688188:0:7614:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720da00/0x8da3486b955f3f72 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7614 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366663.688200:0:7614:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720da00/0x8da3486b955f3f72 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7614 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789366663.688231:0:7614:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1789366663.688248:0:7614:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720da00/0x8da3486b955f3f72 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7614 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366663.688273:0:7614:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720de00/0x8da3486b955f3f6b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.23@tcp remote: 0xda917a494d06c308 expref: 66 pid: 7614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366663.688291:0:7614:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720da00/0x8da3486b955f3f72 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.23@tcp remote: 0xda917a494d06c308 expref: 65 pid: 7614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366663.688300:0:7614:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff963890797500) 00010000:00010000:0.0:1789366663.688303:0:7614:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1789366663.688306:0:7614:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9638b720da00, rc 0) 00000100:00100000:0.0:1789366663.688515:0:7614:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638b7034a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0ab23baa-a205-44ad-bf17-f7b47295d82b+65:11604:x1876286751466880:12345-192.168.202.23@tcp:101:lhsmtool_posix.0 Request processed in 459us (2124us total) trans 0 rc 0/0 00000100:00100000:0.0:1789366663.688529:0:7614:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 223 00000100:00100000:2.0:1789366663.691063:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:3.0:1789366663.691290:0:8065:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751467008 00000100:00100000:3.0:1789366663.691300:0:8065:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751467008 00000100:00100000:3.0:1789366663.691356:0:8065:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 64 00000100:00100000:3.0:1789366663.691365:0:8065:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638aef22680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0ab23baa-a205-44ad-bf17-f7b47295d82b+10:2355:x1876286751467008:12345-192.168.202.23@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789366663.691383:0:8065:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789366663.691402:0:8065:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001e78ae4c/0x8da3486b955f3f79 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda917a494d06c30f expref: -99 pid: 8065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789366663.691428:0:8065:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6aa79187, blocks: 0x1 00010000:00010000:3.0:1789366663.691444:0:8065:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=239s v=(0 0) 00010000:00010000:3.0:1789366663.691450:0:8065:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789366663.691458:0:8065:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001e78ae4c/0x8da3486b955f3f79 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.23@tcp remote: 0xda917a494d06c30f expref: 11 pid: 8065 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366663.691475:0:8065:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000001e78ae4c/0x8da3486b955f3f79 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.23@tcp remote: 0xda917a494d06c30f expref: 11 pid: 8065 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366663.691488:0:8065:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9638832d2000, rc 0) 00000100:00100000:3.0:1789366663.692273:0:8065:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638aef22680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0ab23baa-a205-44ad-bf17-f7b47295d82b+11:2355:x1876286751467008:12345-192.168.202.23@tcp:101:lhsmtool_posix.0 Request processed in 906us (1215us total) trans 0 rc 0/0 00000100:00100000:3.0:1789366663.692282:0:8065:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 64 00000100:00100000:1.0:1789366663.701444:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:2.0:1789366663.701546:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751467264 00000100:00100000:2.0:1789366663.701556:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751467264 00000100:00100000:2.0:1789366663.701613:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 224 00000100:00100000:2.0:1789366663.701624:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638b7039880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0ab23baa-a205-44ad-bf17-f7b47295d82b+65:11604:x1876286751467264:12345-192.168.202.23@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1789366663.701761:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638b7039880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0ab23baa-a205-44ad-bf17-f7b47295d82b+65:11604:x1876286751467264:12345-192.168.202.23@tcp:57:lhsmtool_posix.0 Request processed in 139us (327us total) trans 0 rc 0/0 00000100:00100000:2.0:1789366663.701769:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 224 00000100:00100000:0.0:1789366663.703906:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:3.0:1789366663.703979:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751467392 00000100:00100000:3.0:1789366663.703987:0:6661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751467392 00000100:00100000:3.0:1789366663.704101:0:6661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 65 00000100:00100000:3.0:1789366663.704111:0:6661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638af2e9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0ab23baa-a205-44ad-bf17-f7b47295d82b+11:11604:x1876286751467392:12345-192.168.202.23@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789366663.704141:0:6661:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789366663.704161:0:6661:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000004f4d78f/0x8da3486b955f3f80 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda917a494d06c316 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366663.704193:0:6661:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000001e78ae4c/0x8da3486b955f3f79 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.23@tcp remote: 0xda917a494d06c30f expref: 12 pid: 8065 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366663.704202:0:6661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789366663.704205:0:6661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789366663.704210:0:6661:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000004f4d78f/0x8da3486b955f3f80 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.23@tcp remote: 0xda917a494d06c316 expref: 12 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366663.704242:0:6661:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000001e78ae4c/0x8da3486b955f3f79 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.23@tcp remote: 0xda917a494d06c30f expref: 12 pid: 8065 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366663.704256:0:6661:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000001e78ae4c/0x8da3486b955f3f79 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.23@tcp remote: 0xda917a494d06c30f expref: 12 pid: 8065 timeout: 339 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789366663.704270:0:6661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9638b702ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6661:1876286758784000:192.168.202.23@tcp:104: 00000100:00100000:3.0:1789366663.704380:0:6661:0:(client.c:2716:ptlrpc_set_wait()) set ffff9638a7492480 going to sleep for 11 seconds 00000100:00100000:3.0:1789366663.711210:0:6661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9638b702ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6661:1876286758784000:192.168.202.23@tcp:104: 00010000:00010000:3.0:1789366663.711249:0:6661:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000004f4d78f/0x8da3486b955f3f80 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.23@tcp remote: 0xda917a494d06c316 expref: 12 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366663.711270:0:6661:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9638832d3c00, rc 0) 00000100:00100000:3.0:1789366663.711329:0:6661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638af2e9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0ab23baa-a205-44ad-bf17-f7b47295d82b+12:11604:x1876286751467392:12345-192.168.202.23@tcp:101:lhsmtool_posix.0 Request processed in 7218us (7482us total) trans 0 rc 0/0 00000100:00100000:3.0:1789366663.711338:0:6661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 65 00000100:00100000:1.0:1789366663.712662:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:3.0:1789366663.713680:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751467520 00000100:00100000:3.0:1789366663.713692:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751467520 00010000:00010000:3.0:1789366663.713759:0:5802:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000001e78ae4c/0x8da3486b955f3f79 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.23@tcp remote: 0xda917a494d06c30f expref: 12 pid: 8065 timeout: 339 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789366663.713802:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 82 00000100:00100000:3.0:1789366663.713812:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638b7352a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0ab23baa-a205-44ad-bf17-f7b47295d82b+12:2354:x1876286751467520:12345-192.168.202.23@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789366663.713826:0:5802:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789366663.713847:0:5802:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000001e78ae4c/0x8da3486b955f3f79 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.23@tcp remote: 0xda917a494d06c30f expref: 12 pid: 8065 timeout: 339 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366663.713871:0:5802:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000001e78ae4c/0x8da3486b955f3f79 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.23@tcp remote: 0xda917a494d06c30f expref: 12 pid: 8065 timeout: 339 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366663.713894:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001e78ae4c/0x8da3486b955f3f79 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.23@tcp remote: 0xda917a494d06c30f expref: 12 pid: 8065 timeout: 339 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366663.713928:0:5802:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789366663.713931:0:5802:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789366663.713939:0:5802:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000004f4d78f/0x8da3486b955f3f80 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.23@tcp remote: 0xda917a494d06c316 expref: 11 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366663.713949:0:5802:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000004f4d78f/0x8da3486b955f3f80 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.23@tcp remote: 0xda917a494d06c316 expref: 11 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366663.713986:0:5802:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 0000000004f4d78f/0x8da3486b955f3f80 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.23@tcp remote: 0xda917a494d06c316 expref: 11 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789366663.714001:0:5802:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9638b702ca80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:5802:1876286758784128:192.168.202.23@tcp:105: 00000100:00100000:3.0:1789366663.714560:0:5802:0:(client.c:2716:ptlrpc_set_wait()) set ffff9638a7492480 going to sleep for 11 seconds 00000100:00100000:1.0:1789366663.718450:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:3.0:1789366663.718607:0:5802:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9638b702ca80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:5802:1876286758784128:192.168.202.23@tcp:105: 00010000:00010000:3.0:1789366663.718629:0:5802:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789366663.718697:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638b7352a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0ab23baa-a205-44ad-bf17-f7b47295d82b+11:2354:x1876286751467520:12345-192.168.202.23@tcp:103:ldlm_bl.0 Request processed in 4886us (6046us total) trans 0 rc 0/0 00000100:00100000:3.0:1789366663.718706:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 82 00000100:00100000:0.0:1789366663.718858:0:6666:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751467648 00000100:00100000:0.0:1789366663.718865:0:6666:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751467648 00002000:00100000:0.0:1789366663.718907:0:6666:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x6:0x0] (0->12) req@ffff96388327ca80 x1876286751467648/t0(0) o4->0ab23baa-a205-44ad-bf17-f7b47295d82b@192.168.202.23@tcp:64/0 lens 504/0 e 0 to 0 dl 1789366674 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789366663.718917:0:6666:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff96388327ca80 with x1876286751467648 ext(0->12) 00002000:00010000:0.0:1789366663.718921:0:6666:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff96388327ca80 00000100:00100000:0.0:1789366663.718950:0:6666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 7 00000100:00100000:0.0:1789366663.718959:0:6666:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96388327ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0ab23baa-a205-44ad-bf17-f7b47295d82b+11:2354:x1876286751467648:12345-192.168.202.23@tcp:4:lhsmtool_posix.0 00000100:00100000:0.0:1789366663.719501:0:6666:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96388327ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0ab23baa-a205-44ad-bf17-f7b47295d82b+13:2354:x1876286751467648:12345-192.168.202.23@tcp:4:lhsmtool_posix.0 Request processed in 542us (1060us total) trans 4294967320 rc 0/0 00000100:00100000:0.0:1789366663.719509:0:6666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 7 00002000:00100000:0.0:1789366663.719515:0:6666:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x6:0x0] (0->12) req@ffff96388327ca80 x1876286751467648/t4294967320(0) o4->0ab23baa-a205-44ad-bf17-f7b47295d82b@192.168.202.23@tcp:64/0 lens 504/448 e 0 to 0 dl 1789366674 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789366663.719524:0:6666:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff96388327ca80 with x1876286751467648 ext(0->12) 00002000:00010000:0.0:1789366663.719527:0:6666:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff96388327ca80 00000100:00100000:2.0:1789366663.723276:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:0.0:1789366663.723372:0:7132:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751467776 00000100:00100000:0.0:1789366663.723381:0:7132:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751467776 00000100:00100000:0.0:1789366663.723440:0:7132:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 225 00000100:00100000:0.0:1789366663.723450:0:7132:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963882ee0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0ab23baa-a205-44ad-bf17-f7b47295d82b+65:11604:x1876286751467776:12345-192.168.202.23@tcp:44:lhsmtool_posix.0 00000100:00100000:2.0:1789366663.746507:0:7132:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963882ee0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0ab23baa-a205-44ad-bf17-f7b47295d82b+65:11604:x1876286751467776:12345-192.168.202.23@tcp:44:lhsmtool_posix.0 Request processed in 23046us (23228us total) trans 0 rc 0/0 00000100:00100000:2.0:1789366663.746522:0:7132:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 225 00000001:00080000:1.0:1789366663.746699:0:5837:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967499 is committed 00000004:00080000:1.0:1789366663.746707:0:5837:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 8 committed 00000020:00080000:1.0:1789366663.746767:0:5837:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9638af2e2540 refcount 2 committed 0 result 0 batchid 6 00000020:00080000:1.0:1789366663.746772:0:5837:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9638af329c00 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9638af2e2480 00000020:00080000:1.0:1789366663.746775:0:5837:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9638af329d00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9638af304800 00000020:00080000:1.0:1789366663.746794:0:5837:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 5 batchid updated 00000001:00080000:1.0:1789366663.746816:0:5837:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967500 is committed 00000004:00080000:1.0:1789366663.746854:0:5837:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 6 committed 00000020:00080000:1.0:1789366663.746869:0:5837:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9638b72dc6c0 refcount 2 committed 0 result 0 batchid 7 00000020:00080000:1.0:1789366663.746873:0:5837:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9638bfe67e00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9638b72dc0c0 00000020:00080000:1.0:1789366663.746876:0:5837:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9638bfe67700 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9638b73d3400 00000020:00080000:1.0:1789366663.746925:0:5848:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 7 committed batchid 5 00000020:00080000:1.0:1789366663.747113:0:5848:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000100:00100000:1.0:1789366663.747225:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96388327e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3284:1876286758784256:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1789366663.747282:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789366663.747364:0:8065:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286758784256 00000100:00100000:1.0:1789366663.747371:0:8065:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286758784256 00000100:00100000:1.0:1789366663.747412:0:8065:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1789366663.747421:0:8065:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96388327dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+8:3284:x1876286758784256:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1789366663.747444:0:8065:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:5 count 1 00002000:00010000:1.0:1789366663.747486:0:8065:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x5:0x0] initial LVB size: 9, mtime: 0x6aa79187, atime: 0x6aa79187, ctime: 0x6aa79187, blocks: 0x1 00010000:00010000:1.0:1789366663.747495:0:8065:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009a47f876/0x8da3486b955f3f87 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366663.747510:0:8065:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=239s v=(0 0) 00010000:00010000:1.0:1789366663.747514:0:8065:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789366663.747520:0:8065:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009a47f876/0x8da3486b955f3f87 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366663.747534:0:8065:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009a47f876/0x8da3486b955f3f87 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366663.747543:0:8065:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009a47f876/0x8da3486b955f3f87 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366663.747557:0:8065:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009a47f876/0x8da3486b955f3f87 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366663.747572:0:8065:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1789366663.748005:0:8065:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96388327dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+9:3284:x1876286758784256:12345-0@lo:6:osp-syn-1-0.0 Request processed in 583us (721us total) trans 4294967310 rc 0/0 00000100:00100000:1.0:1789366663.748012:0:8065:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000004:00080000:1.0:1789366663.748052:0:3284:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff96388327e680/2, rc 0, transno 4294967310 00000100:00100000:1.0:1789366663.748059:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96388327e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3284:1876286758784256:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1789366663.748415:0:3287:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789366663.748425:0:3287:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9638aef24e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3287:1876286758784512:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1789366663.748530:0:3287:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789366663.748563:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286758784512 00000100:00100000:2.0:1789366663.748566:0:6659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286758784512 00000100:00100000:2.0:1789366663.748588:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1789366663.748592:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638aef26300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3287:x1876286758784512:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:2.0:1789366663.748673:0:6659:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:2.0:1789366663.748676:0:6659:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb mtime from disk: 0 -> 1789366664 00002000:00010000:2.0:1789366663.748678:0:6659:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1789366663.748679:0:6659:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb ctime from disk: 1789366663 -> 1789366664 00002000:00010000:2.0:1789366663.748681:0:6659:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:2.0:1789366663.748707:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638aef26300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3287:x1876286758784512:12345-0@lo:2:osp-syn-0-0.0 Request processed in 115us (252us total) trans 4294967321 rc 0/0 00000100:00100000:2.0:1789366663.748712:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000004:00080000:2.0:1789366663.748748:0:3287:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9638aef24e00/2, rc 0, transno 4294967321 00000100:00100000:2.0:1789366663.748752:0:3287:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9638aef24e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3287:1876286758784512:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1789366663.748796:0:3284:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789366663.748802:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9638aef25500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3284:1876286758784384:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1789366663.748822:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789366663.749001:0:6675:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789366663.749009:0:6675:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009a47f876/0x8da3486b955f3f87 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366663.749029:0:6675:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9638b6ce3c00 already unused, calling callback (ffffffffc16df520) 00010000:00010000:0.0:1789366663.749034:0:6675:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009a47f876/0x8da3486b955f3f87 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366663.749043:0:6675:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009a47f876/0x8da3486b955f3f87 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366663.749061:0:6675:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009a47f876/0x8da3486b955f3f87 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366663.749069:0:6675:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009a47f876/0x8da3486b955f3f87 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366663.749084:0:6675:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789366663.749085:0:6675:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789366663.749087:0:6675:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789366663.750817:0:8065:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286758784384 00000100:00100000:2.0:1789366663.750829:0:8065:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286758784384 00000100:00100000:1.0:1789366663.750872:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:2.0:1789366663.750963:0:8065:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751467904 00000100:00100000:2.0:1789366663.750967:0:8065:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751467904 00000100:00100000:2.0:1789366663.751000:0:8065:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1789366663.751010:0:8065:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96388327d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3284:x1876286758784384:12345-0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1789366663.751024:0:6660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 69 00000100:00100000:3.0:1789366663.751032:0:6660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96388327d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0ab23baa-a205-44ad-bf17-f7b47295d82b+13:2355:x1876286751467904:12345-192.168.202.23@tcp:16:lhsmtool_posix.0 00002000:00080000:2.0:1789366663.751035:0:8065:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:5 count 1 00010000:00010000:2.0:1789366663.751056:0:8065:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000097408a05/0x8da3486b955f3f8e lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366663.751073:0:8065:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000082beeec3/0x8da3486b955f3d49 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.202.23@tcp remote: 0xda917a494d06c275 expref: 13 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366663.751081:0:8065:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x5:0x0].0x0 since=1s v=(0 0) 00010000:00010000:2.0:1789366663.751085:0:8065:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789366663.751089:0:8065:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000097408a05/0x8da3486b955f3f8e lrc: 4/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366663.751128:0:8065:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000082beeec3/0x8da3486b955f3d49 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.202.23@tcp remote: 0xda917a494d06c275 expref: 13 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366663.751143:0:8065:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000082beeec3/0x8da3486b955f3d49 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.202.23@tcp remote: 0xda917a494d06c275 expref: 13 pid: 6660 timeout: 339 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789366663.751165:0:8065:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9638aef27100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8065:1876286758784640:192.168.202.23@tcp:104: 00000100:00100000:2.0:1789366663.751235:0:8065:0:(client.c:2716:ptlrpc_set_wait()) set ffff9638b72dc9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789366663.756984:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:1.0:1789366663.757020:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751468032 00000100:00100000:1.0:1789366663.757029:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751468032 00010000:00010000:1.0:1789366663.757071:0:5803:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000082beeec3/0x8da3486b955f3d49 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.202.23@tcp remote: 0xda917a494d06c275 expref: 14 pid: 6660 timeout: 339 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789366663.757108:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 83 00000100:00100000:1.0:1789366663.757129:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96388327ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0ab23baa-a205-44ad-bf17-f7b47295d82b+14:2354:x1876286751468032:12345-192.168.202.23@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789366663.757145:0:5803:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789366663.757152:0:5803:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000082beeec3/0x8da3486b955f3d49 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.202.23@tcp remote: 0xda917a494d06c275 expref: 14 pid: 6660 timeout: 339 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366663.757181:0:5803:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000082beeec3/0x8da3486b955f3d49 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.202.23@tcp remote: 0xda917a494d06c275 expref: 14 pid: 6660 timeout: 339 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366663.757206:0:5803:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789366663.757211:0:5803:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789366663.757217:0:5803:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000097408a05/0x8da3486b955f3f8e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 8065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366663.757227:0:5803:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000097408a05/0x8da3486b955f3f8e lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 8065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366663.757246:0:5803:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789366663.757298:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96388327ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0ab23baa-a205-44ad-bf17-f7b47295d82b+14:2354:x1876286751468032:12345-192.168.202.23@tcp:103:ldlm_bl.0 Request processed in 180us (323us total) trans 0 rc 0/0 00000100:00100000:1.0:1789366663.757305:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 83 00010000:00010000:3.0:1789366663.758603:0:8065:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000082beeec3/0x8da3486b955f3d49 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.202.23@tcp remote: 0xda917a494d06c275 expref: 13 pid: 6660 timeout: 339 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789366663.758636:0:8065:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9638aef27100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8065:1876286758784640:192.168.202.23@tcp:104: 00010000:00010000:3.0:1789366663.758659:0:8065:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000097408a05/0x8da3486b955f3f8e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366663.758671:0:8065:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000097408a05/0x8da3486b955f3f8e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366663.758678:0:8065:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000097408a05/0x8da3486b955f3f8e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366663.758688:0:8065:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000097408a05/0x8da3486b955f3f8e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366663.758696:0:8065:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000097408a05/0x8da3486b955f3f8e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366663.758711:0:8065:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789366663.759878:0:5805:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789366663.759889:0:5805:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000097408a05/0x8da3486b955f3f8e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366663.759899:0:5805:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9638902c9200 already unused, calling callback (ffffffffc16df520) 00010000:00010000:1.0:1789366663.759904:0:5805:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000097408a05/0x8da3486b955f3f8e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366663.759913:0:5805:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000097408a05/0x8da3486b955f3f8e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366663.759943:0:5805:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000097408a05/0x8da3486b955f3f8e lrc: 1/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366663.759950:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000097408a05/0x8da3486b955f3f8e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366663.759970:0:5805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789366663.759972:0:5805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789366663.759973:0:5805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789366663.761153:0:8065:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96388327d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+8:3284:x1876286758784384:12345-0@lo:6:osp-syn-0-0.0 Request processed in 10140us (12325us total) trans 4294967322 rc 0/0 00000100:00100000:3.0:1789366663.761166:0:8065:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000004:00080000:0.0:1789366663.761349:0:3284:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9638aef25500/2, rc 0, transno 4294967322 00000100:00100000:0.0:1789366663.761357:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9638aef25500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3284:1876286758784384:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1789366663.786320:0:6660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96388327d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0ab23baa-a205-44ad-bf17-f7b47295d82b+12:2355:x1876286751467904:12345-192.168.202.23@tcp:16:lhsmtool_posix.0 Request processed in 35277us (35440us total) trans 0 rc 0/0 00000100:00100000:1.0:1789366663.786334:0:6660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 69 00000001:00080000:0.0:1789366663.786414:0:6685:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967320 is committed 00000001:00080000:0.0:1789366663.786435:0:6685:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967321 is committed 00000100:00100000:1.0:1789366663.789239:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:0.0:1789366663.789334:0:7614:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751468288 00000100:00100000:0.0:1789366663.789343:0:7614:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751468288 00000100:00100000:0.0:1789366663.789438:0:7614:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 226 00000100:00100000:0.0:1789366663.789449:0:7614:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96388327e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0ab23baa-a205-44ad-bf17-f7b47295d82b+20:11604:x1876286751468288:12345-192.168.202.23@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1789366663.789510:0:7614:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789366663.789550:0:7614:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720da00/0x8da3486b955f3f72 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.23@tcp remote: 0xda917a494d06c308 expref: 20 pid: 7614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366663.789568:0:7614:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff963890797500) 00010000:00010000:0.0:1789366663.789573:0:7614:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789366663.789602:0:7614:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720ca00/0x8da3486b955f3f95 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7614 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366663.789614:0:7614:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720ca00/0x8da3486b955f3f95 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7614 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366663.789624:0:7614:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720ca00/0x8da3486b955f3f95 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7614 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789366663.790226:0:7614:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000003e624d7e reply state 00000000eb4f11ea transno 4294967501 ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720ca00/0x8da3486b955f3f95 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7614 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789366663.790238:0:7614:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789366663.790337:0:7614:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96388327e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0ab23baa-a205-44ad-bf17-f7b47295d82b+21:11604:x1876286751468288:12345-192.168.202.23@tcp:36:lhsmtool_posix.0 Request processed in 889us (1105us total) trans 4294967501 rc 0/0 00000100:00100000:0.0:1789366663.790345:0:7614:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 226 00000100:00100000:3.0:1789366663.792887:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00010000:00010000:1.0:1789366663.793197:0:3271:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720ca00/0x8da3486b955f3f95 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7614 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366663.793211:0:3271:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720ca00/0x8da3486b955f3f95 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7614 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366663.793219:0:3271:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720ca00/0x8da3486b955f3f95 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7614 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366663.793225:0:3271:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9638b720ca00 already unused, calling callback (ffffffffc20ee4f0) 00010000:00010000:1.0:1789366663.793230:0:3271:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720ca00/0x8da3486b955f3f95 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7614 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366663.793239:0:3271:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720ca00/0x8da3486b955f3f95 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7614 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366663.793276:0:3271:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff963890797500) 00010000:00010000:1.0:1789366663.793280:0:3271:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789366663.793285:0:3271:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720ca00/0x8da3486b955f3f95 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7614 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366663.793292:0:3271:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720ca00/0x8da3486b955f3f95 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7614 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789366663.793328:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751468416 00000100:00100000:1.0:1789366663.793339:0:6661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751468416 00000100:00100000:1.0:1789366663.793395:0:6661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 70 00000100:00100000:1.0:1789366663.793406:0:6661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638b702ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0ab23baa-a205-44ad-bf17-f7b47295d82b+7:2354:x1876286751468416:12345-192.168.202.23@tcp:2:lhsmtool_posix.0 00002000:00010000:1.0:1789366663.793602:0:6661:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:1.0:1789366663.793606:0:6661:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb mtime from disk: 1789366664 -> 1789366663 00002000:00010000:1.0:1789366663.793609:0:6661:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb atime from disk: 0 -> 1789366663 00002000:00010000:1.0:1789366663.793612:0:6661:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb ctime from disk: 1789366664 -> 1789366663 00002000:00010000:1.0:1789366663.793615:0:6661:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:1.0:1789366663.793682:0:6661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638b702ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0ab23baa-a205-44ad-bf17-f7b47295d82b+8:2354:x1876286751468416:12345-192.168.202.23@tcp:2:lhsmtool_posix.0 Request processed in 277us (803us total) trans 4294967323 rc 0/0 00000100:00100000:1.0:1789366663.793691:0:6661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 70 00000100:00100000:3.0:1789366663.796305:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:1.0:1789366663.796380:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751468672 00000100:00100000:1.0:1789366663.796389:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751468672 00000100:00100000:1.0:1789366663.796450:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 227 00000100:00100000:1.0:1789366663.796461:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638bfefaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0ab23baa-a205-44ad-bf17-f7b47295d82b+20:11604:x1876286751468672:12345-192.168.202.23@tcp:55:lhsmtool_posix.0 00010000:00010000:1.0:1789366663.796526:0:5816:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9638b6ce2400/0x8da3486b955f3f9c lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366663.796561:0:5816:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720c000/0x8da3486b955f3f56 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.23@tcp remote: 0xda917a494d06c2fa expref: 20 pid: 7132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366663.796572:0:5816:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9638b6ce2400/0x8da3486b955f3f9c lrc: 4/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366663.796604:0:5816:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720c000/0x8da3486b955f3f56 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.23@tcp remote: 0xda917a494d06c2fa expref: 20 pid: 7132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366663.796619:0:5816:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720c000/0x8da3486b955f3f56 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.23@tcp remote: 0xda917a494d06c2fa expref: 20 pid: 7132 timeout: 339 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789366663.796636:0:5816:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96388327f100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5816:1876286758784768:192.168.202.23@tcp:104: 00000100:00100000:1.0:1789366663.796760:0:5816:0:(client.c:2716:ptlrpc_set_wait()) set ffff96388347a0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789366663.798952:0:5816:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96388327f100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5816:1876286758784768:192.168.202.23@tcp:104: 00010000:00010000:0.0:1789366663.798979:0:5816:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9638b6ce2400/0x8da3486b955f3f9c lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789366663.799305:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:1.0:1789366663.799459:0:8419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751468800 00000100:00100000:1.0:1789366663.799467:0:8419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751468800 00010000:00010000:1.0:1789366663.799502:0:8419:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720c000/0x8da3486b955f3f56 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.23@tcp remote: 0xda917a494d06c2fa expref: 21 pid: 7132 timeout: 339 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789366663.799536:0:8419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 84 00000100:00100000:1.0:1789366663.799546:0:8419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96389077ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0ab23baa-a205-44ad-bf17-f7b47295d82b+21:2355:x1876286751468800:12345-192.168.202.23@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789366663.799559:0:8419:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789366663.799566:0:8419:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720c000/0x8da3486b955f3f56 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.23@tcp remote: 0xda917a494d06c2fa expref: 21 pid: 7132 timeout: 339 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366663.799577:0:8419:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720c000/0x8da3486b955f3f56 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.23@tcp remote: 0xda917a494d06c2fa expref: 21 pid: 7132 timeout: 339 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366663.799613:0:8419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720c000/0x8da3486b955f3f56 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.23@tcp remote: 0xda917a494d06c2fa expref: 21 pid: 7132 timeout: 339 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366663.799628:0:8419:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff963890797500) 00010000:00010000:1.0:1789366663.799633:0:8419:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9638b6ce2400/0x8da3486b955f3f9c lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366663.799642:0:8419:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9638b6ce2400/0x8da3486b955f3f9c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366663.799649:0:8419:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9638b6ce2400/0x8da3486b955f3f9c lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366663.799676:0:8419:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789366663.799758:0:8419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96389077ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0ab23baa-a205-44ad-bf17-f7b47295d82b+20:2355:x1876286751468800:12345-192.168.202.23@tcp:103:ldlm_bl.0 Request processed in 214us (454us total) trans 0 rc 0/0 00000100:00100000:1.0:1789366663.799767:0:8419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 84 00010000:00010000:0.0:1789366663.800147:0:5816:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9638b6ce2400/0x8da3486b955f3f9c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366663.800156:0:5816:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9638b6ce2400/0x8da3486b955f3f9c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366663.800193:0:5816:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9638b6ce2400/0x8da3486b955f3f9c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366663.800199:0:5816:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9638b6ce2400/0x8da3486b955f3f9c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366663.800206:0:5816:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9638b6ce2400/0x8da3486b955f3f9c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366663.800212:0:5816:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9638b6ce2400 already unused, calling callback (ffffffffc20ee4f0) 00010000:00010000:0.0:1789366663.800216:0:5816:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9638b6ce2400/0x8da3486b955f3f9c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366663.800224:0:5816:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9638b6ce2400/0x8da3486b955f3f9c lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366663.800234:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff963890797500) 00010000:00010000:0.0:1789366663.800236:0:5816:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:0.0:1789366663.800240:0:5816:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9638b6ce2400/0x8da3486b955f3f9c lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366663.800247:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9638b6ce2400/0x8da3486b955f3f9c lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789366663.800303:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638bfefaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0ab23baa-a205-44ad-bf17-f7b47295d82b+19:11604:x1876286751468672:12345-192.168.202.23@tcp:55:lhsmtool_posix.0 Request processed in 3842us (4008us total) trans 0 rc -22/-22 00000100:00100000:0.0:1789366663.800311:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 227 00000100:00100000:3.0:1789366663.803222:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:2.0:1789366663.803348:0:8065:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751468928 00000100:00100000:2.0:1789366663.803358:0:8065:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751468928 00000100:00100000:2.0:1789366663.803451:0:8065:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 71 00000100:00100000:2.0:1789366663.803462:0:8065:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638af332680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0ab23baa-a205-44ad-bf17-f7b47295d82b+8:2355:x1876286751468928:12345-192.168.202.23@tcp:1:lhsmtool_posix.0 00010000:00010000:2.0:1789366663.803508:0:8065:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000ea4ba344/0x8da3486b955f3fa3 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366663.803530:0:8065:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000004f4d78f/0x8da3486b955f3f80 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.23@tcp remote: 0xda917a494d06c316 expref: 8 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366663.803538:0:8065:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789366663.803542:0:8065:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789366663.803547:0:8065:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ea4ba344/0x8da3486b955f3fa3 lrc: 4/1,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366663.803580:0:8065:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000004f4d78f/0x8da3486b955f3f80 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.23@tcp remote: 0xda917a494d06c316 expref: 8 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366663.803595:0:8065:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000004f4d78f/0x8da3486b955f3f80 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.23@tcp remote: 0xda917a494d06c316 expref: 8 pid: 6661 timeout: 339 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789366663.803609:0:8065:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9638aef24380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8065:1876286758784896:192.168.202.23@tcp:104: 00000100:00100000:2.0:1789366663.803749:0:8065:0:(client.c:2716:ptlrpc_set_wait()) set ffff9638853926c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789366663.807252:0:8065:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9638aef24380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8065:1876286758784896:192.168.202.23@tcp:104: 00010000:00010000:2.0:1789366663.807284:0:8065:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000ea4ba344/0x8da3486b955f3fa3 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789366663.807826:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:1.0:1789366663.807927:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751469056 00000100:00100000:1.0:1789366663.807933:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751469056 00010000:00010000:1.0:1789366663.807963:0:5803:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000004f4d78f/0x8da3486b955f3f80 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.23@tcp remote: 0xda917a494d06c316 expref: 9 pid: 6661 timeout: 339 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789366663.807997:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 85 00000100:00100000:1.0:1789366663.808004:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638af331c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0ab23baa-a205-44ad-bf17-f7b47295d82b+9:2355:x1876286751469056:12345-192.168.202.23@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789366663.808068:0:5803:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789366663.808087:0:5803:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000004f4d78f/0x8da3486b955f3f80 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.23@tcp remote: 0xda917a494d06c316 expref: 9 pid: 6661 timeout: 339 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366663.808108:0:5803:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000004f4d78f/0x8da3486b955f3f80 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.23@tcp remote: 0xda917a494d06c316 expref: 9 pid: 6661 timeout: 339 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366663.808139:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000004f4d78f/0x8da3486b955f3f80 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.23@tcp remote: 0xda917a494d06c316 expref: 9 pid: 6661 timeout: 339 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366663.808151:0:5803:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789366663.808155:0:5803:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789366663.808159:0:5803:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000ea4ba344/0x8da3486b955f3fa3 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366663.808166:0:5803:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ea4ba344/0x8da3486b955f3fa3 lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366663.808189:0:5803:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789366663.808279:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638af331c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0ab23baa-a205-44ad-bf17-f7b47295d82b+8:2355:x1876286751469056:12345-192.168.202.23@tcp:103:ldlm_bl.0 Request processed in 274us (455us total) trans 0 rc 0/0 00000100:00100000:1.0:1789366663.808287:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 85 00010000:00010000:3.0:1789366663.808375:0:8065:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000ea4ba344/0x8da3486b955f3fa3 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366663.808385:0:8065:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ea4ba344/0x8da3486b955f3fa3 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366663.808410:0:8065:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000ea4ba344/0x8da3486b955f3fa3 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366663.808418:0:8065:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ea4ba344/0x8da3486b955f3fa3 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366663.808426:0:8065:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ea4ba344/0x8da3486b955f3fa3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366663.808433:0:8065:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9638902c8800 already unused, calling callback (ffffffffc16df520) 00010000:00010000:3.0:1789366663.808437:0:8065:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ea4ba344/0x8da3486b955f3fa3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366663.808445:0:8065:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ea4ba344/0x8da3486b955f3fa3 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366663.808456:0:8065:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ea4ba344/0x8da3486b955f3fa3 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366663.808475:0:8065:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ea4ba344/0x8da3486b955f3fa3 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789366663.808530:0:8065:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638af332680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0ab23baa-a205-44ad-bf17-f7b47295d82b+7:2355:x1876286751468928:12345-192.168.202.23@tcp:1:lhsmtool_posix.0 Request processed in 5070us (5318us total) trans 0 rc 0/0 00000100:00100000:3.0:1789366663.808536:0:8065:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 71 00000100:00100000:1.0:1789366663.812870:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:2.0:1789366663.812999:0:7132:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751469312 00000100:00100000:2.0:1789366663.813007:0:7132:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751469312 00000100:00100000:2.0:1789366663.813052:0:7132:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 228 00000100:00100000:2.0:1789366663.813059:0:7132:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96388327c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0ab23baa-a205-44ad-bf17-f7b47295d82b+19:11604:x1876286751469312:12345-192.168.202.23@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1789366663.813139:0:7132:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9200/0x8da3486b955f3faa lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366663.813162:0:7132:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9200/0x8da3486b955f3faa lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366663.813175:0:7132:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9200/0x8da3486b955f3faa lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366663.813492:0:7132:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9c00/0x8da3486b955f3fb1 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366663.813504:0:7132:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9800/0x8da3486b955f3f64 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.23@tcp remote: 0xda917a494d06c301 expref: 20 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366663.813512:0:7132:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9c00/0x8da3486b955f3fb1 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366663.813545:0:7132:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9800/0x8da3486b955f3f64 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.23@tcp remote: 0xda917a494d06c301 expref: 20 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366663.813578:0:7132:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9800/0x8da3486b955f3f64 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.23@tcp remote: 0xda917a494d06c301 expref: 20 pid: 5815 timeout: 339 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789366663.813593:0:7132:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9638aef24380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7132:1876286758785024:192.168.202.23@tcp:104: 00000100:00100000:2.0:1789366663.813744:0:7132:0:(client.c:2716:ptlrpc_set_wait()) set ffff9638900c6300 going to sleep for 11 seconds 00000100:00100000:1.0:1789366663.820688:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:0.0:1789366663.820953:0:8419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751469440 00000100:00100000:0.0:1789366663.820964:0:8419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751469440 00010000:00010000:0.0:1789366663.821004:0:8419:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9800/0x8da3486b955f3f64 lrc: 5/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.23@tcp remote: 0xda917a494d06c301 expref: 21 pid: 5815 timeout: 339 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789366663.821063:0:8419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 86 00000100:00100000:0.0:1789366663.821073:0:8419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96388327f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0ab23baa-a205-44ad-bf17-f7b47295d82b+21:2354:x1876286751469440:12345-192.168.202.23@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789366663.821087:0:8419:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789366663.821094:0:8419:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9800/0x8da3486b955f3f64 lrc: 5/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.23@tcp remote: 0xda917a494d06c301 expref: 21 pid: 5815 timeout: 339 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366663.821108:0:8419:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9800/0x8da3486b955f3f64 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.23@tcp remote: 0xda917a494d06c301 expref: 21 pid: 5815 timeout: 339 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366663.821142:0:8419:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff963890797500) 00010000:00010000:0.0:1789366663.821147:0:8419:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9c00/0x8da3486b955f3fb1 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366663.821155:0:8419:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9c00/0x8da3486b955f3fb1 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366663.821162:0:8419:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9c00/0x8da3486b955f3fb1 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366663.821181:0:8419:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789366663.821237:0:8419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96388327f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0ab23baa-a205-44ad-bf17-f7b47295d82b+21:2354:x1876286751469440:12345-192.168.202.23@tcp:103:ldlm_bl.0 Request processed in 165us (559us total) trans 0 rc 0/0 00000100:00100000:0.0:1789366663.821245:0:8419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 86 00010000:00010000:2.0:1789366663.821422:0:7132:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9800/0x8da3486b955f3f64 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.23@tcp remote: 0xda917a494d06c301 expref: 20 pid: 5815 timeout: 339 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789366663.821440:0:7132:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9638aef24380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7132:1876286758785024:192.168.202.23@tcp:104: 00010000:00010000:2.0:1789366663.821474:0:7132:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9c00/0x8da3486b955f3fb1 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366663.821483:0:7132:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9c00/0x8da3486b955f3fb1 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366663.821489:0:7132:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9c00/0x8da3486b955f3fb1 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789366663.821668:0:7132:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967502 00000001:00080000:2.0:1789366663.822088:0:7132:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967503 00000001:00080000:2.0:1789366663.822145:0:7132:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967504 00000100:00100000:2.0:1789366663.822225:0:7132:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9638aef24380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:7132:1876286758785152:0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1789366663.822275:0:7132:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789366663.822316:0:7132:0:(client.c:2716:ptlrpc_set_wait()) set ffff963882efe9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789366663.823223:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286758785152 00000100:00100000:3.0:1789366663.823232:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286758785152 00000100:00100000:3.0:1789366663.823274:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1789366663.823283:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638aef27800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:7132:x1876286758785152:12345-0@lo:1000:mdt00_003.0 00000100:00100000:3.0:1789366663.823369:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638aef27800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:7132:x1876286758785152:12345-0@lo:1000:mdt00_003.0 Request processed in 86us (1093us total) trans 0 rc 0/0 00000100:00100000:3.0:1789366663.823377:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1789366663.823470:0:7132:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967321 gen 2 00000004:00080000:2.0:1789366663.823476:0:7132:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967317 committed transno 4294967321 00000004:00080000:2.0:1789366663.823497:0:7132:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9638aef24e00, transno 4294967321 00000100:00100000:2.0:1789366663.823528:0:7132:0:(client.c:3170:ptlrpc_free_committed()) @@@ stopping search req@ffff9638aef25500 x1876286758784384/t4294967322(4294967322) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1789366679 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789366663.823539:0:7132:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9638aef24380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:7132:1876286758785152:0@lo:1000:mdt00_003.0 00000001:00080000:2.0:1789366663.824185:0:7132:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967505 00000100:00100000:2.0:1789366663.824252:0:7132:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9638aef24380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:7132:1876286758785280:0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1789366663.824290:0:7132:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789366663.824322:0:7132:0:(client.c:2716:ptlrpc_set_wait()) set ffff963882efe540 going to sleep for 11 seconds 00000100:00100000:3.0:1789366663.824566:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286758785280 00000100:00100000:3.0:1789366663.824571:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286758785280 00000100:00100000:3.0:1789366663.824598:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1789366663.824605:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638aef26a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:7132:x1876286758785280:12345-0@lo:1000:mdt00_003.0 00000100:00100000:3.0:1789366663.824910:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638aef26a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:7132:x1876286758785280:12345-0@lo:1000:mdt00_003.0 Request processed in 304us (619us total) trans 4294967324 rc 0/0 00000100:00100000:3.0:1789366663.824917:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1789366663.825156:0:7132:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9638aef24380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:7132:1876286758785280:0@lo:1000:mdt00_003.0 00010000:00010000:2.0:1789366663.825187:0:7132:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9c00/0x8da3486b955f3fb1 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366663.825198:0:7132:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9c00/0x8da3486b955f3fb1 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366663.825205:0:7132:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9c00/0x8da3486b955f3fb1 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366663.825212:0:7132:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9638902c9c00 already unused, calling callback (ffffffffc20ee4f0) 00010000:00010000:2.0:1789366663.825216:0:7132:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9c00/0x8da3486b955f3fb1 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366663.825225:0:7132:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9c00/0x8da3486b955f3fb1 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366663.825239:0:7132:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff963890797500) 00010000:00010000:2.0:1789366663.825242:0:7132:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789366663.825247:0:7132:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9c00/0x8da3486b955f3fb1 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366663.825254:0:7132:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9c00/0x8da3486b955f3fb1 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366663.825293:0:7132:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720c600/0x8da3486b955f3ef4 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366663.825299:0:7132:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720c600/0x8da3486b955f3ef4 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366663.825305:0:7132:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720c600/0x8da3486b955f3ef4 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366663.825310:0:7132:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9638b720c600 already unused, calling callback (ffffffffc20ee4f0) 00010000:00010000:2.0:1789366663.825313:0:7132:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720c600/0x8da3486b955f3ef4 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366663.825319:0:7132:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720c600/0x8da3486b955f3ef4 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366663.825328:0:7132:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9638a7404700) 00010000:00010000:2.0:1789366663.825331:0:7132:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789366663.825337:0:7132:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c8e00/0x8da3486b955f3efb lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.23@tcp remote: 0xda917a494d06c2e5 expref: 23 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366663.825349:0:7132:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c8e00/0x8da3486b955f3efb lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.23@tcp remote: 0xda917a494d06c2e5 expref: 23 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366663.825357:0:7132:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c8e00/0x8da3486b955f3efb lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.23@tcp remote: 0xda917a494d06c2e5 expref: 23 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366663.825382:0:7132:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c8e00/0x8da3486b955f3efb lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.23@tcp remote: 0xda917a494d06c2e5 expref: 23 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789366663.825418:0:7132:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9638aef27480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7132:1876286758785408:192.168.202.23@tcp:105: 00000100:00100000:2.0:1789366663.825528:0:7132:0:(client.c:2716:ptlrpc_set_wait()) set ffff9638900c6300 going to sleep for 11 seconds 00000100:00100000:0.0:1789366663.833680:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:2.0:1789366663.833803:0:7132:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9638aef27480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7132:1876286758785408:192.168.202.23@tcp:105: 00010000:00010000:2.0:1789366663.833834:0:7132:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720c600/0x8da3486b955f3ef4 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366663.833845:0:7132:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720c600/0x8da3486b955f3ef4 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366663.833876:0:7132:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9800/0x8da3486b955f3fb8 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366663.833889:0:7132:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9800/0x8da3486b955f3fb8 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366663.833899:0:7132:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9800/0x8da3486b955f3fb8 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366663.833909:0:7132:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9800/0x8da3486b955f3fb8 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366663.833915:0:7132:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9800/0x8da3486b955f3fb8 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366663.833921:0:7132:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9800/0x8da3486b955f3fb8 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366663.833927:0:7132:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9638902c9800 already unused, calling callback (ffffffffc20ee4f0) 00010000:00010000:2.0:1789366663.833931:0:7132:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9800/0x8da3486b955f3fb8 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366663.833953:0:7132:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9800/0x8da3486b955f3fb8 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366663.833964:0:7132:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9638a7404700) 00010000:00010000:2.0:1789366663.833967:0:7132:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789366663.833970:0:7132:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9800/0x8da3486b955f3fb8 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366663.833976:0:7132:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9800/0x8da3486b955f3fb8 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366663.833986:0:7132:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9200/0x8da3486b955f3faa lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366663.833992:0:7132:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9200/0x8da3486b955f3faa lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366663.833998:0:7132:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9200/0x8da3486b955f3faa lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366663.834003:0:7132:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9638902c9200 already unused, calling callback (ffffffffc20ee4f0) 00010000:00010000:2.0:1789366663.834006:0:7132:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9200/0x8da3486b955f3faa lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366663.834012:0:7132:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9200/0x8da3486b955f3faa lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366663.834019:0:7132:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9638a7404700) 00010000:00010000:2.0:1789366663.834021:0:7132:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1789366663.834024:0:7132:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9200/0x8da3486b955f3faa lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366663.834040:0:7132:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9200/0x8da3486b955f3faa lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789366663.834276:0:7132:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96388327c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0ab23baa-a205-44ad-bf17-f7b47295d82b+23:11604:x1876286751469312:12345-192.168.202.23@tcp:57:lhsmtool_posix.0 Request processed in 21215us (21414us total) trans 4294967506 rc 0/0 00000100:00100000:2.0:1789366663.834286:0:7132:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 228 00000020:00080000:2.0:1789366663.834293:0:7132:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:0.0:1789366663.834746:0:11650:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1789366663.834752:0:11650:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000100:00100000:3.0:1789366663.835052:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751469568 00000100:00100000:3.0:1789366663.835059:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751469568 00000100:00100000:3.0:1789366663.835106:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 58 00000100:00100000:3.0:1789366663.835114:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638af2e8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0ab23baa-a205-44ad-bf17-f7b47295d82b+23:11603:x1876286751469568:12345-192.168.202.23@tcp:49:lfs.0 00000100:00100000:3.0:1789366663.835224:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638af2e8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0ab23baa-a205-44ad-bf17-f7b47295d82b+23:11603:x1876286751469568:12345-192.168.202.23@tcp:49:lfs.0 Request processed in 110us (1554us total) trans 0 rc 0/0 00000100:00100000:3.0:1789366663.835231:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 58 00000040:00080000:1.0:1789366663.835299:0:11650:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 5 00000040:00080000:1.0:1789366663.835307:0:11650:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1789366663.837608:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:0.0:1789366663.837664:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:2.0:1789366663.837777:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751470080 00000100:00100000:2.0:1789366663.837786:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751470080 00000100:00100000:2.0:1789366663.837839:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 59 00000100:00100000:2.0:1789366663.837862:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638af2eb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0ab23baa-a205-44ad-bf17-f7b47295d82b+23:11604:x1876286751470080:12345-192.168.202.23@tcp:35:lhsmtool_posix.0 00000004:00080000:2.0:1789366663.838504:0:5819:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x10:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:2.0:1789366663.838610:0:5819:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967507 00010000:00010000:2.0:1789366663.838654:0:5819:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9c00/0x8da3486b955f3fbf lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366663.838671:0:5819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9c00/0x8da3486b955f3fbf lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366663.838681:0:5819:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9c00/0x8da3486b955f3fbf lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366663.838689:0:5819:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9c00/0x8da3486b955f3fbf lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366663.838696:0:5819:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9c00/0x8da3486b955f3fbf lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366663.838702:0:5819:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9c00/0x8da3486b955f3fbf lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366663.838756:0:5819:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1789366663.838829:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638af2eb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0ab23baa-a205-44ad-bf17-f7b47295d82b+25:11604:x1876286751470080:12345-192.168.202.23@tcp:35:lhsmtool_posix.0 Request processed in 971us (1164us total) trans 4294967508 rc 0/0 00000100:00100000:2.0:1789366663.838837:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 59 00000020:00080000:2.0:1789366663.838842:0:5819:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1789366663.839061:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751469824 00000100:00100000:3.0:1789366663.839068:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751469824 00000100:00100000:3.0:1789366663.839160:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 229 00000100:00100000:3.0:1789366663.839170:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638af2ea300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0ab23baa-a205-44ad-bf17-f7b47295d82b+25:11603:x1876286751469824:12345-192.168.202.23@tcp:58:lfs.0 00010000:00010000:1.0:1789366663.839181:0:5804:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789366663.839191:0:5804:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9c00/0x8da3486b955f3fbf lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366663.839213:0:5804:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9638902c9c00 already unused, calling callback (ffffffffc16df520) 00010000:00010000:1.0:1789366663.839218:0:5804:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9c00/0x8da3486b955f3fbf lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366663.839227:0:5804:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9c00/0x8da3486b955f3fbf lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366663.839242:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9638a7404d00) 00010000:00010000:1.0:1789366663.839245:0:5804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1789366663.839251:0:5804:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9c00/0x8da3486b955f3fbf lrc: 1/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366663.839258:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9c00/0x8da3486b955f3fbf lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366663.839280:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789366663.839283:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789366663.839285:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1789366663.839357:0:5817:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].6, 136 off9008 00000100:00100000:3.0:1789366663.839399:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638af2ea300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0ab23baa-a205-44ad-bf17-f7b47295d82b+25:11603:x1876286751469824:12345-192.168.202.23@tcp:58:lfs.0 Request processed in 231us (1800us total) trans 0 rc 0/0 00000100:00100000:3.0:1789366663.839407:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 229 00000100:00100000:0.0:1789366663.859558:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:1.0:1789366663.859950:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751470208 00000100:00100000:1.0:1789366663.859960:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751470208 00000100:00100000:1.0:1789366663.860036:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 230 00000100:00100000:1.0:1789366663.860048:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638af2e8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0ab23baa-a205-44ad-bf17-f7b47295d82b+25:11606:x1876286751470208:12345-192.168.202.23@tcp:101:lfs.0 00010000:00010000:1.0:1789366663.860073:0:5816:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789366663.860093:0:5816:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9638b6ce2800/0x8da3486b955f3fc6 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xda917a494d06c31d expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366663.860170:0:5816:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9638b6ce2a00/0x8da3486b955f3fcd lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366663.860204:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9638b6ce2a00/0x8da3486b955f3fcd lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366663.860216:0:5816:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9638b6ce2a00/0x8da3486b955f3fcd lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366663.860231:0:5816:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9638b6ce3400/0x8da3486b955f3fd4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366663.860238:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9638b6ce3400/0x8da3486b955f3fd4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366663.860245:0:5816:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9638b6ce3400/0x8da3486b955f3fd4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366663.860493:0:5816:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9638b6ce3600/0x8da3486b955f3fdb lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366663.860505:0:5816:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720d200/0x8da3486b955f3ee6 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.23@tcp remote: 0xda917a494d06c2de expref: 26 pid: 7132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366663.860513:0:5816:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9638b6ce3600/0x8da3486b955f3fdb lrc: 4/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366663.860546:0:5816:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720d200/0x8da3486b955f3ee6 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.23@tcp remote: 0xda917a494d06c2de expref: 26 pid: 7132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366663.860560:0:5816:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720d200/0x8da3486b955f3ee6 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.23@tcp remote: 0xda917a494d06c2de expref: 26 pid: 7132 timeout: 339 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789366663.860584:0:5816:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96388327ea00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5816:1876286758785536:192.168.202.23@tcp:104: 00000100:00100000:1.0:1789366663.860693:0:5816:0:(client.c:2716:ptlrpc_set_wait()) set ffff96388347a240 going to sleep for 11 seconds 00000100:00100000:1.0:1789366663.864166:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:0.0:1789366663.864312:0:5816:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96388327ea00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5816:1876286758785536:192.168.202.23@tcp:104: 00010000:00010000:0.0:1789366663.864339:0:5816:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9638b6ce3600/0x8da3486b955f3fdb lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789366663.864981:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751470464 00000100:00100000:2.0:1789366663.864990:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751470464 00000100:00100000:2.0:1789366663.865079:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 60 00000100:00100000:2.0:1789366663.865088:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96388327f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0ab23baa-a205-44ad-bf17-f7b47295d82b+27:5580:x1876286751470464:12345-192.168.202.23@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1789366663.865324:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96388327f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0ab23baa-a205-44ad-bf17-f7b47295d82b+28:5580:x1876286751470464:12345-192.168.202.23@tcp:35:ldlm_bl.0 Request processed in 236us (1166us total) trans 4294967509 rc 0/0 00000100:00100000:2.0:1789366663.865332:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 60 00000100:00100000:0.0:1789366663.867019:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:1.0:1789366663.867099:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751470592 00000100:00100000:1.0:1789366663.867108:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751470592 00010000:00010000:1.0:1789366663.867150:0:5803:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720d200/0x8da3486b955f3ee6 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.23@tcp remote: 0xda917a494d06c2de expref: 28 pid: 7132 timeout: 339 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789366663.867179:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 87 00000100:00100000:1.0:1789366663.867189:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638986c4450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0ab23baa-a205-44ad-bf17-f7b47295d82b+28:2355:x1876286751470592:12345-192.168.202.23@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789366663.867202:0:5803:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789366663.867209:0:5803:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720d200/0x8da3486b955f3ee6 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.23@tcp remote: 0xda917a494d06c2de expref: 28 pid: 7132 timeout: 339 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366663.867222:0:5803:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720d200/0x8da3486b955f3ee6 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.23@tcp remote: 0xda917a494d06c2de expref: 28 pid: 7132 timeout: 339 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366663.867242:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720d200/0x8da3486b955f3ee6 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.23@tcp remote: 0xda917a494d06c2de expref: 28 pid: 7132 timeout: 339 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366663.867257:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9638a7404700) 00010000:00010000:1.0:1789366663.867262:0:5803:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9638b6ce3600/0x8da3486b955f3fdb lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366663.867273:0:5803:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9638b6ce3600/0x8da3486b955f3fdb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366663.867298:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9638b6ce3600/0x8da3486b955f3fdb lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366663.867328:0:5803:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789366663.867376:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638986c4450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0ab23baa-a205-44ad-bf17-f7b47295d82b+27:2355:x1876286751470592:12345-192.168.202.23@tcp:103:ldlm_bl.0 Request processed in 188us (361us total) trans 0 rc 0/0 00000100:00100000:1.0:1789366663.867383:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 87 00010000:00010000:0.0:1789366663.867520:0:5816:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9638b6ce3600/0x8da3486b955f3fdb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366663.867530:0:5816:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9638b6ce3600/0x8da3486b955f3fdb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789366663.867567:0:5816:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:0.0:1789366663.867572:0:5816:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1789366663.867589:0:5816:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9638b6ce3600/0x8da3486b955f3fdb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366663.867601:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9638b6ce3600/0x8da3486b955f3fdb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366663.867611:0:5816:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9638b6ce2a00/0x8da3486b955f3fcd lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366663.867617:0:5816:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9638b6ce2a00/0x8da3486b955f3fcd lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366663.867623:0:5816:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9638b6ce2a00/0x8da3486b955f3fcd lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366663.867629:0:5816:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9638b6ce2a00 already unused, calling callback (ffffffffc20ee4f0) 00010000:00010000:0.0:1789366663.867633:0:5816:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9638b6ce2a00/0x8da3486b955f3fcd lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366663.867650:0:5816:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9638b6ce2a00/0x8da3486b955f3fcd lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366663.867660:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff963890797800) 00010000:00010000:0.0:1789366663.867663:0:5816:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789366663.867667:0:5816:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9638b6ce2a00/0x8da3486b955f3fcd lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366663.867673:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9638b6ce2a00/0x8da3486b955f3fcd lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366663.867684:0:5816:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9638b6ce3400/0x8da3486b955f3fd4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366663.867690:0:5816:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9638b6ce3400/0x8da3486b955f3fd4 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366663.867696:0:5816:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9638b6ce3400/0x8da3486b955f3fd4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366663.867700:0:5816:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9638b6ce3400 already unused, calling callback (ffffffffc20ee4f0) 00010000:00010000:0.0:1789366663.867703:0:5816:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9638b6ce3400/0x8da3486b955f3fd4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366663.867708:0:5816:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9638b6ce3400/0x8da3486b955f3fd4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366663.867758:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff963887f88200) 00010000:00010000:0.0:1789366663.867761:0:5816:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789366663.867764:0:5816:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9638b6ce3400/0x8da3486b955f3fd4 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366663.867781:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9638b6ce3400/0x8da3486b955f3fd4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366663.867816:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9638b6ce2800/0x8da3486b955f3fc6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.23@tcp remote: 0xda917a494d06c31d expref: 27 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366663.867830:0:5816:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9638b6ce3600/0x8da3486b955f3fdb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.23@tcp remote: 0xda917a494d06c31d expref: 26 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366663.867838:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9638a7404700) 00010000:00010000:0.0:1789366663.867840:0:5816:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789366663.867855:0:5816:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9638b6ce3600, rc 0) 00000100:00100000:0.0:1789366663.867880:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638af2e8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0ab23baa-a205-44ad-bf17-f7b47295d82b+26:11606:x1876286751470208:12345-192.168.202.23@tcp:101:lfs.0 Request processed in 7834us (8331us total) trans 0 rc 0/0 00000100:00100000:0.0:1789366663.867887:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 230 00010000:00010000:0.0:1789366664.248713:0:6675:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1789366664.406660:0:12516:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1789366664.406671:0:12516:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1789366664.406806:0:12516:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 6 00000040:00080000:0.0:1789366664.406816:0:12516:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000040:00080000:1.0:1789366664.888025:0:11650:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1789366664.888036:0:11650:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1789366664.888075:0:11650:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 6 00000040:00080000:1.0:1789366664.888082:0:11650:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1789366664.888282:0:11650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96388327ce00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11650:1876286758785664:192.168.202.23@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1789366664.888598:0:11650:0:(client.c:2716:ptlrpc_set_wait()) set ffff96388347a000 going to sleep for 11 seconds 00000100:00100000:1.0:1789366664.890699:0:11650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96388327ce00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11650:1876286758785664:192.168.202.23@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1789366664.892309:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:2.0:1789366664.892380:0:7132:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751470720 00000100:00100000:2.0:1789366664.892389:0:7132:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751470720 00000100:00100000:2.0:1789366664.892466:0:7132:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 231 00000100:00100000:2.0:1789366664.892476:0:7132:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638af331180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0ab23baa-a205-44ad-bf17-f7b47295d82b+26:11618:x1876286751470720:12345-192.168.202.23@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1789366664.892526:0:7132:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1789366664.892617:0:7132:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638af331180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0ab23baa-a205-44ad-bf17-f7b47295d82b+26:11618:x1876286751470720:12345-192.168.202.23@tcp:53:lhsmtool_posix.0 Request processed in 142us (313us total) trans 0 rc 0/0 00000100:00100000:2.0:1789366664.892624:0:7132:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 231 00000100:00080000:1.0:1789366664.893042:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789366664.897000:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:3.0:1789366664.897083:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751470976 00000100:00100000:3.0:1789366664.897094:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751470976 00000100:00100000:3.0:1789366664.897176:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 232 00000100:00100000:3.0:1789366664.897187:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638af2eb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0ab23baa-a205-44ad-bf17-f7b47295d82b+26:11618:x1876286751470976:12345-192.168.202.23@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789366664.897208:0:5817:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789366664.897228:0:5817:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9638832d3600/0x8da3486b955f3fe2 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xda917a494d06c324 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366664.897333:0:5817:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9638832d2000/0x8da3486b955f3fe9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366664.897348:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9638832d2000/0x8da3486b955f3fe9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366664.897361:0:5817:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9638832d2000/0x8da3486b955f3fe9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789366664.897371:0:5817:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:3.0:1789366664.897499:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9638832d3600/0x8da3486b955f3fe2 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.23@tcp remote: 0xda917a494d06c324 expref: 29 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366664.897537:0:5817:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9638832d2000/0x8da3486b955f3fe9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.23@tcp remote: 0xda917a494d06c324 expref: 28 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366664.897546:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9638a7404700) 00010000:00010000:3.0:1789366664.897549:0:5817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789366664.897553:0:5817:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9638832d2000, rc 0) 00000100:00100000:3.0:1789366664.897625:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638af2eb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0ab23baa-a205-44ad-bf17-f7b47295d82b+28:11618:x1876286751470976:12345-192.168.202.23@tcp:101:lhsmtool_posix.0 Request processed in 440us (635us total) trans 4294967510 rc 0/0 00000100:00100000:3.0:1789366664.897633:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 232 00000100:00100000:3.0:1789366664.902862:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:3.0:1789366664.902965:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:1.0:1789366664.903170:0:8419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751471360 00000100:00100000:1.0:1789366664.903182:0:8419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751471360 00000100:00100000:1.0:1789366664.903248:0:8419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 17 00000100:00100000:1.0:1789366664.903259:0:8419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638af330e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0ab23baa-a205-44ad-bf17-f7b47295d82b+28:2355:x1876286751471360:12345-192.168.202.23@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789366664.903275:0:8419:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789366664.903301:0:8419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9638832d2000/0x8da3486b955f3fe9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.23@tcp remote: 0xda917a494d06c324 expref: 28 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366664.903322:0:8419:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9638a7404700) 00010000:00010000:1.0:1789366664.903328:0:8419:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789366664.903398:0:8419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638af330e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0ab23baa-a205-44ad-bf17-f7b47295d82b+27:2355:x1876286751471360:12345-192.168.202.23@tcp:103:ldlm_bl.0 Request processed in 141us (432us total) trans 0 rc 0/0 00000100:00100000:1.0:1789366664.903417:0:8419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 17 00000100:00100000:0.0:1789366664.903489:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751471232 00000100:00100000:0.0:1789366664.903494:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751471232 00000100:00100000:0.0:1789366664.903527:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 233 00000100:00100000:0.0:1789366664.903533:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638af331500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0ab23baa-a205-44ad-bf17-f7b47295d82b+27:11618:x1876286751471232:12345-192.168.202.23@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1789366664.903604:0:5816:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720ca00/0x8da3486b955f3ff7 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366664.903626:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720ca00/0x8da3486b955f3ff7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366664.903638:0:5816:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720ca00/0x8da3486b955f3ff7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366664.903856:0:5816:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720ca00/0x8da3486b955f3ff7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366664.903863:0:5816:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720ca00/0x8da3486b955f3ff7 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366664.903872:0:5816:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720ca00/0x8da3486b955f3ff7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366664.903877:0:5816:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9638b720ca00 already unused, calling callback (ffffffffc20ee4f0) 00010000:00010000:0.0:1789366664.903881:0:5816:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720ca00/0x8da3486b955f3ff7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366664.903889:0:5816:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720ca00/0x8da3486b955f3ff7 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366664.903900:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9638a7404700) 00010000:00010000:0.0:1789366664.903903:0:5816:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1789366664.903907:0:5816:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720ca00/0x8da3486b955f3ff7 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366664.903915:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720ca00/0x8da3486b955f3ff7 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789366664.904035:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638af331500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0ab23baa-a205-44ad-bf17-f7b47295d82b+28:11618:x1876286751471232:12345-192.168.202.23@tcp:57:lhsmtool_posix.0 Request processed in 501us (1184us total) trans 4294967511 rc 0/0 00000100:00100000:0.0:1789366664.904048:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 233 00000040:00080000:1.0:1789366664.904178:0:11650:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1789366664.904182:0:11650:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1789366664.904637:0:11650:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 6 00000040:00080000:1.0:1789366664.904644:0:11650:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1789366664.909464:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:0.0:1789366664.909530:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751471616 00000100:00100000:0.0:1789366664.909543:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751471616 00000100:00100000:0.0:1789366664.909619:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 61 00000100:00100000:0.0:1789366664.909630:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963888cba850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0ab23baa-a205-44ad-bf17-f7b47295d82b+28:11618:x1876286751471616:12345-192.168.202.23@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1789366664.909892:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963888cba850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0ab23baa-a205-44ad-bf17-f7b47295d82b+29:11618:x1876286751471616:12345-192.168.202.23@tcp:35:lhsmtool_posix.0 Request processed in 263us (440us total) trans 4294967512 rc 0/0 00000100:00100000:0.0:1789366664.909912:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 61 00010000:00010000:1.0:1789366665.274443:0:5805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789366665.655842:0:3286:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789366665.655866:0:3286:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9638af2e9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3286:1876286758785792:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789366665.655930:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789366665.656000:0:7134:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286758785792 00000100:00100000:0.0:1789366665.656009:0:7134:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286758785792 00000100:00080000:1.0:1789366665.656053:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789366665.656072:0:7134:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1789366665.656082:0:7134:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638af2e8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3286:x1876286758785792:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789366665.656124:0:7134:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789366665.656176:0:7134:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638af2e8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3286:x1876286758785792:12345-0@lo:13:osp-pre-0-0.0 Request processed in 95us (245us total) trans 0 rc 0/0 00000100:00100000:0.0:1789366665.656183:0:7134:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1789366665.656281:0:3286:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9638af2e9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3286:1876286758785792:0@lo:13:osp-pre-0-0.0 00000040:00080000:3.0:1789366665.914801:0:12567:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1789366665.914811:0:12567:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1789366665.914879:0:12567:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 6 00000040:00080000:3.0:1789366665.914884:0:12567:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1789366666.030998:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:1.0:1789366666.031575:0:7614:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751471872 00000100:00100000:1.0:1789366666.031583:0:7614:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751471872 00000100:00100000:1.0:1789366666.031638:0:7614:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 234 00000100:00100000:1.0:1789366666.031648:0:7614:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638af2eb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0ab23baa-a205-44ad-bf17-f7b47295d82b+29:11639:x1876286751471872:12345-192.168.202.23@tcp:101:lfs.0 00010000:00010000:1.0:1789366666.031670:0:7614:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00080000:0.0:1789366666.031681:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1789366666.031688:0:7614:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9638b6ce2a00/0x8da3486b955f3ffe lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xda917a494d06c32b expref: -99 pid: 7614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366666.031807:0:7614:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9638b6ce2e00/0x8da3486b955f4005 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7614 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366666.031822:0:7614:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9638b6ce2e00/0x8da3486b955f4005 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7614 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366666.031834:0:7614:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9638b6ce2e00/0x8da3486b955f4005 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7614 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789366666.031843:0:7614:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:1.0:1789366666.031953:0:7614:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9638b6ce2a00/0x8da3486b955f3ffe lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.23@tcp remote: 0xda917a494d06c32b expref: 32 pid: 7614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366666.031979:0:7614:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9638b6ce2e00/0x8da3486b955f4005 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.23@tcp remote: 0xda917a494d06c32b expref: 31 pid: 7614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366666.031989:0:7614:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9638a7404700) 00010000:00010000:1.0:1789366666.031992:0:7614:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1789366666.031996:0:7614:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9638b6ce2e00, rc 0) 00000100:00100000:1.0:1789366666.032055:0:7614:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638af2eb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0ab23baa-a205-44ad-bf17-f7b47295d82b+31:11639:x1876286751471872:12345-192.168.202.23@tcp:101:lfs.0 Request processed in 408us (1064us total) trans 4294967513 rc 0/0 00000100:00100000:1.0:1789366666.032062:0:7614:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 234 00000100:00100000:2.0:1789366666.034261:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:0.0:1789366666.034566:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751472000 00000100:00100000:0.0:1789366666.034576:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751472000 00000100:00100000:0.0:1789366666.034628:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 235 00000100:00100000:0.0:1789366666.034638:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638aef27480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0ab23baa-a205-44ad-bf17-f7b47295d82b+31:11639:x1876286751472000:12345-192.168.202.23@tcp:54:lfs.0 00010000:00010000:0.0:1789366666.034705:0:5815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720c000/0x8da3486b955f4013 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366666.034736:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720c000/0x8da3486b955f4013 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366666.034749:0:5815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720c000/0x8da3486b955f4013 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366666.034772:0:5815:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720c000/0x8da3486b955f4013 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366666.034778:0:5815:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720c000/0x8da3486b955f4013 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366666.034785:0:5815:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720c000/0x8da3486b955f4013 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366666.034793:0:5815:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9638b720c000 already unused, calling callback (ffffffffc20ee4f0) 00010000:00010000:0.0:1789366666.034797:0:5815:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720c000/0x8da3486b955f4013 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366666.034805:0:5815:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720c000/0x8da3486b955f4013 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366666.034815:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9638a7404700) 00010000:00010000:0.0:1789366666.034819:0:5815:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1789366666.034824:0:5815:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720c000/0x8da3486b955f4013 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366666.034830:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720c000/0x8da3486b955f4013 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789366666.035034:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638aef27480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0ab23baa-a205-44ad-bf17-f7b47295d82b+31:11639:x1876286751472000:12345-192.168.202.23@tcp:54:lfs.0 Request processed in 394us (774us total) trans 0 rc 0/0 00000100:00100000:0.0:1789366666.035041:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 235 00000100:00100000:0.0:1789366666.098784:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:1.0:1789366666.099388:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751472128 00000100:00100000:1.0:1789366666.099400:0:6661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751472128 00000100:00100000:1.0:1789366666.099475:0:6661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 72 00000100:00100000:1.0:1789366666.099488:0:6661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638af2e9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0ab23baa-a205-44ad-bf17-f7b47295d82b+7:2357:x1876286751472128:12345-192.168.202.23@tcp:101:cat.0 00010000:00010000:1.0:1789366666.099507:0:6661:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789366666.099530:0:6661:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000daa60d78/0x8da3486b955f401a lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda917a494d06c332 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789366666.099559:0:6661:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x6:0x0] initial LVB size: 13, mtime: 0x6aa79187, atime: 0x6aa79187, ctime: 0x6aa79187, blocks: 0xb 00010000:00010000:1.0:1789366666.099577:0:6661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=241s v=(0 0) 00010000:00010000:1.0:1789366666.099582:0:6661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789366666.099592:0:6661:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000daa60d78/0x8da3486b955f401a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.23@tcp remote: 0xda917a494d06c332 expref: 8 pid: 6661 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366666.099611:0:6661:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000daa60d78/0x8da3486b955f401a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.23@tcp remote: 0xda917a494d06c332 expref: 8 pid: 6661 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366666.099646:0:6661:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9638b6ce2a00, rc 0) 00000100:00080000:0.0:1789366666.099680:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789366666.099711:0:6661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638af2e9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0ab23baa-a205-44ad-bf17-f7b47295d82b+8:2357:x1876286751472128:12345-192.168.202.23@tcp:101:cat.0 Request processed in 225us (936us total) trans 0 rc 0/0 00000100:00100000:1.0:1789366666.099753:0:6661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 72 00000100:00100000:2.0:1789366666.108181:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:0.0:1789366666.108264:0:6664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751472256 00000100:00100000:0.0:1789366666.108273:0:6664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751472256 00002000:00100000:0.0:1789366666.108314:0:6664:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x6:0x0] (0->4095) req@ffff9638aef24000 x1876286751472256/t0(0) o3->0ab23baa-a205-44ad-bf17-f7b47295d82b@192.168.202.23@tcp:67/0 lens 488/0 e 0 to 0 dl 1789366677 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789366666.108322:0:6664:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9638aef24000 with x1876286751472256 ext(0->4095) 00002000:00010000:0.0:1789366666.108326:0:6664:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9638aef24000 00000100:00100000:0.0:1789366666.108351:0:6664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 8 00000100:00100000:0.0:1789366666.108358:0:6664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638aef24000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0ab23baa-a205-44ad-bf17-f7b47295d82b+8:2356:x1876286751472256:12345-192.168.202.23@tcp:3:cat.0 00000100:00100000:0.0:1789366666.108549:0:6664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638aef24000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0ab23baa-a205-44ad-bf17-f7b47295d82b+8:2356:x1876286751472256:12345-192.168.202.23@tcp:3:cat.0 Request processed in 191us (378us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1789366666.108554:0:6664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 8 00002000:00100000:0.0:1789366666.108559:0:6664:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x6:0x0] (0->4095) req@ffff9638aef24000 x1876286751472256/t0(0) o3->0ab23baa-a205-44ad-bf17-f7b47295d82b@192.168.202.23@tcp:67/0 lens 488/4536 e 0 to 0 dl 1789366677 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789366666.108572:0:6664:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9638aef24000 with x1876286751472256 ext(0->4095) 00002000:00010000:0.0:1789366666.108574:0:6664:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9638aef24000 00010000:00010000:0.0:1789366666.298221:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1789366666.733927:0:7617:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967308 is committed 00000001:00080000:1.0:1789366666.733962:0:7617:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967310 is committed 00010000:00010000:0.0:1789366667.319966:0:6675:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789366667.981433:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:1.0:1789366667.981466:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:1.0:1789366667.981503:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:2.0:1789366667.981607:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751472640 00000100:00100000:2.0:1789366667.981617:0:6660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751472640 00000100:00100000:2.0:1789366667.981668:0:6660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 60 00000100:00100000:2.0:1789366667.981686:0:6660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96388327ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0ab23baa-a205-44ad-bf17-f7b47295d82b+8:2355:x1876286751472640:12345-192.168.202.23@tcp:400:kworker.0 00000100:00100000:2.0:1789366667.981772:0:6660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96388327ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0ab23baa-a205-44ad-bf17-f7b47295d82b+8:2355:x1876286751472640:12345-192.168.202.23@tcp:400:kworker.0 Request processed in 86us (304us total) trans 0 rc 0/0 00000100:00100000:2.0:1789366667.981780:0:6660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 60 00000100:00100000:1.0:1789366667.982135:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:1.0:1789366667.982157:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:1.0:1789366667.982179:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751472896 00000100:00100000:1.0:1789366667.982183:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751472896 00000100:00100000:1.0:1789366667.982220:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751472512 00000100:00100000:1.0:1789366667.982223:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751472512 00000100:00100000:1.0:1789366667.982237:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 121 00000100:00100000:1.0:1789366667.982241:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96388327f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b9764435-e52f-45ac-a5f9-bab1231105ac+5:2355:x1876286751472896:12345-192.168.202.23@tcp:400:kworker.0 00000100:00100000:1.0:1789366667.982266:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96388327f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b9764435-e52f-45ac-a5f9-bab1231105ac+5:2355:x1876286751472896:12345-192.168.202.23@tcp:400:kworker.0 Request processed in 25us (763us total) trans 0 rc 0/0 00000100:00100000:1.0:1789366667.982271:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 121 00000100:00100000:1.0:1789366667.982279:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 122 00000100:00100000:1.0:1789366667.982283:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96388327c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0ab23baa-a205-44ad-bf17-f7b47295d82b+31:2355:x1876286751472512:12345-192.168.202.23@tcp:400:kworker.0 00000100:00100000:1.0:1789366667.982296:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96388327c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0ab23baa-a205-44ad-bf17-f7b47295d82b+31:2355:x1876286751472512:12345-192.168.202.23@tcp:400:kworker.0 Request processed in 14us (172us total) trans 0 rc 0/0 00000100:00100000:1.0:1789366667.982308:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 122 00000100:00100000:1.0:1789366667.982320:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751472768 00000100:00100000:1.0:1789366667.982322:0:6659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751472768 00000100:00100000:1.0:1789366667.982337:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 61 00000100:00100000:1.0:1789366667.982341:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96388327df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0ab23baa-a205-44ad-bf17-f7b47295d82b+5:2355:x1876286751472768:12345-192.168.202.23@tcp:400:kworker.0 00000100:00100000:1.0:1789366667.982358:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96388327df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0ab23baa-a205-44ad-bf17-f7b47295d82b+5:2355:x1876286751472768:12345-192.168.202.23@tcp:400:kworker.0 Request processed in 17us (202us total) trans 0 rc 0/0 00000100:00100000:1.0:1789366667.982362:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 61 00000100:00080000:1.0:1789366667.982371:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789366667.982374:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789366667.982466:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751472384 00000100:00100000:3.0:1789366667.982470:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751472384 00000100:00100000:3.0:1789366667.982496:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 279 00000100:00100000:3.0:1789366667.982501:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638b4e83c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:14a2847b-91d8-4d87-b71b-010443acc91a+13:2355:x1876286751472384:12345-192.168.202.23@tcp:400:kworker.0 00000100:00100000:3.0:1789366667.982529:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638b4e83c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:14a2847b-91d8-4d87-b71b-010443acc91a+13:2355:x1876286751472384:12345-192.168.202.23@tcp:400:kworker.0 Request processed in 28us (1112us total) trans 0 rc 0/0 00000100:00100000:3.0:1789366667.982533:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 279 00000100:00100000:1.0:1789366668.216005:0:3285:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789366668.216030:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9638af332300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3285:1876286758785920:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789366668.216109:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789366668.216214:0:6663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286758785920 00000100:00100000:3.0:1789366668.216223:0:6663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286758785920 00000100:00100000:3.0:1789366668.216316:0:6663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1789366668.216327:0:6663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96388327fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1876286758785920:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789366668.216362:0:6663:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789366668.216409:0:6663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96388327fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1876286758785920:12345-0@lo:13:osp-pre-1-0.0 Request processed in 84us (298us total) trans 0 rc 0/0 00000100:00100000:3.0:1789366668.216416:0:6663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00080000:1.0:1789366668.216483:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789366668.216510:0:3285:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967310 gen 2 00000004:00080000:1.0:1789366668.216515:0:3285:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967306 committed transno 4294967310 00000004:00080000:1.0:1789366668.216537:0:3285:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9638bfef8000, transno 4294967307 00000004:00080000:1.0:1789366668.216558:0:3285:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967309 committed transno 4294967310 00000004:00080000:1.0:1789366668.216571:0:3285:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff96388327e680, transno 4294967310 00000100:00100000:1.0:1789366668.216582:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9638af332300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3285:1876286758785920:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789366668.217273:0:3287:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9638aef25880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3287:1876286758786304:0@lo:400:kworker.0 00000100:00100000:2.0:1789366668.217311:0:3287:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789366668.217343:0:3287:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789366668.217348:0:3287:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9638aef27b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3287:1876286758786176:0@lo:400:kworker.0 00000100:00100000:2.0:1789366668.217371:0:3287:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789366668.217419:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9638aef24700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3284:1876286758786432:0@lo:400:kworker.0 00000100:00100000:0.0:1789366668.217452:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789366668.217489:0:3284:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1789366668.217495:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9638aef25f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8cde4528-5832-4854-a387-4adacc3dd0ab:3284:1876286758786048:0@lo:400:kworker.0 00000100:00100000:0.0:1789366668.217520:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789366668.217541:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9638aef26d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3284:1876286758786560:0@lo:400:kworker.0 00000100:00100000:0.0:1789366668.217561:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789366668.217753:0:7132:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286758786304 00000100:00100000:1.0:1789366668.217759:0:7132:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286758786304 00000100:00100000:1.0:1789366668.217805:0:7132:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286758786176 00000100:00100000:1.0:1789366668.217808:0:7132:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286758786176 00000100:00100000:1.0:1789366668.217826:0:7132:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286758786560 00000100:00100000:1.0:1789366668.217829:0:7132:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286758786560 00000100:00100000:1.0:1789366668.217844:0:7132:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:1.0:1789366668.217859:0:7132:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638aef24a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3287:x1876286758786304:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789366668.217902:0:7132:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638aef24a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3287:x1876286758786304:12345-0@lo:400:kworker.0 Request processed in 44us (590us total) trans 0 rc 0/0 00000100:00100000:1.0:1789366668.217909:0:7132:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:1.0:1789366668.217923:0:7132:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:1.0:1789366668.217930:0:7132:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638aef26680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3287:x1876286758786176:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789366668.217957:0:7132:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638aef26680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3287:x1876286758786176:12345-0@lo:400:kworker.0 Request processed in 27us (584us total) trans 0 rc 0/0 00000100:00100000:1.0:1789366668.217963:0:7132:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00080000:0.0:1789366668.217973:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789366668.217978:0:7132:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:1.0:1789366668.217986:0:7132:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638af2eaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3284:x1876286758786560:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789366668.218026:0:7132:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638af2eaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3284:x1876286758786560:12345-0@lo:400:kworker.0 Request processed in 40us (463us total) trans 0 rc 0/0 00000100:00100000:1.0:1789366668.218032:0:7132:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:0.0:1789366668.218054:0:3287:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9638aef27b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3287:1876286758786176:0@lo:400:kworker.0 00000100:00100000:1.0:1789366668.218066:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9638aef26d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3284:1876286758786560:0@lo:400:kworker.0 00000100:00100000:0.0:1789366668.218073:0:3287:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9638aef25880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3287:1876286758786304:0@lo:400:kworker.0 00000100:00100000:3.0:1789366668.218261:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286758786048 00000100:00100000:3.0:1789366668.218267:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286758786048 00000100:00100000:3.0:1789366668.218301:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 280 00000100:00100000:3.0:1789366668.218309:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638b4e82c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8cde4528-5832-4854-a387-4adacc3dd0ab+19:3284:x1876286758786048:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789366668.218353:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638b4e82c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8cde4528-5832-4854-a387-4adacc3dd0ab+19:3284:x1876286758786048:12345-0@lo:400:kworker.0 Request processed in 45us (832us total) trans 0 rc 0/0 00000100:00100000:3.0:1789366668.218359:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 280 00000100:00100000:2.0:1789366668.218616:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286758786432 00000100:00100000:2.0:1789366668.218621:0:6660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286758786432 00000100:00080000:0.0:1789366668.218666:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789366668.218679:0:6660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1789366668.218687:0:6660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638af2ea680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3284:x1876286758786432:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789366668.218755:0:6660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638af2ea680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3284:x1876286758786432:12345-0@lo:400:kworker.0 Request processed in 69us (1302us total) trans 0 rc 0/0 00000100:00100000:2.0:1789366668.218762:0:6660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1789366668.219251:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9638aef25f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8cde4528-5832-4854-a387-4adacc3dd0ab:3284:1876286758786048:0@lo:400:kworker.0 00000100:00100000:1.0:1789366668.219263:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9638aef24700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3284:1876286758786432:0@lo:400:kworker.0 00010000:00010000:1.0:1789366668.343945:0:5805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1789366668.796643:0:5837:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967512 is committed 00000001:00080000:1.0:1789366668.796663:0:5837:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967513 is committed 00000020:00080000:1.0:1789366668.796673:0:5837:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 7 batchid updated 00000020:00080000:2.0:1789366668.796691:0:5848:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 7 00000020:00080000:1.0:1789366668.796695:0:5837:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff963882efe9c0 refcount 2 committed 0 result 0 batchid 8 00000020:00080000:1.0:1789366668.796700:0:5837:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9638bfe67b00 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff963882efef00 00000020:00080000:1.0:1789366668.796703:0:5837:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9638bfe67f00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9638bfeeb800 00000020:00080000:2.0:1789366668.796704:0:5848:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 7 00000020:00080000:2.0:1789366668.796739:0:5848:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 8 committed batchid 7 00000020:00080000:2.0:1789366668.796921:0:5848:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 7 00000100:00100000:2.0:1789366669.071145:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:0.0:1789366669.071667:0:7614:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751473024 00000100:00100000:0.0:1789366669.071678:0:7614:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751473024 00000100:00080000:1.0:1789366669.071773:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789366669.071798:0:7614:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 236 00000100:00100000:0.0:1789366669.071810:0:7614:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638aef25c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0ab23baa-a205-44ad-bf17-f7b47295d82b+18:11292:x1876286751473024:12345-192.168.202.23@tcp:60:lhsmtool_posix.0 00000100:00100000:0.0:1789366669.071915:0:7614:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638aef25c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0ab23baa-a205-44ad-bf17-f7b47295d82b+18:11292:x1876286751473024:12345-192.168.202.23@tcp:60:lhsmtool_posix.0 Request processed in 108us (780us total) trans 0 rc 0/0 00000100:00100000:0.0:1789366669.071923:0:7614:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 236 00000100:00100000:3.0:1789366669.074183:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:2.0:1789366669.074255:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751473280 00000100:00100000:2.0:1789366669.074265:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751473280 00000100:00100000:2.0:1789366669.074447:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 62 00000100:00100000:2.0:1789366669.074459:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638af333100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0ab23baa-a205-44ad-bf17-f7b47295d82b+18:11292:x1876286751473280:12345-192.168.202.23@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1789366669.074826:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638af333100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0ab23baa-a205-44ad-bf17-f7b47295d82b+19:11292:x1876286751473280:12345-192.168.202.23@tcp:35:lhsmtool_posix.0 Request processed in 369us (651us total) trans 4294967514 rc 0/0 00000100:00100000:2.0:1789366669.074847:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 62 00000100:00100000:1.0:1789366669.250020:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:3.0:1789366669.250257:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751473408 00000100:00100000:3.0:1789366669.250268:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751473408 00000100:00100000:3.0:1789366669.250368:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 237 00000100:00100000:3.0:1789366669.250379:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96388327d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b9764435-e52f-45ac-a5f9-bab1231105ac+5:12089:x1876286751473408:12345-192.168.202.23@tcp:101:lsof.0 00010000:00010000:3.0:1789366669.250398:0:5817:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789366669.250460:0:5817:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9638832d3600/0x8da3486b955f4021 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xda917a494d06c339 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366669.250524:0:5817:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9638832d3c00/0x8da3486b955f4028 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366669.250539:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9638832d3c00/0x8da3486b955f4028 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366669.250565:0:5817:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9638832d3c00/0x8da3486b955f4028 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789366669.250599:0:5817:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1789366669.250603:0:5817:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1789366669.250625:0:5817:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9638832d3c00/0x8da3486b955f4028 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366669.250649:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9638832d3600/0x8da3486b955f4021 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.23@tcp remote: 0xda917a494d06c339 expref: 7 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366669.250667:0:5817:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9638832d3c00/0x8da3486b955f4028 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.23@tcp remote: 0xda917a494d06c339 expref: 6 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366669.250676:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9638a7404800) 00010000:00010000:3.0:1789366669.250678:0:5817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789366669.250682:0:5817:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9638832d3c00, rc 0) 00000100:00100000:3.0:1789366669.250760:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96388327d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b9764435-e52f-45ac-a5f9-bab1231105ac+6:12089:x1876286751473408:12345-192.168.202.23@tcp:101:lsof.0 Request processed in 382us (749us total) trans 0 rc 0/0 00000100:00100000:3.0:1789366669.250767:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 237 00000100:00080000:1.0:1789366669.254714:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:00080000:1.0:1789366669.263753:0:6685:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967323 is committed 00000001:00080000:1.0:1789366669.263769:0:6685:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967324 is committed 00010000:00010000:0.0:1789366669.368014:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789366670.392208:0:6675:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789366670.775960:0:3287:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789366670.775983:0:3287:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96388327c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3287:1876286758786688:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789366670.776154:0:3287:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789366670.776269:0:6662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286758786688 00000100:00100000:1.0:1789366670.776277:0:6662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286758786688 00000100:00100000:1.0:1789366670.776342:0:6662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1789366670.776352:0:6662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638aef25180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3287:x1876286758786688:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789366670.776388:0:6662:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789366670.776444:0:6662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638aef25180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3287:x1876286758786688:12345-0@lo:13:osp-pre-0-0.0 Request processed in 94us (389us total) trans 0 rc 0/0 00000100:00100000:1.0:1789366670.776451:0:6662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1789366670.776489:0:3287:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967324 gen 2 00000004:00080000:3.0:1789366670.776497:0:3287:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9638aef25500, transno 4294967322 00000100:00080000:2.0:1789366670.776516:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000004:00080000:3.0:1789366670.776517:0:3287:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967324 committed transno 4294967324 00000100:00100000:3.0:1789366670.776547:0:3287:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96388327c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3287:1876286758786688:0@lo:13:osp-pre-0-0.0 00000001:02000400:0.0:1789366671.100235:0:12768:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1c: Test automated attach using Project ID with manual HSM restore ========================================================== 02:17:50 (1789366670) 00010000:00010000:1.0:1789366671.415864:0:5805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1789366672.061214:0:11650:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1789366672.061225:0:11650:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1789366672.061587:0:11650:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:1.0:1789366672.061594:0:11650:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:0.0:1789366672.439849:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789366673.082844:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:2.0:1789366673.082919:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751473664 00000100:00100000:2.0:1789366673.082930:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751473664 00000100:00100000:2.0:1789366673.083008:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 63 00000100:00100000:2.0:1789366673.083019:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638af330380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0ab23baa-a205-44ad-bf17-f7b47295d82b+19:12310:x1876286751473664:12345-192.168.202.23@tcp:35:umount.0 00000100:00080000:1.0:1789366673.083101:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789366673.083302:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638af330380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0ab23baa-a205-44ad-bf17-f7b47295d82b+20:12310:x1876286751473664:12345-192.168.202.23@tcp:35:umount.0 Request processed in 284us (466us total) trans 4294967515 rc 0/0 00000100:00100000:2.0:1789366673.083311:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 63 00000100:00100000:3.0:1789366673.087057:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:0.0:1789366673.087945:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751473920 00000100:00100000:0.0:1789366673.087962:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751473920 00000100:00100000:0.0:1789366673.088072:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 64 00000100:00100000:0.0:1789366673.088086:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638af333800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0ab23baa-a205-44ad-bf17-f7b47295d82b+20:12310:x1876286751473920:12345-192.168.202.23@tcp:35:umount.0 00000100:00100000:0.0:1789366673.088595:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638af333800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0ab23baa-a205-44ad-bf17-f7b47295d82b+21:12310:x1876286751473920:12345-192.168.202.23@tcp:35:umount.0 Request processed in 513us (1548us total) trans 4294967516 rc 0/0 00000100:00100000:0.0:1789366673.088627:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 64 00000100:00100000:1.0:1789366673.090623:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:2.0:1789366673.090843:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751474176 00000100:00100000:2.0:1789366673.090916:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751474176 00000100:00100000:2.0:1789366673.090969:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 65 00000100:00100000:2.0:1789366673.090976:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96388327ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0ab23baa-a205-44ad-bf17-f7b47295d82b+21:12310:x1876286751474176:12345-192.168.202.23@tcp:35:umount.0 00000100:00100000:2.0:1789366673.091210:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96388327ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0ab23baa-a205-44ad-bf17-f7b47295d82b+22:12310:x1876286751474176:12345-192.168.202.23@tcp:35:umount.0 Request processed in 228us (591us total) trans 4294967517 rc 0/0 00000100:00100000:2.0:1789366673.091219:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 65 00000100:00100000:3.0:1789366673.093489:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:2.0:1789366673.094019:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751474432 00000100:00100000:2.0:1789366673.094028:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751474432 00000100:00100000:2.0:1789366673.094082:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 66 00000100:00100000:2.0:1789366673.094090:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638af332a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0ab23baa-a205-44ad-bf17-f7b47295d82b+22:12310:x1876286751474432:12345-192.168.202.23@tcp:35:umount.0 00000100:00100000:2.0:1789366673.094465:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638af332a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0ab23baa-a205-44ad-bf17-f7b47295d82b+23:12310:x1876286751474432:12345-192.168.202.23@tcp:35:umount.0 Request processed in 375us (984us total) trans 4294967518 rc 0/0 00000100:00100000:2.0:1789366673.094482:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 66 00000100:00100000:3.0:1789366673.097909:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:3.0:1789366673.097953:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:3.0:1789366673.097980:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:1.0:1789366673.098109:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751474560 00000100:00100000:1.0:1789366673.098121:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751474560 00000100:00100000:3.0:1789366673.098156:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:1.0:1789366673.098179:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751474816 00000100:00100000:1.0:1789366673.098183:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751474816 00000100:00100000:1.0:1789366673.098195:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751474688 00000100:00100000:1.0:1789366673.098197:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751474688 00000100:00100000:1.0:1789366673.098212:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 18 00000100:00100000:1.0:1789366673.098232:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638af333480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:14a2847b-91d8-4d87-b71b-010443acc91a+15:2357:x1876286751474560:12345-192.168.202.23@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789366673.098247:0:5802:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789366673.098278:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9638832d3800/0x8da3486b955f30c3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801000000000 nid: 192.168.202.23@tcp remote: 0xda917a494d06bed2 expref: 15 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789366673.098291:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 19 00010000:00010000:1.0:1789366673.098299:0:5802:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789366673.098307:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638af330000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:14a2847b-91d8-4d87-b71b-010443acc91a+14:2357:x1876286751474816:12345-192.168.202.23@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789366673.098319:0:5801:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1789366673.098321:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00010000:00010000:2.0:1789366673.098334:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9638a0741c00/0x8da3486b955f32d7 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 192.168.202.23@tcp remote: 0xda917a494d06bf9d expref: 14 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366673.098344:0:5801:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789366673.098367:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:2.0:1789366673.098376:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638af330000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:14a2847b-91d8-4d87-b71b-010443acc91a+13:2357:x1876286751474816:12345-192.168.202.23@tcp:103:ldlm_bl.0 Request processed in 72us (420us total) trans 0 rc 0/0 00000100:00100000:1.0:1789366673.098377:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638af333480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:14a2847b-91d8-4d87-b71b-010443acc91a+13:2357:x1876286751474560:12345-192.168.202.23@tcp:103:ldlm_bl.0 Request processed in 153us (476us total) trans 0 rc 0/0 00000100:00100000:2.0:1789366673.098387:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 19 00000100:00100000:1.0:1789366673.098394:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 18 00000100:00100000:2.0:1789366673.098413:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 20 00000100:00100000:2.0:1789366673.098423:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638af331f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:14a2847b-91d8-4d87-b71b-010443acc91a+11:2357:x1876286751474688:12345-192.168.202.23@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1789366673.098432:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751474944 00000100:00100000:1.0:1789366673.098437:0:6661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751474944 00010000:00010000:2.0:1789366673.098445:0:5801:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789366673.098459:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9638832d2400/0x8da3486b955f3029 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 192.168.202.23@tcp remote: 0xda917a494d06be9a expref: 11 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366673.098471:0:5801:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789366673.098472:0:8065:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751475072 00000100:00100000:3.0:1789366673.098478:0:8065:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751475072 00000100:00100000:1.0:1789366673.098483:0:6661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 73 00000100:00100000:1.0:1789366673.098493:0:6661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638af333b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0ab23baa-a205-44ad-bf17-f7b47295d82b+5:2353:x1876286751474944:12345-192.168.202.23@tcp:9:umount.0 00000100:00100000:2.0:1789366673.098504:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638af331f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:14a2847b-91d8-4d87-b71b-010443acc91a+10:2357:x1876286751474688:12345-192.168.202.23@tcp:103:ldlm_bl.0 Request processed in 81us (520us total) trans 0 rc 0/0 00000100:00100000:2.0:1789366673.098512:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 20 00000020:00000080:1.0:1789366673.098520:0:6661:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x8da3486b955f339b 00000100:00080000:1.0:1789366673.098531:0:6661:0:(import.c:65:import_set_state_nolock()) ffff963888970800 : changing import state from FULL to CLOSED 00000100:00100000:2.0:1789366673.098554:0:7132:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751475200 00000100:00100000:2.0:1789366673.098558:0:7132:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751475200 00000100:00100000:3.0:1789366673.098561:0:8065:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 63 00000100:00100000:3.0:1789366673.098573:0:8065:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638af331880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0ab23baa-a205-44ad-bf17-f7b47295d82b+7:2356:x1876286751475072:12345-192.168.202.23@tcp:400:kworker.0 00000001:00000004:1.0:1789366673.098576:0:6661:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967310 00000100:00100000:2.0:1789366673.098604:0:7132:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 126 00000100:00100000:3.0:1789366673.098612:0:8065:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638af331880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0ab23baa-a205-44ad-bf17-f7b47295d82b+7:2356:x1876286751475072:12345-192.168.202.23@tcp:400:kworker.0 Request processed in 40us (291us total) trans 0 rc 0/0 00000100:00100000:2.0:1789366673.098616:0:7132:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638af330700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b9764435-e52f-45ac-a5f9-bab1231105ac+6:2357:x1876286751475200:12345-192.168.202.23@tcp:400:kworker.0 00000100:00100000:3.0:1789366673.098625:0:8065:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 63 00000100:00100000:2.0:1789366673.098659:0:7132:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638af330700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b9764435-e52f-45ac-a5f9-bab1231105ac+6:2357:x1876286751475200:12345-192.168.202.23@tcp:400:kworker.0 Request processed in 48us (293us total) trans 0 rc 0/0 00000100:00100000:2.0:1789366673.098665:0:7132:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 126 00000100:00080000:2.0:1789366673.098702:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789366673.098708:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789366673.098710:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1789366673.098782:0:6675:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789366673.098917:0:6661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638af333b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0ab23baa-a205-44ad-bf17-f7b47295d82b+2:2353:x1876286751474944:12345-192.168.202.23@tcp:9:umount.0 Request processed in 425us (761us total) trans 0 rc 0/0 00000100:00100000:1.0:1789366673.098925:0:6661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 73 00000100:00100000:3.0:1789366673.107478:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:0.0:1789366673.107537:0:8065:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751475584 00000100:00100000:0.0:1789366673.107548:0:8065:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751475584 00000100:00100000:0.0:1789366673.107597:0:8065:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 74 00000100:00100000:0.0:1789366673.107605:0:8065:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638af332d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0ab23baa-a205-44ad-bf17-f7b47295d82b+7:2353:x1876286751475584:12345-192.168.202.23@tcp:9:umount.0 00000020:00000080:0.0:1789366673.107632:0:8065:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x8da3486b955f3603 00000020:00010000:0.0:1789366673.107639:0:8065:0:(genops.c:1921:obd_stale_export_put()) Put export ffff96388891b800: total 0 00000100:00080000:0.0:1789366673.107643:0:8065:0:(import.c:65:import_set_state_nolock()) ffff96388891e800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1789366673.107679:0:8065:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967324 00000100:00100000:0.0:1789366673.107948:0:8065:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638af332d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0ab23baa-a205-44ad-bf17-f7b47295d82b+5:2353:x1876286751475584:12345-192.168.202.23@tcp:9:umount.0 Request processed in 342us (478us total) trans 0 rc 0/0 00000100:00100000:0.0:1789366673.107956:0:8065:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 74 00000020:00010000:1.0:1789366673.108008:0:5805:0:(genops.c:1907:obd_stale_export_get()) Get export ffff96388891b800: total 0 00010000:00010000:1.0:1789366673.108076:0:5805:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff96388891b800, canceled 0 locks, left on hash table 2. 00010000:00010000:1.0:1789366673.108135:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002cd9e6e2/0x8da3486b955f399f lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.202.23@tcp remote: 0xda917a494d06c172 expref: 4 pid: 8065 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366673.108171:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000daa60d78/0x8da3486b955f401a lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.202.23@tcp remote: 0xda917a494d06c332 expref: 3 pid: 6661 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366673.108186:0:5805:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff96388891b800, canceled 2 locks, left on hash table 0. 00010000:00010000:1.0:1789366673.108201:0:5805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789366673.108215:0:5805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789366673.108217:0:5805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789366673.114783:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:2.0:1789366673.115098:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751476608 00000100:00100000:2.0:1789366673.115110:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751476608 00000100:00100000:2.0:1789366673.115172:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 238 00000100:00100000:2.0:1789366673.115183:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638af330a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0ab23baa-a205-44ad-bf17-f7b47295d82b+23:2353:x1876286751476608:12345-192.168.202.23@tcp:39:umount.0 00000020:00000080:2.0:1789366673.115218:0:5816:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x8da3486b955f3037 00000020:00010000:2.0:1789366673.115234:0:5816:0:(genops.c:1921:obd_stale_export_put()) Put export ffff963785eb9000: total 0 00000100:00080000:2.0:1789366673.115240:0:5816:0:(import.c:65:import_set_state_nolock()) ffff9638b7379800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1789366673.115266:0:5816:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967518 00000020:00010000:0.0:1789366673.115282:0:5804:0:(genops.c:1907:obd_stale_export_get()) Get export ffff963785eb9000: total 0 00010000:00010000:0.0:1789366673.115327:0:5804:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff963785eb9000, canceled 0 locks, left on hash table 13. 00010000:00010000:0.0:1789366673.115358:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9638a7404a00) 00010000:00010000:0.0:1789366673.115362:0:5804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789366673.115381:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9638832d2200/0x8da3486b955f3960 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.23@tcp remote: 0xda917a494d06c15d expref: 22 pid: 7132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366673.115406:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff963890797800) 00010000:00010000:0.0:1789366673.115410:0:5804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1789366673.115414:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c8c00/0x8da3486b955f3abe lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.23@tcp remote: 0xda917a494d06c1db expref: 21 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366673.115427:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9638a7404a00) 00010000:00010000:0.0:1789366673.115430:0:5804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1789366673.115446:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9638832d3a00/0x8da3486b955f398a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.23@tcp remote: 0xda917a494d06c16b expref: 20 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366673.115464:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9638a7404700) 00010000:00010000:0.0:1789366673.115466:0:5804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1789366673.115471:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9638b6ce2e00/0x8da3486b955f4005 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.23@tcp remote: 0xda917a494d06c32b expref: 19 pid: 7614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366673.115515:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff963890797000) 00010000:00010000:0.0:1789366673.115519:0:5804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1789366673.115524:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c8600/0x8da3486b955f365e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.23@tcp remote: 0xda917a494d06c099 expref: 19 pid: 7614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366673.115538:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff963890797400) 00010000:00010000:0.0:1789366673.115540:0:5804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789366673.115544:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720d800/0x8da3486b955f3301 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.23@tcp remote: 0xda917a494d06bfab expref: 18 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366673.115564:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9638a7404700) 00010000:00010000:0.0:1789366673.115567:0:5804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1789366673.115571:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c8e00/0x8da3486b955f3efb lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.23@tcp remote: 0xda917a494d06c2e5 expref: 17 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366673.115598:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff963890797000) 00010000:00010000:0.0:1789366673.115602:0:5804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1789366673.115607:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720d400/0x8da3486b955f3371 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.23@tcp remote: 0xda917a494d06bfc7 expref: 17 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366673.115623:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff963890797800) 00010000:00010000:0.0:1789366673.115631:0:5804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1789366673.115636:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720c800/0x8da3486b955f3a1d lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.23@tcp remote: 0xda917a494d06c195 expref: 16 pid: 7132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789366673.115763:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638af330a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0ab23baa-a205-44ad-bf17-f7b47295d82b+13:2353:x1876286751476608:12345-192.168.202.23@tcp:39:umount.0 Request processed in 581us (992us total) trans 4294967519 rc 0/0 00000100:00100000:2.0:1789366673.115772:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 238 00010000:00010000:0.0:1789366673.115937:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9638a7404a00) 00010000:00010000:0.0:1789366673.115941:0:5804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1789366673.115946:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720ce00/0x8da3486b955f3880 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.23@tcp remote: 0xda917a494d06c125 expref: 12 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366673.115964:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9638a7404700) 00010000:00010000:0.0:1789366673.115966:0:5804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789366673.115971:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9638b6ce3600/0x8da3486b955f3fdb lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.23@tcp remote: 0xda917a494d06c31d expref: 11 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366673.115988:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9638a7404800) 00010000:00010000:0.0:1789366673.115991:0:5804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789366673.115995:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9400/0x8da3486b955f3a01 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.23@tcp remote: 0xda917a494d06c18e expref: 10 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366673.116006:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9638a7404100) 00010000:00010000:0.0:1789366673.116008:0:5804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789366673.116011:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff963880031200/0x8da3486b955f331d lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.23@tcp remote: 0xda917a494d06bfb2 expref: 9 pid: 7614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366673.116025:0:5804:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff963785eb9000, canceled 13 locks, left on hash table 0. 00010000:00010000:0.0:1789366673.116054:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789366673.116057:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789366673.116058:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789366673.335998:0:3286:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789366673.336020:0:3286:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9638af332300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3286:1876286758786816:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789366673.336234:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789366673.336422:0:7134:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286758786816 00000100:00100000:0.0:1789366673.336443:0:7134:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286758786816 00000100:00100000:0.0:1789366673.337488:0:7134:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1789366673.337502:0:7134:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96388327c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3286:x1876286758786816:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789366673.337541:0:7134:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789366673.337602:0:7134:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96388327c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3286:x1876286758786816:12345-0@lo:13:osp-pre-1-0.0 Request processed in 105us (1368us total) trans 0 rc 0/0 00000100:00100000:0.0:1789366673.337609:0:7134:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1789366673.337657:0:3286:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9638af332300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3286:1876286758786816:0@lo:13:osp-pre-1-0.0 00000100:00080000:1.0:1789366673.338561:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789366673.344240:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9638af331c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8cde4528-5832-4854-a387-4adacc3dd0ab:3284:1876286758786944:0@lo:400:kworker.0 00000100:00100000:1.0:1789366673.344314:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789366673.344323:0:3287:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9638b6d55500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3287:1876286758787328:0@lo:400:kworker.0 00000100:00100000:2.0:1789366673.344378:0:3286:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9638bfef8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3286:1876286758787200:0@lo:400:kworker.0 00000100:00100000:0.0:1789366673.344434:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9638af332300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3285:1876286758787072:0@lo:400:kworker.0 00000100:00100000:3.0:1789366673.345767:0:3287:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789366673.345855:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789366673.345859:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286758787328 00000100:00100000:3.0:1789366673.345869:0:6660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286758787328 00000100:00080000:2.0:1789366673.345920:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789366673.345936:0:6660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1789366673.345949:0:6660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638b6d56300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3287:x1876286758787328:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789366673.345964:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286758787200 00000100:00100000:2.0:1789366673.345969:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286758787200 00000100:00100000:2.0:1789366673.346008:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:3.0:1789366673.346018:0:6660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638b6d56300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3287:x1876286758787328:12345-0@lo:400:kworker.0 Request processed in 71us (253us total) trans 0 rc 0/0 00000100:00100000:2.0:1789366673.346019:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638aef25500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3286:x1876286758787200:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789366673.346045:0:6660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1789366673.346082:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638aef25500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3286:x1876286758787200:12345-0@lo:400:kworker.0 Request processed in 65us (227us total) trans 0 rc 0/0 00000100:00100000:2.0:1789366673.346090:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:3.0:1789366673.346100:0:3287:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9638b6d55500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3287:1876286758787328:0@lo:400:kworker.0 00000100:00080000:2.0:1789366673.346124:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789366673.346155:0:3286:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9638bfef8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3286:1876286758787200:0@lo:400:kworker.0 00000100:00100000:3.0:1789366673.346157:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286758786944 00000100:00100000:3.0:1789366673.346163:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286758786944 00000100:00100000:3.0:1789366673.346218:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 281 00000100:00100000:3.0:1789366673.346226:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638b4e80450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8cde4528-5832-4854-a387-4adacc3dd0ab+19:3284:x1876286758786944:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789366673.346290:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638b4e80450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8cde4528-5832-4854-a387-4adacc3dd0ab+19:3284:x1876286758786944:12345-0@lo:400:kworker.0 Request processed in 64us (1975us total) trans 0 rc 0/0 00000100:00100000:2.0:1789366673.346296:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 281 00000100:00100000:0.0:1789366673.346548:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789366673.346582:0:3285:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789366673.346592:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9638b6d54e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3285:1876286758787456:0@lo:400:kworker.0 00000100:00100000:0.0:1789366673.346621:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789366673.346707:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9638af331c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8cde4528-5832-4854-a387-4adacc3dd0ab:3284:1876286758786944:0@lo:400:kworker.0 00000100:00100000:2.0:1789366673.346842:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286758787072 00000100:00100000:2.0:1789366673.346847:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286758787072 00000100:00100000:2.0:1789366673.346875:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286758787456 00000100:00100000:2.0:1789366673.346878:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286758787456 00000100:00100000:2.0:1789366673.346973:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:2.0:1789366673.346980:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638af2e9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3285:x1876286758787072:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789366673.347016:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638af2e9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3285:x1876286758787072:12345-0@lo:400:kworker.0 Request processed in 37us (469us total) trans 0 rc 0/0 00000100:00100000:2.0:1789366673.347022:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:2.0:1789366673.347044:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:2.0:1789366673.347051:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638af2ead80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3285:x1876286758787456:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789366673.347074:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638af2ead80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3285:x1876286758787456:12345-0@lo:400:kworker.0 Request processed in 25us (453us total) trans 0 rc 0/0 00000100:00100000:2.0:1789366673.347080:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00080000:1.0:1789366673.347120:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789366673.347170:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9638b6d54e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3285:1876286758787456:0@lo:400:kworker.0 00000100:00100000:0.0:1789366673.347183:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9638af332300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3285:1876286758787072:0@lo:400:kworker.0 00010000:00010000:3.0:1789366673.463849:0:6675:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789366673.757215:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:2.0:1789366673.757261:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:1.0:1789366673.757292:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751476736 00000100:00100000:1.0:1789366673.757302:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751476736 00000100:00100000:1.0:1789366673.757362:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751476864 00000100:00100000:1.0:1789366673.757366:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751476864 00000100:00100000:1.0:1789366673.757399:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 21 00000100:00100000:1.0:1789366673.757412:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638aef24380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:14a2847b-91d8-4d87-b71b-010443acc91a+11:2356:x1876286751476736:12345-192.168.202.23@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789366673.757428:0:5802:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789366673.757446:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff96388148e400/0x8da3486b955f3109 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 192.168.202.23@tcp remote: 0xda917a494d06bee7 expref: 11 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366673.757466:0:5802:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789366673.757515:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638aef24380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:14a2847b-91d8-4d87-b71b-010443acc91a+10:2356:x1876286751476736:12345-192.168.202.23@tcp:103:ldlm_bl.0 Request processed in 107us (311us total) trans 0 rc 0/0 00000100:00100000:1.0:1789366673.757523:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 21 00000100:00100000:1.0:1789366673.757540:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 22 00000100:00100000:1.0:1789366673.757547:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638aef24700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:14a2847b-91d8-4d87-b71b-010443acc91a+9:2356:x1876286751476864:12345-192.168.202.23@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789366673.757556:0:5802:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789366673.757577:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff96388148f400/0x8da3486b955f3110 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 192.168.202.23@tcp remote: 0xda917a494d06bf11 expref: 9 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366673.757587:0:5802:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789366673.757606:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638aef24700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:14a2847b-91d8-4d87-b71b-010443acc91a+8:2356:x1876286751476864:12345-192.168.202.23@tcp:103:ldlm_bl.0 Request processed in 60us (345us total) trans 0 rc 0/0 00000100:00100000:1.0:1789366673.757612:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 22 00000100:00100000:3.0:1789366673.757876:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:2.0:1789366673.758151:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751476992 00000100:00100000:2.0:1789366673.758156:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751476992 00000100:00100000:2.0:1789366673.759095:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 23 00000100:00100000:2.0:1789366673.759106:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638986c7050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:14a2847b-91d8-4d87-b71b-010443acc91a+8:2357:x1876286751476992:12345-192.168.202.23@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789366673.759120:0:5803:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789366673.759134:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9638a0740600/0x8da3486b955f32d0 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 192.168.202.23@tcp remote: 0xda917a494d06bf96 expref: 8 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366673.759156:0:5803:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789366673.759191:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638986c7050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:14a2847b-91d8-4d87-b71b-010443acc91a+7:2357:x1876286751476992:12345-192.168.202.23@tcp:103:ldlm_bl.0 Request processed in 88us (1317us total) trans 0 rc 0/0 00000100:00100000:2.0:1789366673.759198:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 23 00000100:00100000:3.0:1789366673.762947:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:2.0:1789366673.762990:0:7132:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751477248 00000100:00100000:2.0:1789366673.763001:0:7132:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751477248 00000100:00100000:2.0:1789366673.763119:0:7132:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 239 00000100:00100000:2.0:1789366673.763131:0:7132:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638b6d55500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b9764435-e52f-45ac-a5f9-bab1231105ac+6:2353:x1876286751477248:12345-192.168.202.23@tcp:39:umount.0 00000020:00000080:2.0:1789366673.763173:0:7132:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x8da3486b955f311e 00000020:00010000:2.0:1789366673.763182:0:7132:0:(genops.c:1921:obd_stale_export_put()) Put export ffff963785ebe800: total 0 00000100:00080000:2.0:1789366673.763187:0:7132:0:(import.c:65:import_set_state_nolock()) ffff963785ebb800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1789366673.763216:0:7132:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967519 00000100:00100000:2.0:1789366673.763390:0:7132:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638b6d55500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b9764435-e52f-45ac-a5f9-bab1231105ac+5:2353:x1876286751477248:12345-192.168.202.23@tcp:39:umount.0 Request processed in 263us (452us total) trans 4294967520 rc 0/0 00000100:00100000:2.0:1789366673.763396:0:7132:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 239 00000020:00010000:1.0:1789366673.763446:0:5805:0:(genops.c:1907:obd_stale_export_get()) Get export ffff963785ebe800: total 0 00010000:00010000:1.0:1789366673.763451:0:5805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789366673.763510:0:5805:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff963785ebe800, canceled 0 locks, left on hash table 1. 00010000:00010000:1.0:1789366673.763539:0:5805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9638a7404800) 00010000:00010000:1.0:1789366673.763543:0:5805:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789366673.763552:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9638832d3c00/0x8da3486b955f4028 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.23@tcp remote: 0xda917a494d06c339 expref: 4 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366673.763576:0:5805:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff963785ebe800, canceled 1 locks, left on hash table 0. 00010000:00010000:1.0:1789366673.763590:0:5805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789366673.763592:0:5805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789366673.763594:0:5805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789366673.772584:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:0.0:1789366673.773173:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751477504 00000100:00100000:0.0:1789366673.773182:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751477504 00000100:00100000:0.0:1789366673.773254:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 282 00000100:00100000:0.0:1789366673.773261:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638b4e83050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:14a2847b-91d8-4d87-b71b-010443acc91a+7:2353:x1876286751477504:12345-192.168.202.23@tcp:251:umount.0 00000020:00000080:0.0:1789366673.773297:0:5810:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x8da3486b955f3014 00000020:00010000:0.0:1789366673.773303:0:5810:0:(genops.c:1921:obd_stale_export_put()) Put export ffff96378672c000: total 0 00000100:00080000:0.0:1789366673.773307:0:5810:0:(import.c:65:import_set_state_nolock()) ffff96378672b800 : changing import state from FULL to CLOSED 00000100:00100000:0.0:1789366673.773362:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638b4e83050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:14a2847b-91d8-4d87-b71b-010443acc91a+3:2353:x1876286751477504:12345-192.168.202.23@tcp:251:umount.0 Request processed in 102us (788us total) trans 0 rc 0/0 00000100:00100000:0.0:1789366673.773367:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 282 00000020:00010000:1.0:1789366673.773535:0:5804:0:(genops.c:1907:obd_stale_export_get()) Get export ffff96378672c000: total 0 00010000:00010000:1.0:1789366673.773922:0:5804:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff96378672c000, canceled 0 locks, left on hash table 1. 00010000:00010000:1.0:1789366673.773956:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff96388148fe00/0x8da3486b955f30ca lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 192.168.202.23@tcp remote: 0xda917a494d06bed9 expref: 2 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366673.773973:0:5804:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff96378672c000, canceled 1 locks, left on hash table 0. 00000020:00000080:1.0:1789366673.773988:0:5804:0:(genops.c:885:class_export_put()) final put ffff96378672c000/14a2847b-91d8-4d87-b71b-010443acc91a 00010000:00010000:1.0:1789366673.774007:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789366673.774010:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789366673.774012:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1789366673.774089:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff96378672c000/14a2847b-91d8-4d87-b71b-010443acc91a for MGS 00000020:00000080:3.0:1789366673.774131:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff96378672b800 for MGS 00000001:00080000:0.0:1789366673.875692:0:5837:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967516 is committed 00000001:00100000:0.0:1789366673.875742:0:5837:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of b9764435-e52f-45ac-a5f9-bab1231105ac 00000001:00080000:0.0:1789366673.875752:0:5837:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967520 is committed 00000020:00000080:0.0:1789366673.875756:0:5837:0:(genops.c:885:class_export_put()) final put ffff963785ebe800/b9764435-e52f-45ac-a5f9-bab1231105ac 00000001:00100000:0.0:1789366673.875769:0:5837:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 0ab23baa-a205-44ad-bf17-f7b47295d82b 00000001:00080000:0.0:1789366673.875773:0:5837:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967519 is committed 00000020:00000080:0.0:1789366673.875782:0:5837:0:(genops.c:885:class_export_put()) final put ffff963785eb9000/0ab23baa-a205-44ad-bf17-f7b47295d82b 00000020:00080000:0.0:1789366673.875789:0:5837:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 8 batchid updated 00000020:00080000:2.0:1789366673.875812:0:5848:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000020:00080000:2.0:1789366673.875825:0:5848:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000020:00000080:3.0:1789366673.876045:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff963785ebe800/b9764435-e52f-45ac-a5f9-bab1231105ac for lustre-MDT0000 00000020:00000080:3.0:1789366673.876112:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff963785eb9000/0ab23baa-a205-44ad-bf17-f7b47295d82b for lustre-MDT0000 00000020:00000080:3.0:1789366673.876142:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff963785ebb800 for lustre-MDT0000 00000020:00000080:3.0:1789366673.876146:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9638b7379800 for lustre-MDT0000 00000001:00100000:1.0:1789366674.391510:0:6685:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 0ab23baa-a205-44ad-bf17-f7b47295d82b 00000020:00000080:1.0:1789366674.391528:0:6685:0:(genops.c:885:class_export_put()) final put ffff96388891b800/0ab23baa-a205-44ad-bf17-f7b47295d82b 00000020:00000080:3.0:1789366674.391606:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff96388891b800/0ab23baa-a205-44ad-bf17-f7b47295d82b for lustre-OST0000 00000020:00000080:3.0:1789366674.391649:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff96388891e800 for lustre-OST0000 00010000:00010000:3.0:1789366674.487908:0:6675:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1789366674.940914:0:12969:0:(tgt_mount.c:2195:server_umount_begin()) umount -f 00000020:01000004:3.0:1789366674.951408:0:12969:0:(tgt_mount.c:2065:server_put_super()) server put_super lustre-MDT0000 00010000:00010000:3.0:1789366674.951461:0:12969:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.123@tcp lock: ffff9638a0740400/0x8da3486b955f3099 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x8da3486b955f30a0 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366674.951487:0:12969:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.123@tcp lock: ffff9638a0740400/0x8da3486b955f3099 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x8da3486b955f30a0 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366674.951496:0:12969:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.123@tcp lock: ffff9638a0740400/0x8da3486b955f3099 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x8da3486b955f30a0 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366674.951505:0:12969:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.123@tcp lock: ffff9638a0740400/0x8da3486b955f3099 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x8da3486b955f30a0 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366674.951543:0:12969:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1789366674.951549:0:12969:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00010000:00010000:2.0:1789366674.951562:0:5805:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789366674.951570:0:5805:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.123@tcp lock: ffff9638a0740400/0x8da3486b955f3099 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0x8da3486b955f30a0 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366674.951577:0:5805:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9638a0740400 already unused, calling callback (ffffffffc1cc7c20) 10000000:00010000:2.0:1789366674.951580:0:5805:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.123@tcp lock: ffff9638a0740400/0x8da3486b955f3099 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0x8da3486b955f30a0 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1789366674.951587:0:12969:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00010000:00010000:2.0:1789366674.951589:0:5805:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.123@tcp lock: ffff9638a0740400/0x8da3486b955f3099 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1008400000000 nid: local remote: 0x8da3486b955f30a0 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789366674.951593:0:12969:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:3.0:1789366674.951602:0:12969:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 10000000:00010000:2.0:1789366674.951615:0:5805:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.123@tcp lock: ffff9638a0740400/0x8da3486b955f3099 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1009400000000 nid: local remote: 0x8da3486b955f30a0 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789366674.951626:0:5805:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00080000:3.0:1789366674.951630:0:12969:0:(import.c:65:import_set_state_nolock()) ffff963885b44000 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 10000000:01000000:2.0:1789366674.951630:0:5805:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:2.0:1789366674.951635:0:5805:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:2.0:1789366674.951665:0:5805:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.123@tcp lock: ffff9638a0740400/0x8da3486b955f3099 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x8da3486b955f30a0 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366674.951672:0:5805:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:0.0:1789366674.951696:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9638b6d57100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3283:1876286758787584:0@lo:39:umount.0 00010000:00010000:2.0:1789366674.951703:0:5805:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.123@tcp lock: ffff9638a0740400/0x8da3486b955f3099 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x8da3486b955f30a0 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366674.951710:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.123@tcp lock: ffff9638a0740400/0x8da3486b955f3099 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x8da3486b955f30a0 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366674.951768:0:5805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789366674.951772:0:5805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789366674.951775:0:5805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789366674.951783:0:3284:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789366674.951796:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9638aef24380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8cde4528-5832-4854-a387-4adacc3dd0ab:3284:1876286758787712:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789366674.951862:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789366674.951905:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789366674.951941:0:8419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286758787712 00000100:00100000:0.0:1789366674.951948:0:8419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286758787712 00000100:00100000:0.0:1789366674.952007:0:8419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1789366674.952027:0:8419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638aef24700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8cde4528-5832-4854-a387-4adacc3dd0ab+19:3284:x1876286758787712:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789366674.952045:0:8419:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789366674.952061:0:8419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff96388148f600/0x8da3486b955f30a0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x8da3486b955f3099 expref: 19 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366674.952072:0:8419:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789366674.952107:0:8419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638aef24700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8cde4528-5832-4854-a387-4adacc3dd0ab+18:3284:x1876286758787712:12345-0@lo:103:ldlm_bl.0 Request processed in 91us (247us total) trans 0 rc 0/0 00000100:00100000:0.0:1789366674.952114:0:8419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1789366674.952133:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9638aef24380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8cde4528-5832-4854-a387-4adacc3dd0ab:3284:1876286758787712:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789366674.952134:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286758787584 00000100:00100000:0.0:1789366674.952137:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286758787584 00000100:00100000:0.0:1789366674.952163:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 240 00000100:00100000:0.0:1789366674.952170:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638af2e8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3283:x1876286758787584:12345-0@lo:39:umount.0 00000020:00000080:0.0:1789366674.952191:0:5815:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x8da3486b955f2e38 00000100:00080000:0.0:1789366674.952198:0:5815:0:(import.c:65:import_set_state_nolock()) ffff963885b42000 : changing import state from FULL to CLOSED 00010000:00010000:2.0:1789366674.952249:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789366674.952267:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638af2e8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+1:3283:x1876286758787584:12345-0@lo:39:umount.0 Request processed in 98us (364us total) trans 0 rc 0/0 00000100:00100000:0.0:1789366674.952274:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 240 00000020:00000080:0.0:1789366674.952279:0:5815:0:(genops.c:885:class_export_put()) final put ffff963885b41800/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:2.0:1789366674.952309:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff963885b41800/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000 00000020:00000080:2.0:1789366674.952359:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff963885b42000 for lustre-MDT0000 00000100:00080000:3.0:1789366674.952360:0:3283:0:(import.c:65:import_set_state_nolock()) ffff963885b44000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:3.0:1789366674.952374:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9638b6d57100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3283:1876286758787584:0@lo:39:umount.0 00000100:00080000:3.0:1789366674.952391:0:12969:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1789366674.952394:0:12969:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:3.0:1789366674.952397:0:12969:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:2.0:1789366674.954011:0:12969:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.123@tcp lock: ffff9638827f6c00/0x8da3486b955f30a7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x8da3486b955f30ae expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366674.954052:0:12969:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.123@tcp lock: ffff9638827f6c00/0x8da3486b955f30a7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x8da3486b955f30ae expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366674.954060:0:12969:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.123@tcp lock: ffff9638827f6c00/0x8da3486b955f30a7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0x8da3486b955f30ae expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366674.954067:0:12969:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.123@tcp lock: ffff9638827f6c00/0x8da3486b955f30a7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0x8da3486b955f30ae expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366674.954149:0:12969:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789366674.954157:0:12969:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.123@tcp lock: ffff9638832d3000/0x8da3486b955f2fce lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8da3486b955f2fd5 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366674.954164:0:12969:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.123@tcp lock: ffff9638832d3000/0x8da3486b955f2fce lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x8da3486b955f2fd5 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366674.954170:0:12969:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.123@tcp lock: ffff9638832d3000/0x8da3486b955f2fce lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x8da3486b955f2fd5 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366674.954177:0:12969:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.123@tcp lock: ffff9638832d3000/0x8da3486b955f2fce lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x8da3486b955f2fd5 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366674.954191:0:12969:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1789366674.954198:0:12969:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.123@tcp lock: ffff9638a0740e00/0x8da3486b955f32c2 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x8da3486b955f32c9 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366674.954204:0:12969:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.123@tcp lock: ffff9638a0740e00/0x8da3486b955f32c2 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x8da3486b955f32c9 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366674.954220:0:12969:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.123@tcp lock: ffff9638a0740e00/0x8da3486b955f32c2 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x8da3486b955f32c9 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366674.954226:0:12969:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.123@tcp lock: ffff9638a0740e00/0x8da3486b955f32c2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x8da3486b955f32c9 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366674.954244:0:12969:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:2.0:1789366674.954249:0:12969:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.123@tcp lock: ffff963880030c00/0x8da3486b955f2d90 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8da3486b955f2d97 expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366674.954256:0:12969:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.123@tcp lock: ffff963880030c00/0x8da3486b955f2d90 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x8da3486b955f2d97 expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366674.954263:0:12969:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.123@tcp lock: ffff963880030c00/0x8da3486b955f2d90 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x8da3486b955f2d97 expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366674.954266:0:5804:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1789366674.954274:0:5804:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.123@tcp lock: ffff9638827f6c00/0x8da3486b955f30a7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0x8da3486b955f30ae expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366674.954283:0:5804:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9638827f6c00 already unused, calling callback (ffffffffc1cc7c20) 10000000:00010000:0.0:1789366674.954287:0:5804:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.123@tcp lock: ffff9638827f6c00/0x8da3486b955f30a7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0x8da3486b955f30ae expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366674.954295:0:5804:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.123@tcp lock: ffff9638827f6c00/0x8da3486b955f30a7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1008400000000 nid: local remote: 0x8da3486b955f30ae expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789366674.954302:0:5804:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.123@tcp lock: ffff9638827f6c00/0x8da3486b955f30a7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1009400000000 nid: local remote: 0x8da3486b955f30ae expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789366674.954308:0:5804:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1789366674.954310:0:5804:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0000: stopping, won't requeue 00010000:00010000:0.0:1789366674.954337:0:5804:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.123@tcp lock: ffff9638827f6c00/0x8da3486b955f30a7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x8da3486b955f30ae expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366674.954344:0:5804:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789366674.954347:0:6675:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1789366674.954353:0:6675:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.123@tcp lock: ffff9638832d3000/0x8da3486b955f2fce lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x8da3486b955f2fd5 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366674.954361:0:6675:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9638832d3000 already unused, calling callback (ffffffffc1cc7c20) 10000000:00010000:3.0:1789366674.954364:0:6675:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.123@tcp lock: ffff9638832d3000/0x8da3486b955f2fce lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x8da3486b955f2fd5 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366674.954370:0:5804:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.123@tcp lock: ffff9638827f6c00/0x8da3486b955f30a7 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x8da3486b955f30ae expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366674.954371:0:6675:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.123@tcp lock: ffff9638832d3000/0x8da3486b955f2fce lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x8da3486b955f2fd5 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366674.954389:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.123@tcp lock: ffff9638827f6c00/0x8da3486b955f30a7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x8da3486b955f30ae expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789366674.954390:0:6675:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.123@tcp lock: ffff9638832d3000/0x8da3486b955f2fce lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x8da3486b955f2fd5 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789366674.954408:0:6675:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:3.0:1789366674.954410:0:6675:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 00010000:00010000:0.0:1789366674.954417:0:5804:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 10000000:01000000:3.0:1789366674.954418:0:6675:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:0.0:1789366674.954430:0:5804:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.123@tcp lock: ffff9638a0740e00/0x8da3486b955f32c2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x8da3486b955f32c9 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366674.954437:0:5804:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9638a0740e00 already unused, calling callback (ffffffffc1cc7c20) 00010000:00010000:3.0:1789366674.954438:0:6675:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.123@tcp lock: ffff9638832d3000/0x8da3486b955f2fce lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x8da3486b955f2fd5 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789366674.954441:0:5804:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.123@tcp lock: ffff9638a0740e00/0x8da3486b955f32c2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x8da3486b955f32c9 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366674.954451:0:6675:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789366674.954458:0:5804:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.123@tcp lock: ffff9638a0740e00/0x8da3486b955f32c2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x8da3486b955f32c9 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366674.954460:0:6675:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.123@tcp lock: ffff9638832d3000/0x8da3486b955f2fce lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x8da3486b955f2fd5 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789366674.954473:0:5804:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.123@tcp lock: ffff9638a0740e00/0x8da3486b955f32c2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x8da3486b955f32c9 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366674.954476:0:6675:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.123@tcp lock: ffff9638832d3000/0x8da3486b955f2fce lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x8da3486b955f2fd5 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789366674.954484:0:5804:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:0.0:1789366674.954490:0:5804:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:0.0:1789366674.954492:0:5804:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:3.0:1789366674.954502:0:6675:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789366674.954506:0:6675:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789366674.954508:0:6675:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789366674.954524:0:5804:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.123@tcp lock: ffff9638a0740e00/0x8da3486b955f32c2 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x8da3486b955f32c9 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366674.954531:0:5804:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789366674.954535:0:12969:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.123@tcp lock: ffff963880030c00/0x8da3486b955f2d90 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x8da3486b955f2d97 expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366674.954550:0:12969:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1789366674.954553:0:12969:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0000 10000000:01000000:2.0:1789366674.954556:0:12969:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0000 (0) 00010000:00010000:0.0:1789366674.954559:0:5804:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.123@tcp lock: ffff9638a0740e00/0x8da3486b955f32c2 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x8da3486b955f32c9 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366674.954568:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.123@tcp lock: ffff9638a0740e00/0x8da3486b955f32c2 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x8da3486b955f32c9 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366674.954579:0:5804:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789366674.954583:0:5804:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.123@tcp lock: ffff963880030c00/0x8da3486b955f2d90 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x8da3486b955f2d97 expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366674.954588:0:5804:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff963880030c00 already unused, calling callback (ffffffffc1cc7c20) 00000020:01000004:2.0:1789366674.954597:0:12969:0:(tgt_mount.c:2115:server_put_super()) stopping lustre-MDT0000 10000000:00010000:0.0:1789366674.954598:0:5804:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.123@tcp lock: ffff963880030c00/0x8da3486b955f2d90 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x8da3486b955f2d97 expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000000:2.0:1789366674.954603:0:12969:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000 (flags='F') 00010000:00010000:0.0:1789366674.954609:0:5804:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.123@tcp lock: ffff963880030c00/0x8da3486b955f2d90 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x8da3486b955f2d97 expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:2.0:1789366674.954610:0:12969:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1789366674.954616:0:12969:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000: forcing exports to disconnect: 2/5 10000000:00010000:0.0:1789366674.954620:0:5804:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.123@tcp lock: ffff963880030c00/0x8da3486b955f2d90 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x8da3486b955f2d97 expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:2.0:1789366674.954624:0:12969:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff9638b7020800 lustre-MDT0000-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 10000000:01000000:0.0:1789366674.954635:0:5804:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 00000020:00080000:2.0:1789366674.954637:0:12969:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff963784ba0800 lustre-MDT0000-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 10000000:01000000:0.0:1789366674.954641:0:5804:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:0.0:1789366674.954644:0:5804:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:0.0:1789366674.954659:0:5804:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.123@tcp lock: ffff963880030c00/0x8da3486b955f2d90 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x8da3486b955f2d97 expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366674.954666:0:5804:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789366674.954673:0:5804:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.123@tcp lock: ffff963880030c00/0x8da3486b955f2d90 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x8da3486b955f2d97 expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366674.954692:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.123@tcp lock: ffff963880030c00/0x8da3486b955f2d90 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x8da3486b955f2d97 expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366674.954714:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789366674.954736:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789366674.954738:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789366674.954744:0:6675:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789366674.954755:0:3286:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9638b7038380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8cde4528-5832-4854-a387-4adacc3dd0ab:3286:1876286758787840:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789366674.954759:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96378749b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8cde4528-5832-4854-a387-4adacc3dd0ab:3284:1876286758788096:0@lo:103:ldlm_bl.0 00000020:00080000:2.0:1789366674.954955:0:12969:0:(genops.c:1553:class_disconnect_exports()) OBD device 5 (ffff96388952b380) has exports, disconnecting them 00000020:00080000:2.0:1789366674.954962:0:12969:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9638b7020800), last request at 1789366673 00000020:00000080:2.0:1789366674.954968:0:12969:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x8da3486b955f2f96 00000100:00080000:2.0:1789366674.954982:0:12969:0:(import.c:65:import_set_state_nolock()) ffff9638b7021800 : changing import state from FULL to CLOSED 00000020:00080000:2.0:1789366674.955042:0:12969:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9638b7020800): rc 0 00000020:00000080:2.0:1789366674.955046:0:12969:0:(genops.c:885:class_export_put()) final put ffff9638b7020800/lustre-MDT0000-lwp-OST0001_UUID 00010000:00010000:1.0:1789366674.955077:0:5805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789366674.955107:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00080000:2.0:1789366674.955339:0:12969:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff963784ba0800), last request at 1789366673 00000020:00000080:2.0:1789366674.955344:0:12969:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x8da3486b955f2ebd 00000100:00080000:2.0:1789366674.955350:0:12969:0:(import.c:65:import_set_state_nolock()) ffff963784ba4800 : changing import state from FULL to CLOSED 00000020:00080000:2.0:1789366674.955391:0:12969:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff963784ba0800): rc 0 00000020:00000080:2.0:1789366674.955393:0:12969:0:(genops.c:885:class_export_put()) final put ffff963784ba0800/lustre-MDT0000-lwp-OST0000_UUID 00000004:00000080:2.0:1789366674.955400:0:12969:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=400866e7 len=0 karg=ffffa15081c93ae0 00000100:00080000:2.0:1789366674.955418:0:12969:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1789366674.955421:0:12969:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967324 gen 3 00000004:00080000:2.0:1789366674.955434:0:12969:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:2.0:1789366674.955493:0:12969:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:2.0:1789366674.955504:0:12969:0:(import.c:65:import_set_state_nolock()) ffff963785035000 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:2.0:1789366674.955515:0:12969:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1789366674.955517:0:12969:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967310 gen 3 00000004:00080000:2.0:1789366674.955883:0:12969:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1789366674.955969:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff963787498000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8cde4528-5832-4854-a387-4adacc3dd0ab:3285:1876286758788224:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789366674.956008:0:3287:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9638b6d57100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8cde4528-5832-4854-a387-4adacc3dd0ab:3287:1876286758787968:0@lo:103:ldlm_bl.0 00000020:00000080:0.0:1789366674.956149:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9638b7020800/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000 00000100:00080000:2.0:1789366674.956181:0:12969:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:00000080:0.0:1789366674.956191:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff963784ba0800/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00000100:00080000:2.0:1789366674.956196:0:12969:0:(import.c:65:import_set_state_nolock()) ffff9638829e4000 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000020:00000080:0.0:1789366674.956216:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9638b7021800 for lustre-MDT0000 00000020:00000080:0.0:1789366674.956223:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff963784ba4800 for lustre-MDT0000 00000100:00100000:0.0:1789366674.956247:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286758788096 00000100:00100000:0.0:1789366674.956254:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286758788096 00000020:00080000:2.0:1789366674.956259:0:12969:0:(genops.c:1558:class_disconnect_exports()) OBD device 5 (ffff96388952b380) has no exports 00000100:00100000:3.0:1789366674.956388:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9638aef24380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3283:1876286758788352:0@lo:9:umount.0 00000100:00100000:0.0:1789366674.956446:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1789366674.956455:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638b6d54380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8cde4528-5832-4854-a387-4adacc3dd0ab+18:3284:x1876286758788096:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789366674.956466:0:5801:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789366674.956480:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9638a0740a00/0x8da3486b955f32c9 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x8da3486b955f32c2 expref: 18 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366674.956495:0:5801:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789366674.956540:0:3287:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789366674.956578:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286758787968 00000100:00100000:1.0:1789366674.956582:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286758787968 00000100:00100000:1.0:1789366674.956612:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1789366674.956619:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96388327e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8cde4528-5832-4854-a387-4adacc3dd0ab+18:3287:x1876286758787968:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789366674.956627:0:5802:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789366674.956636:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff963880031e00/0x8da3486b955f2fd5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x8da3486b955f2fce expref: 18 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366674.956648:0:5802:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789366674.956681:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96388327e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8cde4528-5832-4854-a387-4adacc3dd0ab+17:3287:x1876286758787968:12345-0@lo:103:ldlm_bl.0 Request processed in 63us (142us total) trans 0 rc 0/0 00000100:00100000:1.0:1789366674.956687:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1789366674.956745:0:3287:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9638b6d57100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8cde4528-5832-4854-a387-4adacc3dd0ab:3287:1876286758787968:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789366674.956758:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789366674.956769:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789366674.956819:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286758787840 00000100:00100000:2.0:1789366674.956824:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286758787840 00000100:00100000:2.0:1789366674.956862:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1789366674.956871:0:5803:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 4 min 3 max 56 00000100:00100000:2.0:1789366674.956873:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96388327f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8cde4528-5832-4854-a387-4adacc3dd0ab+17:3286:x1876286758787840:12345-0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789366674.956880:0:5803:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_004' 00010000:00010000:2.0:1789366674.956902:0:5802:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789366674.956913:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9638832d2e00/0x8da3486b955f30ae lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x8da3486b955f30a7 expref: 17 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366674.956927:0:5802:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789366674.956970:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96388327f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8cde4528-5832-4854-a387-4adacc3dd0ab+16:3286:x1876286758787840:12345-0@lo:103:ldlm_bl.0 Request processed in 99us (199us total) trans 0 rc 0/0 00000100:00100000:2.0:1789366674.956979:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1789366674.957028:0:3286:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9638b7038380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8cde4528-5832-4854-a387-4adacc3dd0ab:3286:1876286758787840:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789366674.957388:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789366674.957407:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638b6d54380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8cde4528-5832-4854-a387-4adacc3dd0ab+15:3284:x1876286758788096:12345-0@lo:103:ldlm_bl.0 Request processed in 951us (2298us total) trans 0 rc 0/0 00000100:00100000:0.0:1789366674.957414:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1789366674.957417:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9638aef25f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3283:1876286758788480:0@lo:9:umount.0 00000100:00100000:3.0:1789366674.957443:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789366674.957476:0:8065:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286758788352 00000100:00100000:0.0:1789366674.957480:0:8065:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286758788352 00000100:00100000:0.0:1789366674.957506:0:8065:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286758788480 00000100:00100000:0.0:1789366674.957509:0:8065:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286758788480 00000100:00100000:0.0:1789366674.957529:0:8065:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1789366674.957539:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1789366674.957539:0:8065:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638b6d57800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3283:x1876286758788352:12345-0@lo:9:umount.0 00000100:00100000:3.0:1789366674.957553:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638b6d56a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3283:x1876286758788480:12345-0@lo:9:umount.0 00000020:00000080:0.0:1789366674.957561:0:8065:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x8da3486b955f2f0a 00000100:00080000:0.0:1789366674.957569:0:8065:0:(import.c:65:import_set_state_nolock()) ffff963784ba1000 : changing import state from FULL to CLOSED 00000020:00000080:3.0:1789366674.957570:0:6659:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x8da3486b955f2fff 00000100:00080000:3.0:1789366674.957579:0:6659:0:(import.c:65:import_set_state_nolock()) ffff9638b737a000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1789366674.957597:0:8065:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967324 00000001:00000004:3.0:1789366674.957611:0:6659:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967310 00000100:00100000:1.0:1789366674.957677:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96378749b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8cde4528-5832-4854-a387-4adacc3dd0ab:3284:1876286758788096:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789366674.957814:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638b6d56a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+2:3283:x1876286758788480:12345-0@lo:9:umount.0 Request processed in 264us (369us total) trans 0 rc 0/0 00000100:00100000:3.0:1789366674.957821:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00010000:00010000:3.0:1789366674.957843:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789366674.957853:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1789366674.957878:0:3283:0:(import.c:65:import_set_state_nolock()) ffff9638829e4000 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:1.0:1789366674.957891:0:3283:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:1.0:1789366674.957893:0:3283:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1789366674.957896:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9638aef25f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3283:1876286758788480:0@lo:9:umount.0 00000100:00100000:3.0:1789366674.957913:0:8419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286758788224 00000100:00100000:3.0:1789366674.957918:0:8419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286758788224 00000100:00100000:3.0:1789366674.957956:0:8419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1789366674.957964:0:8419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638b6d57480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8cde4528-5832-4854-a387-4adacc3dd0ab+15:3285:x1876286758788224:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789366674.957974:0:8419:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789366674.957987:0:8419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9638827f7c00/0x8da3486b955f2d97 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x8da3486b955f2d90 expref: 15 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366674.958003:0:8419:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789366674.958049:0:8419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638b6d57480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8cde4528-5832-4854-a387-4adacc3dd0ab+14:3285:x1876286758788224:12345-0@lo:103:ldlm_bl.0 Request processed in 87us (195us total) trans 0 rc 0/0 00000100:00100000:3.0:1789366674.958057:0:8419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1789366674.958108:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff963787498000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8cde4528-5832-4854-a387-4adacc3dd0ab:3285:1876286758788224:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789366674.958128:0:6675:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789366674.958211:0:8065:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638b6d57800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+2:3283:x1876286758788352:12345-0@lo:9:umount.0 Request processed in 675us (823us total) trans 0 rc 0/0 00000100:00100000:0.0:1789366674.958219:0:8065:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00010000:00010000:0.0:1789366674.958233:0:5805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1789366674.958263:0:3283:0:(import.c:65:import_set_state_nolock()) ffff963785035000 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:1.0:1789366674.958305:0:3283:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:1.0:1789366674.958353:0:3283:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1789366674.958357:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9638aef24380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3283:1876286758788352:0@lo:9:umount.0 00000020:00080000:0.0:1789366674.966252:0:12969:0:(genops.c:1558:class_disconnect_exports()) OBD device 5 (ffff96388952b380) has no exports 00000020:00000080:0.0:1789366675.006313:0:12969:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x8da3486b955f2deb 00000020:00000080:0.0:1789366675.006328:0:12969:0:(genops.c:885:class_export_put()) final put ffff9638a739b000/lustre-QMT0000_UUID 00000020:01000000:0.0:1789366675.006399:0:12969:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-QMT0000 (flags='') 00000020:00000080:1.0:1789366675.006490:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9638a739b000/lustre-QMT0000_UUID for lustre-QMT0000 00000020:00000080:1.0:1789366675.006513:0:12969:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1789366675.006523:0:12969:0:(obd_config.c:956:class_cleanup()) lustre-QMT0000: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1789366675.006527:0:12969:0:(genops.c:1558:class_disconnect_exports()) OBD device 7 (ffff9638bfe7b380) has no exports 00000020:00000080:1.0:1789366675.007024:0:12969:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x8da3486b955f2de4 00000020:00000080:1.0:1789366675.007030:0:12969:0:(genops.c:885:class_export_put()) final put ffff9638bfe86000/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1789366675.007084:0:12969:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1789366675.007091:0:12969:0:(obd_config.c:883:class_detach()) detach on obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:1.0:1789366675.007094:0:12969:0:(genops.c:885:class_export_put()) final put ffff9638bf5cc000/lustre-QMT0000_UUID 00000020:00000080:1.0:1789366675.007096:0:12969:0:(genops.c:844:class_export_destroy()) destroying export ffff9638bf5cc000/lustre-QMT0000_UUID for lustre-QMT0000 00000020:01000000:1.0:1789366675.007099:0:12969:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-QMT0000 (lustre-QMT0000_UUID) 00000020:00000080:3.0:1789366675.008058:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9638bfe86000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:1.0:1789366675.008141:0:12969:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff963882eac0c0 - data ffff9638aa64b438/ffff9637853fc000 00000020:01000000:1.0:1789366675.008283:0:12969:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff96388a116f60 - data ffff9638aa4000d8/ffff963889488400 00000001:00000004:1.0:1789366675.034843:0:12969:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967520 00000100:00080000:3.0:1789366675.106546:0:12969:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1789366675.106554:0:12969:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967324 gen 4 00000004:00080000:3.0:1789366675.106568:0:12969:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1789366675.106571:0:12969:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:0.0:1789366675.106778:0:7130:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:0.0:1789366675.106783:0:7130:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x3:0x0] index 8 count 1 00000040:00080000:0.0:1789366675.106793:0:7130:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 1 count 2 00000100:00080000:3.0:1789366675.107713:0:12969:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1789366675.107747:0:12969:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967310 gen 4 00000004:00080000:3.0:1789366675.107764:0:12969:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1789366675.107767:0:12969:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:1.0:1789366675.108425:0:8063:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:1.0:1789366675.108429:0:8063:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x6:0x0] index 5 count 1 00000040:00080000:1.0:1789366675.108440:0:8063:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 1 count 2 00000020:00000080:0.0:1789366675.144192:0:12969:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x8da3486b955f2db3 00000020:00000080:0.0:1789366675.144203:0:12969:0:(genops.c:885:class_export_put()) final put ffff9638bec79800/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1789366675.144271:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9638bec79800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1789366675.145135:0:12969:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x8da3486b955f2dc8 00000020:00000080:0.0:1789366675.145141:0:12969:0:(genops.c:885:class_export_put()) final put ffff9638bf5cc800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:0.0:1789366675.145147:0:12969:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-mdtlov (flags='') 00000020:00000080:0.0:1789366675.145152:0:12969:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789366675.145159:0:12969:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1789366675.145163:0:12969:0:(genops.c:1558:class_disconnect_exports()) OBD device 4 (ffff9638895299c0) has no exports 00000020:00000080:3.0:1789366675.145186:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9638bf5cc800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000004:01000000:0.0:1789366675.145327:0:12969:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:0.0:1789366675.145335:0:12969:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x8da3486b955f2ff8 00000020:00000080:0.0:1789366675.145339:0:12969:0:(genops.c:885:class_export_put()) final put ffff9638b737f800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:0.0:1789366675.145353:0:12969:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0000 (flags='') 00000020:00000080:0.0:1789366675.145357:0:12969:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789366675.145362:0:12969:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:0.0:1789366675.145365:0:12969:0:(genops.c:1558:class_disconnect_exports()) OBD device 17 (ffff9638b4f299c0) has no exports 00000020:00000080:0.0:1789366675.145369:0:12969:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x8da3486b955f2ff1 00000020:00000080:0.0:1789366675.145372:0:12969:0:(genops.c:885:class_export_put()) final put ffff9638829da800/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1789366675.145442:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9638b737f800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:00000080:3.0:1789366675.145448:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9638829da800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:0.0:1789366675.145936:0:12969:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0000: client import never connected 00000100:00080000:0.0:1789366675.145940:0:12969:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:0.0:1789366675.145944:0:12969:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967310 gen 5 00000004:00080000:0.0:1789366675.145950:0:12969:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1789366675.145953:0:12969:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1789366675.146009:0:12969:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789366675.146024:0:12969:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1789366675.146030:0:12969:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x8da3486b955f2f03 00000020:00000080:0.0:1789366675.146034:0:12969:0:(genops.c:885:class_export_put()) final put ffff9638b730b000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1789366675.146198:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9638829e4000 for lustre-OST0001-osc-MDT0000 00000020:00000080:3.0:1789366675.146205:0:37:0:(genops.c:885:class_export_put()) final put ffff9638b7027000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1789366675.146207:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9638b7027000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:01000000:3.0:1789366675.146212:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:01000000:0.0:1789366675.146248:0:12969:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0000 (flags='') 00000020:00000080:0.0:1789366675.146252:0:12969:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789366675.146256:0:12969:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:0.0:1789366675.146258:0:12969:0:(genops.c:1558:class_disconnect_exports()) OBD device 13 (ffff9638bfe7cd40) has no exports 00000020:00000080:0.0:1789366675.146267:0:12969:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x8da3486b955f2efc 00000020:00000080:0.0:1789366675.146270:0:12969:0:(genops.c:885:class_export_put()) final put ffff963785033000/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1789366675.146529:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9638b730b000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:00000080:3.0:1789366675.146536:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff963785033000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:0.0:1789366675.146666:0:12969:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0000: client import never connected 00000100:00080000:0.0:1789366675.146669:0:12969:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:0.0:1789366675.146672:0:12969:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967324 gen 5 00000004:00080000:0.0:1789366675.146675:0:12969:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1789366675.146676:0:12969:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1789366675.146705:0:12969:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789366675.146710:0:12969:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1789366675.146744:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff963785035000 for lustre-OST0000-osc-MDT0000 00000020:00000080:3.0:1789366675.146750:0:37:0:(genops.c:885:class_export_put()) final put ffff963784bbf000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1789366675.146753:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff963784bbf000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:01000000:3.0:1789366675.146758:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1789366675.146758:0:12969:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789366675.146762:0:12969:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1789366675.146765:0:12969:0:(genops.c:885:class_export_put()) final put ffff9638bec78000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1789366675.146855:0:12969:0:(genops.c:844:class_export_destroy()) destroying export ffff9638bec78000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:0.0:1789366675.146861:0:12969:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-mdtlov (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1789366675.146971:0:12969:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x8da3486b955f2dcf 00000020:00000080:0.0:1789366675.146975:0:12969:0:(genops.c:885:class_export_put()) final put ffff9638bf5c8800/lustre-MDD0000_UUID 00000020:01000000:0.0:1789366675.146987:0:12969:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0000 (flags='') 00000020:00000080:0.0:1789366675.146990:0:12969:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789366675.146993:0:12969:0:(obd_config.c:956:class_cleanup()) lustre-MDD0000: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1789366675.146995:0:12969:0:(genops.c:1558:class_disconnect_exports()) OBD device 6 (ffff963889528000) has no exports 00000020:00000080:0.0:1789366675.147022:0:12969:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789366675.147025:0:12969:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000020:00000080:0.0:1789366675.147028:0:12969:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x8da3486b955f2dd6 00000020:00000080:0.0:1789366675.147031:0:12969:0:(genops.c:885:class_export_put()) final put ffff9638bf5c9800/lustre-MDT0000-osd_UUID 00000020:01000004:0.0:1789366675.147037:0:12969:0:(tgt_mount.c:187:server_put_mount()) put mount ffff963884956000 from lustre-MDT0000, refs=3 00000020:00000080:3.0:1789366675.147038:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9638bf5c8800/lustre-MDD0000_UUID for lustre-MDD0000 00000020:01000004:0.0:1789366675.147040:0:12969:0:(obd_mount.c:710:lustre_put_lsi()) put ffff963884956000 3 00000020:00000080:3.0:1789366675.147041:0:37:0:(genops.c:885:class_export_put()) final put ffff9638bec07800/lustre-MDD0000_UUID 00000020:00000080:3.0:1789366675.147043:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9638bec07800/lustre-MDD0000_UUID for lustre-MDD0000 00000020:01000004:0.0:1789366675.147043:0:12969:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff963884956000 from lustre-MDT0000 00000020:01000000:3.0:1789366675.147047:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0000 (lustre-MDD0000_UUID) 00000020:00000080:0.0:1789366675.147062:0:12969:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789366675.147066:0:12969:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:00000080:0.0:1789366675.147068:0:12969:0:(genops.c:885:class_export_put()) final put ffff9638bec7b000/lustre-MDT0000_UUID 00000020:00000080:0.0:1789366675.147069:0:12969:0:(genops.c:844:class_export_destroy()) destroying export ffff9638bec7b000/lustre-MDT0000_UUID for lustre-MDT0000 00000020:01000000:0.0:1789366675.147075:0:12969:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000 (lustre-MDT0000_UUID) 00000020:01000004:0.0:1789366675.147099:0:12969:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 2 references. 00000020:01000004:0.0:1789366675.147102:0:12969:0:(tgt_mount.c:255:server_stop_mgs()) Stop MGS service MGS 00000020:01000000:0.0:1789366675.147105:0:12969:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGS (flags='F') 00000020:00000080:0.0:1789366675.147107:0:12969:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789366675.147109:0:12969:0:(obd_config.c:956:class_cleanup()) MGS: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1789366675.147115:0:12969:0:(genops.c:1819:print_export_data()) MGS: ACTIVE ffff963883534000 8cde4528-5832-4854-a387-4adacc3dd0ab 0@lo 13 (0 0 8) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1789366675.147120:0:12969:0:(genops.c:1553:class_disconnect_exports()) OBD device 1 (ffff96388952cd40) has exports, disconnecting them 00000020:00080000:0.0:1789366675.147123:0:12969:0:(genops.c:1528:class_disconnect_export_list()) MGS: disconnecting export at 0@lo (ffff963883534000), last request at 1789366517 00000020:00000080:0.0:1789366675.147135:0:12969:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x8da3486b955f2d74 00000020:00010000:0.0:1789366675.147138:0:12969:0:(genops.c:1921:obd_stale_export_put()) Put export ffff963883534000: total 2 00000100:00080000:0.0:1789366675.147141:0:12969:0:(import.c:65:import_set_state_nolock()) ffff963883535000 : changing import state from FULL to CLOSED 00000020:00080000:0.0:1789366675.147151:0:12969:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff963883534000): rc 0 00000020:00080000:0.0:1789366675.147154:0:12969:0:(genops.c:1558:class_disconnect_exports()) OBD device 1 (ffff96388952cd40) has no exports 00000020:00000080:3.0:1789366675.147187:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9638bf5c9800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00010000:3.0:1789366675.147196:0:5804:0:(genops.c:1907:obd_stale_export_get()) Get export ffff963883534000: total 0 00000100:00100000:0.0:1789366675.147200:0:5810:0:(service.c:3183:ptlrpc_main()) ll_mgs_0001: service thread [ffff9638b4e21200:5810] 1 exiting: rc = 0 00010000:00010000:3.0:1789366675.147213:0:5804:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff963883534000, canceled 0 locks, left on hash table 8. 00010000:00010000:3.0:1789366675.147239:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9638a0740c00/0x8da3486b955f3068 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x8da3486b955f3061 expref: 9 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366675.147253:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff96388148e200/0x8da3486b955f3076 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x8da3486b955f306f expref: 8 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366675.147264:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9638827f6400/0x8da3486b955f3084 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x8da3486b955f307d expref: 7 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366675.147275:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9638832d2a00/0x8da3486b955f32ad lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x8da3486b955f32a6 expref: 6 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366675.147298:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9638832d3200/0x8da3486b955f3092 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x8da3486b955f308b expref: 5 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366675.147307:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9638a0741000/0x8da3486b955f32bb lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x8da3486b955f32b4 expref: 4 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366675.147321:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9638a0740000/0x8da3486b955f2e70 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x8da3486b955f2e69 expref: 3 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366675.147332:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9638832d2800/0x8da3486b955f30bc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x8da3486b955f30b5 expref: 2 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366675.147342:0:5804:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff963883534000, canceled 8 locks, left on hash table 0. 00000020:00000080:3.0:1789366675.147355:0:5804:0:(genops.c:885:class_export_put()) final put ffff963883534000/8cde4528-5832-4854-a387-4adacc3dd0ab 00010000:00010000:3.0:1789366675.147361:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789366675.147363:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789366675.147365:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1789366675.147369:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff963883534000/8cde4528-5832-4854-a387-4adacc3dd0ab for MGS 00000100:00100000:2.0:1789366675.147426:0:5811:0:(service.c:3183:ptlrpc_main()) ll_mgs_0002: service thread [ffff963882fb6400:5811] 2 exiting: rc = 0 00000020:00000080:1.0:1789366675.147485:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff963883535000 for MGS 00000100:00100000:2.0:1789366675.147542:0:5808:0:(service.c:3183:ptlrpc_main()) ll_mgs_0000: service thread [ffff9638b4e23200:5808] 0 exiting: rc = 1 00000100:00100000:0.0:1789366675.147577:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789366675.147584:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789366675.147589:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789366675.147594:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789366675.147600:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789366675.147605:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789366675.147610:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789366675.147616:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789366675.147622:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789366675.147626:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789366675.147632:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789366675.147637:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789366675.147643:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789366675.147648:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789366675.147653:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789366675.147658:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789366675.147663:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789366675.147668:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789366675.147673:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789366675.147683:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789366675.147688:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789366675.147693:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789366675.147697:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789366675.147702:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789366675.147707:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789366675.147711:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789366675.147968:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789366675.147975:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789366675.147980:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789366675.147984:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789366675.147989:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789366675.147994:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789366675.147999:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789366675.148003:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789366675.148007:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789366675.148012:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789366675.148028:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789366675.148033:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789366675.148038:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789366675.148043:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789366675.148048:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789366675.148053:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789366675.148057:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789366675.148062:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789366675.148067:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789366675.148072:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789366675.148076:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789366675.148082:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789366675.148092:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789366675.148098:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789366675.148103:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789366675.148108:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789366675.148113:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789366675.148117:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789366675.148127:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789366675.148132:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789366675.148136:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789366675.148141:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789366675.148146:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789366675.148151:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789366675.148156:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789366675.148160:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789366675.148165:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789366675.148169:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 20000000:01000000:0.0:1789366675.148713:0:12969:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:0.0:1789366675.148910:0:12969:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 00000020:01000000:0.0:1789366675.149539:0:12969:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff96389868bf60 - data ffff9638aa68ebd0/ffff963785a06800 00000020:01000000:0.0:1789366675.149638:0:12969:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9638871f3960 - data ffff9638bb3421b0/ffff9638833a4800 00000020:00000080:0.0:1789366675.150348:0:12969:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x8da3486b955f2d58 00000020:00000080:0.0:1789366675.150354:0:12969:0:(genops.c:885:class_export_put()) final put ffff96388357a800/lustre-MDT0000-osd_UUID 00000020:01000004:0.0:1789366675.150362:0:12969:0:(tgt_mount.c:187:server_put_mount()) put mount ffff963884956000 from MGS, refs=2 00000020:01000004:0.0:1789366675.150365:0:12969:0:(obd_mount.c:710:lustre_put_lsi()) put ffff963884956000 2 00000020:01000004:0.0:1789366675.150367:0:12969:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff963884956000 from MGS 00000020:00000080:0.0:1789366675.150383:0:12969:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789366675.150388:0:12969:0:(obd_config.c:883:class_detach()) detach on obd MGS (uuid MGS) 00000020:00000080:0.0:1789366675.150390:0:12969:0:(genops.c:885:class_export_put()) final put ffff963883536800/MGS 00000020:00000080:0.0:1789366675.150392:0:12969:0:(genops.c:844:class_export_destroy()) destroying export ffff963883536800/MGS for MGS 00000020:01000000:0.0:1789366675.150397:0:12969:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGS (MGS) 00000020:00000080:1.0:1789366675.150463:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff96388357a800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:0.0:1789366675.150503:0:12969:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0000 (flags='F') 00000020:00000080:0.0:1789366675.150507:0:12969:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789366675.150512:0:12969:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-MDT0000: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1789366675.150517:0:12969:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-MDT0000: ACTIVE ffff963885b41000 lustre-MDT0000-lwp-MDT0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1789366675.150522:0:12969:0:(genops.c:1553:class_disconnect_exports()) OBD device 8 (ffff9638986a19c0) has exports, disconnecting them 00000020:00080000:0.0:1789366675.150526:0:12969:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0000: disconnecting export at 0@lo (ffff963885b41000), last request at 1789366517 00000020:00000080:0.0:1789366675.150530:0:12969:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x8da3486b955f2e23 00000020:00080000:0.0:1789366675.150537:0:12969:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff963885b41000): rc 0 00000020:00000080:0.0:1789366675.150547:0:12969:0:(genops.c:885:class_export_put()) final put ffff963885b41000/lustre-MDT0000-lwp-MDT0000 00000020:00000080:1.0:1789366675.151505:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff963885b41000/lustre-MDT0000-lwp-MDT0000 for lustre-MDT0000-lwp-MDT0000 00010000:01000000:0.0:1789366675.154441:0:12969:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0000: client import never connected 00000100:00080000:0.0:1789366675.154450:0:12969:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1789366675.154454:0:12969:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:0.0:1789366675.154461:0:12969:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1789366675.154592:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff963885b44000 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:0.0:1789366675.154918:0:12969:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789366675.154926:0:12969:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000020:00000080:0.0:1789366675.154930:0:12969:0:(genops.c:885:class_export_put()) final put ffff9638ba2ef000/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:0.0:1789366675.154934:0:12969:0:(genops.c:844:class_export_destroy()) destroying export ffff9638ba2ef000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000-lwp-MDT0000 00000020:01000000:0.0:1789366675.154940:0:12969:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0000 (lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000004:0.0:1789366675.154992:0:12969:0:(obd_mount.c:710:lustre_put_lsi()) put ffff963884956000 1 00000020:00000080:0.0:1789366675.154996:0:12969:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x8da3486b955f2d4a 00000020:00000080:0.0:1789366675.155002:0:12969:0:(genops.c:885:class_export_put()) final put ffff963883536000/lustre-MDT0000-osd_UUID 00000020:01000000:0.0:1789366675.155023:0:12969:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osd (flags='') 00000020:00000080:0.0:1789366675.155027:0:12969:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789366675.155031:0:12969:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1789366675.155034:0:12969:0:(genops.c:1558:class_disconnect_exports()) OBD device 0 (ffff963882f58000) has no exports 00000020:00000080:1.0:1789366675.155092:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff963883536000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1789366675.165179:0:12969:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1789366675.165191:0:12969:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00000020:00000080:3.0:1789366675.165196:0:12969:0:(genops.c:885:class_export_put()) final put ffff963884952800/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1789366675.165201:0:12969:0:(genops.c:844:class_export_destroy()) destroying export ffff963884952800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:3.0:1789366675.165208:0:12969:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osd (lustre-MDT0000-osd_UUID) 00000020:01000004:3.0:1789366675.165329:0:12969:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff963884953000 00000020:01000000:3.0:1789366675.165348:0:12969:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MDS (flags='F') 00000020:00000080:3.0:1789366675.165351:0:12969:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1789366675.165354:0:12969:0:(obd_config.c:956:class_cleanup()) MDS: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1789366675.165357:0:12969:0:(genops.c:1558:class_disconnect_exports()) OBD device 3 (ffff9638b4f28000) has no exports 00000100:00100000:3.0:1789366675.165434:0:7614:0:(service.c:3183:ptlrpc_main()) mdt00_004: service thread [ffff9638aef98200:7614] 4 exiting: rc = 0 00000100:00100000:2.0:1789366675.165435:0:5816:0:(service.c:3183:ptlrpc_main()) mdt00_001: service thread [ffff9638b4f37000:5816] 1 exiting: rc = 0 00000100:00100000:0.0:1789366675.165538:0:5817:0:(service.c:3183:ptlrpc_main()) mdt00_002: service thread [ffff9638b4f37400:5817] 2 exiting: rc = 0 00000100:00100000:0.0:1789366675.165596:0:5815:0:(service.c:3183:ptlrpc_main()) mdt00_000: service thread [ffff9638b4f36c00:5815] 0 exiting: rc = 1 00000100:00100000:2.0:1789366675.165690:0:7132:0:(service.c:3183:ptlrpc_main()) mdt00_003: service thread [ffff963784b96c00:7132] 3 exiting: rc = 0 00000100:00100000:3.0:1789366675.165821:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789366675.165828:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789366675.165844:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789366675.165849:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789366675.165855:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789366675.165861:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789366675.165877:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789366675.165890:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789366675.165898:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789366675.165903:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789366675.165908:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789366675.165913:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789366675.165918:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789366675.165923:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789366675.165928:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789366675.165933:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789366675.165938:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789366675.165943:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789366675.165948:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789366675.165952:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789366675.165959:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789366675.165964:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789366675.165969:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789366675.165974:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789366675.165979:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789366675.165983:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789366675.165988:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789366675.165992:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789366675.165997:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789366675.166002:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789366675.166007:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789366675.166011:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789366675.166027:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789366675.166032:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789366675.166038:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789366675.166042:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789366675.166047:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789366675.166057:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789366675.166062:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789366675.166075:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789366675.166080:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789366675.166085:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789366675.166090:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789366675.166094:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789366675.166099:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789366675.166104:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789366675.166109:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789366675.166113:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789366675.166117:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789366675.166121:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789366675.166126:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789366675.166130:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789366675.166135:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789366675.166139:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789366675.166144:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789366675.166150:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789366675.166158:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789366675.166166:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789366675.166171:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789366675.166175:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789366675.166179:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789366675.166184:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789366675.166189:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789366675.166193:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789366675.170405:0:5818:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_000: service thread [ffff9638b4f36e00:5818] 0 exiting: rc = 1 00000100:00100000:3.0:1789366675.170850:0:5819:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_001: service thread [ffff9638b4f36800:5819] 1 exiting: rc = 0 00000100:00100000:1.0:1789366675.170974:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789366675.170984:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789366675.171001:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789366675.171006:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789366675.171011:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789366675.171874:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789366675.171880:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789366675.171886:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789366675.171891:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789366675.171897:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789366675.171902:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789366675.171909:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789366675.171914:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789366675.171919:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789366675.171924:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789366675.171929:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789366675.171933:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789366675.171938:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789366675.171944:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789366675.171948:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789366675.171954:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789366675.171958:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789366675.171963:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789366675.171968:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789366675.171972:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789366675.171977:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789366675.171982:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789366675.171988:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789366675.171993:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789366675.171998:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789366675.172003:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789366675.172009:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789366675.172593:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789366675.172603:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789366675.172608:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789366675.172613:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789366675.172618:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789366675.172632:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789366675.172637:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789366675.172643:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789366675.172647:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789366675.172652:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789366675.172657:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789366675.172662:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789366675.172667:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789366675.172672:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789366675.172677:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789366675.172682:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789366675.172687:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789366675.172691:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789366675.172696:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789366675.172701:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789366675.172705:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789366675.172710:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789366675.172732:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789366675.172738:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789366675.173024:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789366675.173030:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789366675.173036:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789366675.173040:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789366675.173045:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789366675.173051:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789366675.173056:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789366675.173061:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789366675.174155:0:5820:0:(service.c:3183:ptlrpc_main()) mdt_out00_000: service thread [ffff9638b4f36200:5820] 0 exiting: rc = 1 00000100:00100000:2.0:1789366675.174309:0:5821:0:(service.c:3183:ptlrpc_main()) mdt_out00_001: service thread [ffff9638b4f36a00:5821] 1 exiting: rc = 0 00000100:00100000:1.0:1789366675.174353:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789366675.174361:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789366675.174366:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789366675.174372:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789366675.174390:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789366675.174397:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789366675.174403:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789366675.174416:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789366675.174430:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789366675.174503:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789366675.174512:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789366675.174525:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789366675.174532:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789366675.174538:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789366675.174544:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789366675.174555:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789366675.174575:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789366675.174588:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789366675.174594:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789366675.174600:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789366675.174605:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789366675.174616:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789366675.174623:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789366675.174629:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789366675.174634:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789366675.174640:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789366675.174650:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789366675.174656:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789366675.174678:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789366675.174685:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789366675.174691:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789366675.174697:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789366675.174710:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789366675.174909:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789366675.174918:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789366675.174924:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789366675.174930:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789366675.174936:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789366675.174942:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789366675.174948:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789366675.174969:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789366675.174976:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789366675.174982:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789366675.174995:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789366675.175002:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789366675.175007:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789366675.175024:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789366675.175031:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789366675.175037:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789366675.175044:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789366675.175050:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789366675.175056:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789366675.175077:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789366675.175084:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789366675.175090:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789366675.175097:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789366675.175103:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789366675.175109:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789366675.175114:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789366675.175120:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789366675.175126:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789366675.175131:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789366675.175138:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789366675.175143:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789366675.182917:0:5823:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0001: service thread [ffff9638ba216200:5823] 1 exiting: rc = 0 00000100:00100000:2.0:1789366675.183912:0:5822:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0000: service thread [ffff9638b4f36600:5822] 0 exiting: rc = 1 00000100:00100000:3.0:1789366675.184120:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789366675.184126:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789366675.184129:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789366675.184133:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789366675.184136:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789366675.184140:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789366675.184151:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789366675.184155:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789366675.184158:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789366675.184162:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789366675.184165:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789366675.184168:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789366675.184171:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789366675.184175:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789366675.184179:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789366675.184182:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789366675.184186:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789366675.184189:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789366675.184191:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789366675.184194:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789366675.184197:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789366675.184200:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789366675.184202:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789366675.184205:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789366675.184208:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789366675.184210:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789366675.184213:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789366675.184216:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789366675.184219:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789366675.184222:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789366675.184225:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789366675.184228:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789366675.184231:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789366675.184233:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789366675.184237:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789366675.184240:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789366675.184242:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789366675.184245:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789366675.184248:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789366675.184251:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789366675.184254:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789366675.184260:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789366675.184263:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789366675.184266:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789366675.184269:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789366675.184272:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789366675.184275:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789366675.184278:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789366675.184281:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789366675.184283:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789366675.184286:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789366675.184289:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789366675.184292:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789366675.184295:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789366675.184297:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789366675.184300:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789366675.184302:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789366675.184305:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789366675.184307:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789366675.184310:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789366675.184313:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789366675.184316:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789366675.184319:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789366675.184322:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789366675.184676:0:5825:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0001: service thread [ffff9638ba217200:5825] 1 exiting: rc = 0 00000100:00100000:1.0:1789366675.184875:0:5824:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0000: service thread [ffff9638ba217e00:5824] 0 exiting: rc = 1 00000100:00100000:3.0:1789366675.184893:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789366675.184899:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789366675.184905:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789366675.184910:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789366675.184914:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789366675.184919:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789366675.184924:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789366675.184929:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789366675.184933:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789366675.184939:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789366675.184944:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789366675.184949:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789366675.184964:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789366675.184969:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789366675.184975:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789366675.184980:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789366675.184985:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789366675.184990:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789366675.184994:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789366675.184999:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789366675.185003:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789366675.185009:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789366675.185027:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789366675.185032:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789366675.185037:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789366675.185042:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789366675.185046:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789366675.185051:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789366675.185055:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789366675.185059:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789366675.185064:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789366675.185068:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789366675.185073:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789366675.185078:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789366675.185082:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789366675.185087:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789366675.185091:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789366675.185095:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789366675.185101:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789366675.185106:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789366675.185111:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789366675.185116:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789366675.185121:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789366675.185125:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789366675.185130:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789366675.185136:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789366675.185141:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789366675.185156:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789366675.185161:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789366675.185165:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789366675.185170:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789366675.185175:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789366675.185180:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789366675.185185:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789366675.185190:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789366675.185194:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789366675.185199:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789366675.185204:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789366675.185209:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789366675.185214:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789366675.185219:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789366675.185224:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789366675.185229:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789366675.185234:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789366675.185635:0:5827:0:(service.c:3183:ptlrpc_main()) mdt_fld_0001: service thread [ffff9638ba216000:5827] 1 exiting: rc = 0 00000100:00100000:1.0:1789366675.185875:0:5826:0:(service.c:3183:ptlrpc_main()) mdt_fld_0000: service thread [ffff9638ba216400:5826] 0 exiting: rc = 1 00000100:00100000:3.0:1789366675.189133:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789366675.189142:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789366675.189147:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789366675.189152:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789366675.189156:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789366675.189161:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789366675.189165:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789366675.189169:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789366675.189174:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789366675.189178:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789366675.189183:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789366675.189187:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789366675.189192:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789366675.189197:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789366675.189202:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789366675.189206:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789366675.189210:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789366675.189216:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789366675.189233:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789366675.189237:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789366675.189242:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789366675.189246:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789366675.189251:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789366675.189256:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789366675.189261:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789366675.189266:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789366675.189271:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789366675.189276:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789366675.189281:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789366675.189285:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789366675.189290:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789366675.189295:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789366675.189301:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789366675.189305:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789366675.189310:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789366675.189315:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789366675.189319:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789366675.189323:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789366675.189328:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789366675.189332:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789366675.189337:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789366675.189342:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789366675.189347:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789366675.189357:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789366675.189362:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789366675.189367:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789366675.189373:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789366675.189377:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789366675.189382:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789366675.189387:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789366675.189392:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789366675.189397:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789366675.189401:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789366675.189416:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789366675.189420:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789366675.189425:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789366675.189429:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789366675.189434:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789366675.189450:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789366675.189456:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789366675.189461:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789366675.189466:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789366675.189471:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789366675.189476:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789366675.190210:0:5830:0:(service.c:3183:ptlrpc_main()) mdt_io00_002: service thread [ffff9638ba217000:5830] 2 exiting: rc = 0 00000100:00100000:0.0:1789366675.190215:0:5828:0:(service.c:3183:ptlrpc_main()) mdt_io00_000: service thread [ffff9638ba217c00:5828] 0 exiting: rc = 1 00000100:00100000:2.0:1789366675.190434:0:5829:0:(service.c:3183:ptlrpc_main()) mdt_io00_001: service thread [ffff9638ba216c00:5829] 1 exiting: rc = 0 00000100:00100000:3.0:1789366675.190606:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789366675.190613:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789366675.190618:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789366675.190624:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789366675.190629:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789366675.190636:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789366675.190642:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789366675.190648:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789366675.190654:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789366675.190659:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789366675.190665:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789366675.190670:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789366675.190678:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789366675.190683:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789366675.190688:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789366675.190693:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789366675.190698:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789366675.190703:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789366675.190708:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789366675.190713:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789366675.190984:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789366675.190991:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789366675.191025:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789366675.191033:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789366675.191045:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789366675.191050:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789366675.191055:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789366675.191060:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789366675.191065:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789366675.191071:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789366675.191077:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789366675.191082:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789366675.191087:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789366675.191093:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789366675.191099:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789366675.191105:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789366675.191111:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789366675.191116:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789366675.191122:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789366675.191127:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789366675.191133:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789366675.191138:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789366675.191144:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789366675.191149:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789366675.191154:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789366675.191160:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789366675.191180:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789366675.191187:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789366675.191192:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789366675.191197:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789366675.191203:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789366675.191208:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789366675.191214:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789366675.191220:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789366675.191226:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789366675.191232:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789366675.191237:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789366675.191243:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789366675.191249:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789366675.191262:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789366675.191268:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789366675.191274:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789366675.191280:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789366675.191285:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:3.0:1789366675.195304:0:12969:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1789366675.195316:0:12969:0:(obd_config.c:883:class_detach()) detach on obd MDS (uuid MDS_uuid) 00000020:00000080:3.0:1789366675.195326:0:12969:0:(genops.c:885:class_export_put()) final put ffff9638829e1800/MDS_uuid 00000020:00000080:3.0:1789366675.195330:0:12969:0:(genops.c:844:class_export_destroy()) destroying export ffff9638829e1800/MDS_uuid for MDS 00000020:01000000:3.0:1789366675.195338:0:12969:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MDS (MDS_uuid) 00000020:02000400:3.0:1789366675.195461:0:12969:0:(tgt_mount.c:2184:server_put_super()) server umount lustre-MDT0000 complete 00010000:00010000:3.0:1789366675.511876:0:6675:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789366676.536837:0:5805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1789366676.950280:0:7617:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 0ab23baa-a205-44ad-bf17-f7b47295d82b 00000020:00000080:2.0:1789366676.950291:0:7617:0:(genops.c:885:class_export_put()) final put ffff963888974800/0ab23baa-a205-44ad-bf17-f7b47295d82b 00000001:00100000:2.0:1789366676.950320:0:7617:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1789366676.950324:0:7617:0:(genops.c:885:class_export_put()) final put ffff9638b737a800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1789366676.950324:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff963888974800/0ab23baa-a205-44ad-bf17-f7b47295d82b for lustre-OST0001 00000020:00000080:1.0:1789366676.950407:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9638b737a800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001 00000020:00000080:1.0:1789366676.950429:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff963888970800 for lustre-OST0001 00000020:00000080:1.0:1789366676.950434:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9638b737a000 for lustre-OST0001 00000020:01000004:2.0:1789366677.019924:0:13120:0:(tgt_mount.c:2195:server_umount_begin()) umount -f 00000020:01000004:2.0:1789366677.034430:0:13120:0:(tgt_mount.c:2065:server_put_super()) server put_super lustre-OST0000 00010000:00010000:2.0:1789366677.034488:0:13120:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.123@tcp lock: ffff9638832d2600/0x8da3486b955f307d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x8da3486b955f3084 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366677.034504:0:13120:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.123@tcp lock: ffff9638832d2600/0x8da3486b955f307d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x8da3486b955f3084 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366677.034538:0:13120:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.123@tcp lock: ffff9638832d2600/0x8da3486b955f307d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x8da3486b955f3084 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366677.034546:0:13120:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.123@tcp lock: ffff9638832d2600/0x8da3486b955f307d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x8da3486b955f3084 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366677.034570:0:13120:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1789366677.034574:0:13120:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:2.0:1789366677.034599:0:13120:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1789366677.034603:0:13120:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:2.0:1789366677.034609:0:13120:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00010000:00010000:3.0:1789366677.034615:0:5804:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789366677.034624:0:5804:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.123@tcp lock: ffff9638832d2600/0x8da3486b955f307d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0x8da3486b955f3084 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366677.034633:0:5804:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9638832d2600 already unused, calling callback (ffffffffc1cc7c20) 00000100:00080000:2.0:1789366677.034637:0:13120:0:(import.c:65:import_set_state_nolock()) ffff9638ba2ec800 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 10000000:00010000:3.0:1789366677.034638:0:5804:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.123@tcp lock: ffff9638832d2600/0x8da3486b955f307d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0x8da3486b955f3084 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366677.034652:0:5804:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.123@tcp lock: ffff9638832d2600/0x8da3486b955f307d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1008400000000 nid: local remote: 0x8da3486b955f3084 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789366677.034661:0:5804:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.123@tcp lock: ffff9638832d2600/0x8da3486b955f307d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1009400000000 nid: local remote: 0x8da3486b955f3084 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789366677.034668:0:5804:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1789366677.034671:0:5804:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:3.0:1789366677.034674:0:5804:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:3.0:1789366677.034702:0:5804:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.123@tcp lock: ffff9638832d2600/0x8da3486b955f307d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0x8da3486b955f3084 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366677.034709:0:5804:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1789366677.034779:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9638aef25880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3283:1876286758788608:0@lo:39:umount.0 00010000:00010000:3.0:1789366677.034784:0:5804:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.123@tcp lock: ffff9638832d2600/0x8da3486b955f307d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0x8da3486b955f3084 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366677.034795:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.123@tcp lock: ffff9638832d2600/0x8da3486b955f307d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0x8da3486b955f3084 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789366677.034805:0:3287:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00010000:00010000:3.0:1789366677.034809:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789366677.034813:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789366677.034816:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789366677.034820:0:3287:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9638b6d55500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8cde4528-5832-4854-a387-4adacc3dd0ab:3287:1876286758788736:0@lo:103:ldlm_bl.0 00000400:00000100:1.0:1789366677.034849:0:3283:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1876286758788608 offset 0 length 224: 4 00000100:00100000:0.0:1789366677.034871:0:3287:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789366677.034952:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286758788736 00000100:00100000:3.0:1789366677.034965:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286758788736 00000100:00100000:3.0:1789366677.035020:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1789366677.035028:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963787499f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0+-99:3287:x1876286758788736:12345-0@lo:103:ldlm_bl.0 00010000:00020000:3.0:1789366677.035035:0:5802:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1789366677 with bad export cookie 10206080807456419188 00000100:00100000:3.0:1789366677.040496:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963787499f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0+-99:3287:x1876286758788736:12345-0@lo:103:ldlm_bl.0 Request processed in 5457us (5616us total) trans 0 rc -107/-107 00000100:00100000:3.0:1789366677.040510:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00080000:2.0:1789366677.040607:0:3287:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.202.123@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:2.0:1789366677.040613:0:3287:0:(import.c:65:import_set_state_nolock()) ffff963882f30000 MGS: changing import state from FULL to DISCONN 00000100:02020000:2.0:1789366677.040617:0:3287:0:(import.c:186:ptlrpc_set_import_discon()) MGC192.168.202.123@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail 00000100:00080000:2.0:1789366677.047712:0:3287:0:(import.c:192:ptlrpc_set_import_discon()) import MGS@0@lo for MGC192.168.202.123@tcp not replayable, auto-deactivating 00000100:00080000:2.0:1789366677.047759:0:3287:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:2.0:1789366677.047771:0:3287:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9638b6d55500 x1876286758788736/t0(0) o103->MGC192.168.202.123@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1789366693 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 10000000:01000000:2.0:1789366677.047785:0:3287:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:2.0:1789366677.047788:0:3287:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:2.0:1789366677.047790:0:3287:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:2.0:1789366677.047794:0:3287:0:(import.c:65:import_set_state_nolock()) ffff963882f30000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1789366677.047799:0:3287:0:(import.c:545:import_select_connection()) MGC192.168.202.123@tcp: connect to NID 0@lo last attempt 93 00000100:00080000:2.0:1789366677.047814:0:3287:0:(import.c:666:import_select_connection()) MGC192.168.202.123@tcp: import ffff963882f30000 using connection 192.168.202.123@tcp/0@lo 00000100:00100000:2.0:1789366677.047872:0:3287:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9638aef27b80 x1876286758788864/t0(0) o250->MGC192.168.202.123@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1789366677.047930:0:3287:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9638b6d55500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8cde4528-5832-4854-a387-4adacc3dd0ab:3287:1876286758788736:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789366677.047945:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9638aef27b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8cde4528-5832-4854-a387-4adacc3dd0ab:3283:1876286758788864:0@lo:250:ptlrpcd_00_03.0 00000400:00000100:1.0:1789366677.048006:0:3283:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1876286758788864 offset 0 length 520: 4 00010000:00010000:3.0:1789366677.559896:0:6675:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1789366678.456364:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8cde4528-5832-4854-a387-4adacc3dd0ab->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1789366678.456375:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) 8cde4528-5832-4854-a387-4adacc3dd0ab->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1789366678.456528:0:3287:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96388327ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3287:1876286758788992:0@lo:400:kworker.0 00000400:00000100:2.0:1789366678.456589:0:3287:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1876286758788992 offset 0 length 224: 4 00010000:00010000:2.0:1789366678.584371:0:5805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1789366679.517665:0:6685:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1789366679.517673:0:6685:0:(genops.c:885:class_export_put()) final put ffff963784ba6000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1789366679.517914:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff963784ba6000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000020:00000080:1.0:1789366679.518099:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff963784ba1000 for lustre-OST0000 00010000:00010000:3.0:1789366679.609077:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789366680.632133:0:6675:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789366681.656533:0:5805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1789366682.489217:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8cde4528-5832-4854-a387-4adacc3dd0ab->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1789366682.489226:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) 8cde4528-5832-4854-a387-4adacc3dd0ab->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1789366682.489362:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9638aef26d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3284:1876286758789120:0@lo:400:kworker.0 00000400:00000100:1.0:1789366682.489417:0:3284:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1876286758789120 offset 0 length 224: 4 00010000:00010000:3.0:1789366682.679887:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789366683.710437:0:6675:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789366684.729151:0:5805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789366685.751929:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789366686.775857:0:6675:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1789366687.671788:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8cde4528-5832-4854-a387-4adacc3dd0ab->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1789366687.671799:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) 8cde4528-5832-4854-a387-4adacc3dd0ab->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1789366687.671799:0:3283:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789366677/real 1789366677] req@ffff9638aef27b80 x1876286758788864/t0(0) o250->MGC192.168.202.123@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1789366687 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'ptlrpcd_00_03.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789366687.671830:0:3283:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9638aef27b80 x1876286758788864/t0(0) o250->MGC192.168.202.123@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1789366687 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'ptlrpcd_00_03.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789366687.671840:0:3283:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789366677/real 1789366677] req@ffff9638aef25880 x1876286758788608/t0(0) o39->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1789366687 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789366687.671851:0:3283:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9638aef25880 x1876286758788608/t0(0) o39->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1789366687 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1789366687.671868:0:3283:0:(import.c:65:import_set_state_nolock()) ffff963882f30000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1789366687.671882:0:3283:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110) 00000100:00100000:1.0:1789366687.671886:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9638aef27b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8cde4528-5832-4854-a387-4adacc3dd0ab:3283:1876286758788864:0@lo:250:ptlrpcd_00_03.0 00000100:00080000:1.0:1789366687.671894:0:3283:0:(import.c:65:import_set_state_nolock()) ffff9638ba2ec800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:0.0:1789366687.671932:0:3284:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789366687.671937:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9638aef25880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3283:1876286758788608:0@lo:39:umount.0 00000100:00080000:2.0:1789366687.671960:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8cde4528-5832-4854-a387-4adacc3dd0ab->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1789366687.671963:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:2.0:1789366687.671967:0:8:0:(import.c:65:import_set_state_nolock()) ffff963882f30000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1789366687.671973:0:8:0:(import.c:545:import_select_connection()) MGC192.168.202.123@tcp: connect to NID 0@lo last attempt 252 00000100:00080000:2.0:1789366687.671979:0:8:0:(import.c:630:import_select_connection()) MGC192.168.202.123@tcp: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1789366687.671995:0:8:0:(import.c:666:import_select_connection()) MGC192.168.202.123@tcp: import ffff963882f30000 using connection 192.168.202.123@tcp/0@lo 00000100:00100000:2.0:1789366687.672017:0:8:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9638aef27100 x1876286758789376/t0(0) o250->MGC192.168.202.123@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1789366687.672050:0:13120:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1789366687.672056:0:13120:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:2.0:1789366687.672062:0:13120:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00100000:1.0:1789366687.672181:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9638aef27100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8cde4528-5832-4854-a387-4adacc3dd0ab:3283:1876286758789376:0@lo:250:kworker.0 00000400:00000100:1.0:1789366687.672233:0:3283:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1876286758789376 offset 0 length 520: 4 00010000:00010000:2.0:1789366687.673078:0:13120:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.123@tcp lock: ffff9638827f7600/0x8da3486b955f308b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x8da3486b955f3092 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366687.673099:0:13120:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.123@tcp lock: ffff9638827f7600/0x8da3486b955f308b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x8da3486b955f3092 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366687.673106:0:13120:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.123@tcp lock: ffff9638827f7600/0x8da3486b955f308b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x8da3486b955f3092 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366687.673113:0:13120:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.123@tcp lock: ffff9638827f7600/0x8da3486b955f308b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x8da3486b955f3092 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366687.673140:0:13120:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789366687.673148:0:13120:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.123@tcp lock: ffff9638832d3e00/0x8da3486b955f32b4 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8da3486b955f32bb expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366687.673155:0:13120:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.123@tcp lock: ffff9638832d3e00/0x8da3486b955f32b4 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x8da3486b955f32bb expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366687.673161:0:13120:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.123@tcp lock: ffff9638832d3e00/0x8da3486b955f32b4 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x8da3486b955f32bb expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366687.673167:0:13120:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.123@tcp lock: ffff9638832d3e00/0x8da3486b955f32b4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x8da3486b955f32bb expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366687.673187:0:13120:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:2.0:1789366687.673192:0:13120:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0000 (0) 00000020:01000004:2.0:1789366687.673212:0:13120:0:(tgt_mount.c:2115:server_put_super()) stopping lustre-OST0000 00000020:01000000:2.0:1789366687.673217:0:13120:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000 (flags='F') 00000020:00000080:2.0:1789366687.673221:0:13120:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1789366687.673226:0:13120:0:(obd_config.c:956:class_cleanup()) lustre-OST0000: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1789366687.673230:0:13120:0:(genops.c:1558:class_disconnect_exports()) OBD device 11 (ffff9638bfe78000) has no exports 00000020:00080000:2.0:1789366687.673257:0:13120:0:(genops.c:1558:class_disconnect_exports()) OBD device 11 (ffff9638bfe78000) has no exports 00010000:00010000:1.0:1789366687.673361:0:5804:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1789366687.673368:0:5804:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.123@tcp lock: ffff9638827f7600/0x8da3486b955f308b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x8da3486b955f3092 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366687.673376:0:5804:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9638827f7600 already unused, calling callback (ffffffffc1cc7c20) 10000000:00010000:1.0:1789366687.673379:0:5804:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.123@tcp lock: ffff9638827f7600/0x8da3486b955f308b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x8da3486b955f3092 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366687.673388:0:5804:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.123@tcp lock: ffff9638827f7600/0x8da3486b955f308b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0x8da3486b955f3092 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789366687.673395:0:5804:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.123@tcp lock: ffff9638827f7600/0x8da3486b955f308b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0x8da3486b955f3092 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789366687.673401:0:5804:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1789366687.673403:0:5804:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0000: stopping, won't requeue 10000000:01000000:1.0:1789366687.673405:0:5804:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0000 00010000:00010000:1.0:1789366687.673418:0:5804:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff963882f30000 00010000:00010000:1.0:1789366687.673421:0:5804:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.123@tcp lock: ffff9638827f7600/0x8da3486b955f308b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0x8da3486b955f3092 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366687.673428:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.123@tcp lock: ffff9638827f7600/0x8da3486b955f308b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0x8da3486b955f3092 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366687.673447:0:5804:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789366687.673450:0:5804:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.123@tcp lock: ffff9638832d3e00/0x8da3486b955f32b4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x8da3486b955f32bb expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366687.673455:0:5804:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9638832d3e00 already unused, calling callback (ffffffffc1cc7c20) 10000000:00010000:1.0:1789366687.673458:0:5804:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.123@tcp lock: ffff9638832d3e00/0x8da3486b955f32b4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x8da3486b955f32bb expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366687.673471:0:5804:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.123@tcp lock: ffff9638832d3e00/0x8da3486b955f32b4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x8da3486b955f32bb expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789366687.673609:0:5804:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.123@tcp lock: ffff9638832d3e00/0x8da3486b955f32b4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x8da3486b955f32bb expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789366687.673615:0:5804:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:1.0:1789366687.673617:0:5804:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:1.0:1789366687.673619:0:5804:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:1.0:1789366687.673625:0:5804:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff963882f30000 00010000:00010000:1.0:1789366687.673697:0:5804:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.123@tcp lock: ffff9638832d3e00/0x8da3486b955f32b4 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x8da3486b955f32bb expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366687.673704:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.123@tcp lock: ffff9638832d3e00/0x8da3486b955f32b4 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x8da3486b955f32bb expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366687.673714:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789366687.673715:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789366687.673761:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789366687.674682:0:5805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789366687.675794:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9638aef24e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3284:1876286758789248:0@lo:400:kworker.0 00000400:00000100:0.0:1789366687.675862:0:3284:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1876286758789248 offset 0 length 224: 4 00000020:01000000:2.0:1789366687.676557:0:13120:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff963882eac540 - data ffff963784f05510/ffff9637853ff800 00000020:01000000:2.0:1789366687.676782:0:13120:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9638987962a0 - data ffff9638bb38a870/ffff9638b6e92400 00100000:10000000:2.0:1789366687.686406:0:13120:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0000-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:1.0:1789366687.719013:0:13120:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x8da3486b955f2e8c 00000020:00000080:1.0:1789366687.719027:0:13120:0:(genops.c:885:class_export_put()) final put ffff963785032000/lustre-OST0000-osd_UUID 00000020:01000004:1.0:1789366687.719044:0:13120:0:(tgt_mount.c:187:server_put_mount()) put mount ffff963885b46000 from lustre-OST0000, refs=2 00000020:01000004:1.0:1789366687.719048:0:13120:0:(obd_mount.c:710:lustre_put_lsi()) put ffff963885b46000 2 00000020:01000004:1.0:1789366687.719052:0:13120:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff963885b46000 from lustre-OST0000 00000020:00000080:1.0:1789366687.719140:0:13120:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1789366687.719152:0:13120:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:00000080:1.0:1789366687.719311:0:13120:0:(genops.c:885:class_export_put()) final put ffff963784bbc000/lustre-OST0000_UUID 00000020:00000080:1.0:1789366687.719314:0:13120:0:(genops.c:844:class_export_destroy()) destroying export ffff963784bbc000/lustre-OST0000_UUID for lustre-OST0000 00000020:01000000:1.0:1789366687.719323:0:13120:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000 (lustre-OST0000_UUID) 00000020:00000080:0.0:1789366687.719386:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff963785032000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:01000004:1.0:1789366687.719461:0:13120:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 1 references. 00000020:01000000:1.0:1789366687.719472:0:13120:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0000 (flags='F') 00000020:00000080:1.0:1789366687.719537:0:13120:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1789366687.719544:0:13120:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1789366687.719551:0:13120:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-OST0000: ACTIVE ffff963784ba7800 lustre-MDT0000-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1789366687.719557:0:13120:0:(genops.c:1553:class_disconnect_exports()) OBD device 12 (ffff9638986a4d40) has exports, disconnecting them 00000020:00080000:1.0:1789366687.719562:0:13120:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0000: disconnecting export at 0@lo (ffff963784ba7800), last request at 1789366524 00000020:00000080:1.0:1789366687.719567:0:13120:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x8da3486b955f2eb6 00000020:00080000:1.0:1789366687.719577:0:13120:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff963784ba7800): rc 0 00000020:00000080:1.0:1789366687.719582:0:13120:0:(genops.c:885:class_export_put()) final put ffff963784ba7800/lustre-MDT0000-lwp-OST0000 00000020:00000080:0.0:1789366687.720352:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff963784ba7800/lustre-MDT0000-lwp-OST0000 for lustre-MDT0000-lwp-OST0000 00010000:01000000:0.0:1789366687.739804:0:13120:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0000: client import never connected 00000100:00080000:0.0:1789366687.739813:0:13120:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1789366687.739818:0:13120:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:0.0:1789366687.739825:0:13120:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1789366687.739870:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9638ba2ec800 for lustre-MDT0000-lwp-OST0000 00000020:00000080:0.0:1789366687.740042:0:13120:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789366687.740052:0:13120:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000020:00000080:0.0:1789366687.740058:0:13120:0:(genops.c:885:class_export_put()) final put ffff963784ba2800/lustre-MDT0000-lwp-OST0000_UUID 00000020:00000080:0.0:1789366687.740062:0:13120:0:(genops.c:844:class_export_destroy()) destroying export ffff963784ba2800/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000-lwp-OST0000 00000020:01000000:0.0:1789366687.740069:0:13120:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0000 (lustre-MDT0000-lwp-OST0000_UUID) 00000020:01000004:0.0:1789366687.740140:0:13120:0:(obd_mount.c:710:lustre_put_lsi()) put ffff963885b46000 1 00000020:00000080:0.0:1789366687.740148:0:13120:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x8da3486b955f2e46 00000020:00000080:0.0:1789366687.740156:0:13120:0:(genops.c:885:class_export_put()) final put ffff9638ba2ec000/lustre-OST0000-osd_UUID 00000020:01000000:0.0:1789366687.740168:0:13120:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osd (flags='') 00000020:00000080:0.0:1789366687.740174:0:13120:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789366687.740178:0:13120:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1789366687.740182:0:13120:0:(genops.c:1558:class_disconnect_exports()) OBD device 9 (ffff9638986a3380) has no exports 00000020:00000080:2.0:1789366687.740187:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9638ba2ec000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:2.0:1789366687.764386:0:13120:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1789366687.764400:0:13120:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00000020:00000080:2.0:1789366687.764405:0:13120:0:(genops.c:885:class_export_put()) final put ffff963885b45800/lustre-OST0000-osd_UUID 00000020:00000080:2.0:1789366687.764409:0:13120:0:(genops.c:844:class_export_destroy()) destroying export ffff963885b45800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:01000000:2.0:1789366687.764419:0:13120:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osd (lustre-OST0000-osd_UUID) 00000020:01000004:2.0:1789366687.764595:0:13120:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff963885b46800 00000020:02000400:2.0:1789366687.764666:0:13120:0:(tgt_mount.c:2184:server_put_super()) server umount lustre-OST0000 complete 00010000:00010000:2.0:1789366687.800326:0:6675:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789366688.824006:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1789366689.575371:0:13275:0:(tgt_mount.c:2195:server_umount_begin()) umount -f 00000020:01000004:1.0:1789366689.587844:0:13275:0:(tgt_mount.c:2065:server_put_super()) server put_super lustre-OST0001 00010000:00010000:1.0:1789366689.587920:0:13275:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.123@tcp lock: ffff9638832d2c00/0x8da3486b955f3061 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x8da3486b955f3068 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366689.587934:0:13275:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.123@tcp lock: ffff9638832d2c00/0x8da3486b955f3061 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x8da3486b955f3068 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366689.587941:0:13275:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.123@tcp lock: ffff9638832d2c00/0x8da3486b955f3061 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x8da3486b955f3068 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366689.587948:0:13275:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.123@tcp lock: ffff9638832d2c00/0x8da3486b955f3061 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x8da3486b955f3068 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366689.588009:0:13275:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1789366689.588017:0:13275:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:1.0:1789366689.588039:0:13275:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1789366689.588054:0:13275:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff96388327ed80 x1876286758788992/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789366694 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789366689.588073:0:13275:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9638aef26d80 x1876286758789120/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789366698 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789366689.588108:0:13275:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9638aef24e00 x1876286758789248/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789366703 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789366689.588116:0:13275:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00080000:1.0:1789366689.588123:0:13275:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1789366689.588148:0:13275:0:(import.c:65:import_set_state_nolock()) ffff963883576800 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00000100:00100000:2.0:1789366689.588155:0:3287:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96388327ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3287:1876286758788992:0@lo:400:kworker.0 00000100:00100000:1.0:1789366689.588184:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96388327ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3283:1876286758789504:0@lo:39:umount.0 00000400:00000100:1.0:1789366689.588227:0:3283:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1876286758789504 offset 0 length 224: 4 00010000:00010000:3.0:1789366689.588308:0:5805:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789366689.588316:0:5805:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.123@tcp lock: ffff9638832d2c00/0x8da3486b955f3061 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x8da3486b955f3068 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366689.588323:0:5805:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9638832d2c00 already unused, calling callback (ffffffffc1cc7c20) 10000000:00010000:3.0:1789366689.588333:0:5805:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.123@tcp lock: ffff9638832d2c00/0x8da3486b955f3061 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x8da3486b955f3068 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366689.588343:0:5805:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.123@tcp lock: ffff9638832d2c00/0x8da3486b955f3061 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x8da3486b955f3068 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789366689.588350:0:5805:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.123@tcp lock: ffff9638832d2c00/0x8da3486b955f3061 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x8da3486b955f3068 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789366689.588356:0:5805:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1789366689.588358:0:5805:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:3.0:1789366689.588361:0:5805:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:3.0:1789366689.588373:0:5805:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff963882f30000 00000100:00100000:0.0:1789366689.588373:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9638aef24e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3284:1876286758789248:0@lo:400:kworker.0 00010000:00010000:3.0:1789366689.588377:0:5805:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.123@tcp lock: ffff9638832d2c00/0x8da3486b955f3061 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x8da3486b955f3068 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789366689.588381:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9638aef26d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3284:1876286758789120:0@lo:400:kworker.0 00010000:00010000:3.0:1789366689.588384:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.123@tcp lock: ffff9638832d2c00/0x8da3486b955f3061 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x8da3486b955f3068 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366689.588394:0:5805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789366689.588396:0:5805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789366689.588398:0:5805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789366689.849443:0:6675:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789366690.871923:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789366691.895937:0:5805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1789366692.792297:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8cde4528-5832-4854-a387-4adacc3dd0ab->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1789366692.792307:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) 8cde4528-5832-4854-a387-4adacc3dd0ab->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00010000:00010000:2.0:1789366692.921308:0:6675:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789366693.949181:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789366694.967871:0:5805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789366695.992010:0:6675:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789366697.016003:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1789366697.913258:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8cde4528-5832-4854-a387-4adacc3dd0ab->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1789366697.913272:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) 8cde4528-5832-4854-a387-4adacc3dd0ab->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00010000:00010000:3.0:1789366698.039950:0:5805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789366699.064785:0:6675:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789366699.768432:0:3283:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789366689/real 1789366689] req@ffff96388327ea00 x1876286758789504/t0(0) o39->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1789366699 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789366699.768476:0:3283:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff96388327ea00 x1876286758789504/t0(0) o39->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1789366699 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1789366699.768500:0:3283:0:(import.c:65:import_set_state_nolock()) ffff963883576800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:1.0:1789366699.768848:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96388327ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3283:1876286758789504:0@lo:39:umount.0 00000100:00080000:3.0:1789366699.769624:0:13275:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1789366699.769631:0:13275:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:3.0:1789366699.769709:0:13275:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:3.0:1789366699.773198:0:13275:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.123@tcp lock: ffff9638a0741600/0x8da3486b955f306f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8da3486b955f3076 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366699.773326:0:13275:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.123@tcp lock: ffff9638a0741600/0x8da3486b955f306f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x8da3486b955f3076 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366699.773335:0:13275:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.123@tcp lock: ffff9638a0741600/0x8da3486b955f306f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x8da3486b955f3076 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366699.773343:0:13275:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.123@tcp lock: ffff9638a0741600/0x8da3486b955f306f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x8da3486b955f3076 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366699.773465:0:13275:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789366699.773476:0:13275:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.123@tcp lock: ffff9638b6ce2c00/0x8da3486b955f32a6 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8da3486b955f32ad expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366699.773484:0:13275:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.123@tcp lock: ffff9638b6ce2c00/0x8da3486b955f32a6 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x8da3486b955f32ad expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366699.773491:0:13275:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.123@tcp lock: ffff9638b6ce2c00/0x8da3486b955f32a6 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x8da3486b955f32ad expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366699.773498:0:13275:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.123@tcp lock: ffff9638b6ce2c00/0x8da3486b955f32a6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x8da3486b955f32ad expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366699.774246:0:5804:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1789366699.774258:0:5804:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.123@tcp lock: ffff9638a0741600/0x8da3486b955f306f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x8da3486b955f3076 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366699.774269:0:5804:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9638a0741600 already unused, calling callback (ffffffffc1cc7c20) 10000000:00010000:1.0:1789366699.774273:0:5804:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.123@tcp lock: ffff9638a0741600/0x8da3486b955f306f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x8da3486b955f3076 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366699.774282:0:5804:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.123@tcp lock: ffff9638a0741600/0x8da3486b955f306f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x8da3486b955f3076 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789366699.774312:0:5804:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.123@tcp lock: ffff9638a0741600/0x8da3486b955f306f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x8da3486b955f3076 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789366699.774319:0:5804:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1789366699.774321:0:5804:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0001: stopping, won't requeue 00010000:00010000:1.0:1789366699.774337:0:5804:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff963882f30000 00010000:00010000:1.0:1789366699.774341:0:5804:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.123@tcp lock: ffff9638a0741600/0x8da3486b955f306f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x8da3486b955f3076 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366699.774348:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.123@tcp lock: ffff9638a0741600/0x8da3486b955f306f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x8da3486b955f3076 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366699.774371:0:5804:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789366699.774375:0:5804:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.123@tcp lock: ffff9638b6ce2c00/0x8da3486b955f32a6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x8da3486b955f32ad expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366699.774381:0:5804:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9638b6ce2c00 already unused, calling callback (ffffffffc1cc7c20) 10000000:00010000:1.0:1789366699.774384:0:5804:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.123@tcp lock: ffff9638b6ce2c00/0x8da3486b955f32a6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x8da3486b955f32ad expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366699.774391:0:5804:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.123@tcp lock: ffff9638b6ce2c00/0x8da3486b955f32a6 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x8da3486b955f32ad expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789366699.774397:0:5804:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.123@tcp lock: ffff9638b6ce2c00/0x8da3486b955f32a6 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x8da3486b955f32ad expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789366699.774402:0:5804:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:1.0:1789366699.774404:0:5804:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 00010000:00010000:1.0:1789366699.774408:0:5804:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff963882f30000 00010000:00010000:1.0:1789366699.774417:0:5804:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.123@tcp lock: ffff9638b6ce2c00/0x8da3486b955f32a6 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x8da3486b955f32ad expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366699.774424:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789366699.774426:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789366699.774428:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789366699.775004:0:13275:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1789366699.775012:0:13275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.123@tcp lock: ffff9638b6ce2c00/0x8da3486b955f32a6 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x8da3486b955f32ad expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789366699.775031:0:13275:0:(mgc_request.c:130:config_log_put()) dropping config log params 10000000:01000000:3.0:1789366699.775046:0:13275:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0001 10000000:01000000:3.0:1789366699.775049:0:13275:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0001 (0) 00010000:00010000:2.0:1789366699.775358:0:5805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1789366699.775406:0:13275:0:(tgt_mount.c:2115:server_put_super()) stopping lustre-OST0001 00000020:01000000:3.0:1789366699.775411:0:13275:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001 (flags='F') 00000020:00000080:3.0:1789366699.775418:0:13275:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1789366699.775425:0:13275:0:(obd_config.c:956:class_cleanup()) lustre-OST0001: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1789366699.775431:0:13275:0:(genops.c:1558:class_disconnect_exports()) OBD device 15 (ffff963785d63380) has no exports 00000020:00080000:3.0:1789366699.775465:0:13275:0:(genops.c:1558:class_disconnect_exports()) OBD device 15 (ffff963785d63380) has no exports 00000020:01000000:3.0:1789366699.784562:0:13275:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff963882eacb40 - data ffff963889da7438/ffff9637853fc400 00000020:01000000:3.0:1789366699.784778:0:13275:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9638919a61e0 - data ffff9638aa699438/ffff9638b7015c00 00100000:10000000:3.0:1789366699.793688:0:13275:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0001-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:0.0:1789366699.821411:0:13275:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x8da3486b955f2f65 00000020:00000080:0.0:1789366699.821421:0:13275:0:(genops.c:885:class_export_put()) final put ffff96378672f800/lustre-OST0001-osd_UUID 00000020:01000004:0.0:1789366699.821438:0:13275:0:(tgt_mount.c:187:server_put_mount()) put mount ffff963883577000 from lustre-OST0001, refs=2 00000020:01000004:0.0:1789366699.821442:0:13275:0:(obd_mount.c:710:lustre_put_lsi()) put ffff963883577000 2 00000020:01000004:0.0:1789366699.821446:0:13275:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff963883577000 from lustre-OST0001 00000020:00000080:3.0:1789366699.821473:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff96378672f800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:00000080:0.0:1789366699.821496:0:13275:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789366699.821509:0:13275:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:00000080:0.0:1789366699.821513:0:13275:0:(genops.c:885:class_export_put()) final put ffff963883571800/lustre-OST0001_UUID 00000020:00000080:0.0:1789366699.821515:0:13275:0:(genops.c:844:class_export_destroy()) destroying export ffff963883571800/lustre-OST0001_UUID for lustre-OST0001 00000020:01000000:0.0:1789366699.821523:0:13275:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001 (lustre-OST0001_UUID) 00000100:00080000:0.0:1789366699.821652:0:13275:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import 8cde4528-5832-4854-a387-4adacc3dd0ab->MGS 00010000:00010000:0.0:1789366699.821671:0:13275:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.123@tcp lock: ffff9638827f7000/0x8da3486b955f2e69 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x8da3486b955f2e70 expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789366699.821685:0:13275:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.123@tcp lock: ffff9638827f7000/0x8da3486b955f2e69 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x8da3486b955f2e70 expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789366699.821692:0:13275:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 10000000:01000000:0.0:1789366699.821695:0:13275:0:(mgc_request.c:954:mgc_blocking_ast()) log nodemap: disconnecting, won't requeue 10000000:01000000:0.0:1789366699.821698:0:13275:0:(mgc_request.c:130:config_log_put()) dropping config log nodemap 00010000:00010000:0.0:1789366699.821713:0:13275:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff963882f30000 00010000:00010000:0.0:1789366699.821749:0:13275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.123@tcp lock: ffff9638827f7000/0x8da3486b955f2e69 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x8da3486b955f2e70 expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366699.821772:0:13275:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.123@tcp lock: ffff9638a0741400/0x8da3486b955f30b5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x8da3486b955f30bc expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789366699.821779:0:13275:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.123@tcp lock: ffff9638a0741400/0x8da3486b955f30b5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x8da3486b955f30bc expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789366699.821785:0:13275:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1789366699.821797:0:13275:0:(mgc_request.c:954:mgc_blocking_ast()) log lustre-s: disconnecting, won't requeue 10000000:01000000:0.0:1789366699.821799:0:13275:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-sptlrpc 00010000:00010000:0.0:1789366699.821810:0:13275:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff963882f30000 00010000:00010000:0.0:1789366699.821813:0:13275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.123@tcp lock: ffff9638a0741400/0x8da3486b955f30b5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x8da3486b955f30bc expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1789366699.821845:0:13275:0:(import.c:65:import_set_state_nolock()) ffff963882f30000 MGS: changing import state from CONNECTING to CLOSED 10000000:01000000:0.0:1789366699.821850:0:13275:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:0.0:1789366699.821853:0:13275:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:0.0:1789366699.821854:0:13275:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:0.0:1789366699.821858:0:13275:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:0.0:1789366699.822053:0:13275:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9638aef27100 x1876286758789376/t0(0) o250->MGC192.168.202.123@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 1789366702 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 10000000:01000000:0.0:1789366699.822086:0:13275:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:0.0:1789366699.822090:0:13275:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 4s for inflight to error out 00000100:00100000:1.0:1789366699.822111:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9638aef27100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8cde4528-5832-4854-a387-4adacc3dd0ab:3283:1876286758789376:0@lo:250:kworker.0 10000000:01000000:0.0:1789366699.822176:0:13275:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:0.0:1789366699.822184:0:13275:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x8da3486b955f2d66 00000020:00000080:0.0:1789366699.822189:0:13275:0:(genops.c:885:class_export_put()) final put ffff9638829e0000/8cde4528-5832-4854-a387-4adacc3dd0ab 00000020:01000000:0.0:1789366699.822210:0:13275:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGC192.168.202.123@tcp (flags='') 00000020:00000080:0.0:1789366699.822216:0:13275:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789366699.822222:0:13275:0:(obd_config.c:956:class_cleanup()) MGC192.168.202.123@tcp: forcing exports to disconnect: 0/3 00000020:00080000:0.0:1789366699.822227:0:13275:0:(genops.c:1558:class_disconnect_exports()) OBD device 2 (ffff963882f5cd40) has no exports 10000000:01000000:0.0:1789366699.822265:0:5813:0:(mgc_request.c:708:mgc_requeue_thread()) Ending requeue thread 10000000:01000000:0.0:1789366699.822319:0:13275:0:(obd_class.h:670:obd_cleanup_client_import()) MGC192.168.202.123@tcp: client import never connected 00000100:00080000:0.0:1789366699.822322:0:13275:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 10000000:01000000:0.0:1789366699.822324:0:13275:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:0.0:1789366699.822326:0:13275:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 10000000:01000000:0.0:1789366699.822328:0:13275:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:0.0:1789366699.822360:0:13275:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789366699.822364:0:13275:0:(obd_config.c:883:class_detach()) detach on obd MGC192.168.202.123@tcp (uuid 8cde4528-5832-4854-a387-4adacc3dd0ab) 00000020:01000000:0.0:1789366699.822368:0:13275:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0001 (flags='F') 00000020:00000080:0.0:1789366699.822371:0:13275:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789366699.822375:0:13275:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1789366699.822379:0:13275:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-OST0001: ACTIVE ffff9638b7022800 lustre-MDT0000-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1789366699.822383:0:13275:0:(genops.c:1553:class_disconnect_exports()) OBD device 16 (ffff9638b4f2cd40) has exports, disconnecting them 00000020:00080000:0.0:1789366699.822387:0:13275:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0001: disconnecting export at 0@lo (ffff9638b7022800), last request at 1789366531 00000020:00000080:0.0:1789366699.822398:0:13275:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x8da3486b955f2f8f 00000020:00080000:0.0:1789366699.822408:0:13275:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9638b7022800): rc 0 00000020:00000080:0.0:1789366699.822417:0:13275:0:(genops.c:885:class_export_put()) final put ffff9638b7022800/lustre-MDT0000-lwp-OST0001 00000020:00000080:3.0:1789366699.822577:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9638829e0000/8cde4528-5832-4854-a387-4adacc3dd0ab for MGC192.168.202.123@tcp 00000020:00000080:3.0:1789366699.822584:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9638b7022800/lustre-MDT0000-lwp-OST0001 for lustre-MDT0000-lwp-OST0001 00000020:00000080:3.0:1789366699.823743:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff963882f30000 for MGC192.168.202.123@tcp 00000020:00000080:3.0:1789366699.823753:0:37:0:(genops.c:885:class_export_put()) final put ffff963882f36800/8cde4528-5832-4854-a387-4adacc3dd0ab 00000020:00000080:3.0:1789366699.823756:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff963882f36800/8cde4528-5832-4854-a387-4adacc3dd0ab for MGC192.168.202.123@tcp 00000020:01000000:3.0:1789366699.823762:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGC192.168.202.123@tcp (8cde4528-5832-4854-a387-4adacc3dd0ab) 00010000:01000000:1.0:1789366699.824615:0:13275:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0001: client import never connected 00000100:00080000:1.0:1789366699.824621:0:13275:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1789366699.824625:0:13275:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:1.0:1789366699.824632:0:13275:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:3.0:1789366699.825235:0:6675:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-1 blwis in pool) 00010000:00010000:1.0:1789366699.825483:0:5804:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-2 blwis in pool) 00000020:00000080:1.0:1789366699.825843:0:13275:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1789366699.825852:0:13275:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000020:01000004:1.0:1789366699.825859:0:13275:0:(obd_mount.c:710:lustre_put_lsi()) put ffff963883577000 1 00000020:00000080:1.0:1789366699.825867:0:13275:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x8da3486b955f2f34 00000020:00000080:1.0:1789366699.825877:0:13275:0:(genops.c:885:class_export_put()) final put ffff963784ba7000/lustre-OST0001-osd_UUID 00000020:01000000:1.0:1789366699.825888:0:13275:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osd (flags='') 00000020:00000080:1.0:1789366699.825902:0:13275:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1789366699.825907:0:13275:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osd: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1789366699.825912:0:13275:0:(genops.c:1558:class_disconnect_exports()) OBD device 14 (ffff9638bfe799c0) has no exports 00010000:00010000:3.0:1789366699.826433:0:5805:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-3 blwis in pool) 00000100:00100000:1.0:1789366699.826691:0:6674:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_002: service thread [ffff9638895fe000:6674] 2 exiting: rc = 0 00000100:00100000:3.0:1789366699.826866:0:5800:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_001: service thread [ffff963887d05c00:5800] 1 exiting: rc = 0 00000100:00100000:3.0:1789366699.836113:0:5799:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_000: service thread [ffff963887d04600:5799] 0 exiting: rc = 1 00000100:00100000:1.0:1789366699.836531:0:37:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789366699.837474:0:5803:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_002: service thread [ffff963887d05600:5803] 2 exiting: rc = 0 00000100:00100000:1.0:1789366699.837674:0:8419:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_003: service thread [ffff963785ea2600:8419] 3 exiting: rc = 0 00000100:00100000:3.0:1789366699.837839:0:5802:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_001: service thread [ffff963887d05400:5802] 1 exiting: rc = 0 00000100:00100000:1.0:1789366699.838070:0:12970:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_004: service thread [ffff9637875f8200:12970] 4 exiting: rc = 0 00000020:00000080:3.0:1789366699.844260:0:13275:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1789366699.844284:0:13275:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00000100:00100000:1.0:1789366699.844947:0:5801:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_000: service thread [ffff963887d05000:5801] 0 exiting: rc = 1 00000100:00100000:3.0:1789366699.845088:0:37:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789366699.845097:0:37:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789366699.845104:0:37:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789366699.845125:0:37:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789366699.845131:0:37:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789366699.845136:0:37:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789366699.845143:0:37:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789366699.845149:0:37:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789366699.845156:0:37:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789366699.845162:0:37:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789366699.845168:0:37:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789366699.845174:0:37:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789366699.845179:0:37:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789366699.845185:0:37:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789366699.845191:0:37:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789366699.845198:0:37:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789366699.845261:0:37:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789366699.845266:0:37:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789366699.845272:0:37:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789366699.845277:0:37:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789366699.845283:0:37:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789366699.845290:0:37:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789366699.845296:0:37:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789366699.845302:0:37:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789366699.845309:0:37:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789366699.845320:0:37:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789366699.845328:0:37:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789366699.845334:0:37:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789366699.845339:0:37:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789366699.845345:0:37:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789366699.845350:0:37:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789366699.845356:0:37:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789366699.845360:0:37:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789366699.845365:0:37:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789366699.845372:0:37:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789366699.845377:0:37:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789366699.845382:0:37:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789366699.845387:0:37:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789366699.845399:0:37:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789366699.845406:0:37:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789366699.845412:0:37:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789366699.845416:0:37:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789366699.845421:0:37:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789366699.845427:0:37:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789366699.845432:0:37:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789366699.845443:0:37:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789366699.845448:0:37:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789366699.845453:0:37:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789366699.845457:0:37:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789366699.845462:0:37:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789366699.845466:0:37:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789366699.845472:0:37:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789366699.845477:0:37:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789366699.845482:0:37:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789366699.845487:0:37:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789366699.845492:0:37:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789366699.845498:0:37:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789366699.845512:0:37:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789366699.845572:0:37:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789366699.845577:0:37:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789366699.845583:0:37:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789366699.845588:0:37:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789366699.845592:0:37:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789366699.845596:0:37:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:3.0:1789366699.847102:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff963883576800 for lustre-MDT0000-lwp-OST0001 00000020:00000080:3.0:1789366699.847114:0:37:0:(genops.c:885:class_export_put()) final put ffff9638b7023000/lustre-MDT0000-lwp-OST0001_UUID 00000020:00000080:3.0:1789366699.847118:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9638b7023000/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000-lwp-OST0001 00000020:01000000:3.0:1789366699.847124:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0001 (lustre-MDT0000-lwp-OST0001_UUID) 00000020:00000080:3.0:1789366699.847161:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff963784ba7000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:00000080:3.0:1789366699.847165:0:37:0:(genops.c:885:class_export_put()) final put ffff963883572800/lustre-OST0001-osd_UUID 00000020:00000080:3.0:1789366699.847167:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff963883572800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:01000000:3.0:1789366699.847178:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osd (lustre-OST0001-osd_UUID) 00000020:01000004:1.0:1789366699.847626:0:13275:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff963883575000 00000020:01000000:1.0:1789366699.847659:0:13275:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of OSS (flags='F') 00000020:00000080:1.0:1789366699.847666:0:13275:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1789366699.847673:0:13275:0:(obd_config.c:956:class_cleanup()) OSS: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1789366699.847678:0:13275:0:(genops.c:1558:class_disconnect_exports()) OBD device 10 (ffff9638986a0000) has no exports 00000020:00000080:1.0:1789366699.847771:0:13275:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1789366699.847840:0:13275:0:(obd_config.c:883:class_detach()) detach on obd OSS (uuid OSS_uuid) 00000020:00000080:1.0:1789366699.847844:0:13275:0:(genops.c:885:class_export_put()) final put ffff9638ba2ee000/OSS_uuid 00000020:00000080:1.0:1789366699.847847:0:13275:0:(genops.c:844:class_export_destroy()) destroying export ffff9638ba2ee000/OSS_uuid for OSS 00000020:01000000:1.0:1789366699.847851:0:13275:0:(genops.c:441:class_free_dev()) finishing cleanup of obd OSS (OSS_uuid) 00000100:00100000:1.0:1789366699.847971:0:6661:0:(service.c:3183:ptlrpc_main()) ll_ost00_002: service thread [ffff9638bffde800:6661] 2 exiting: rc = 0 00000100:00100000:1.0:1789366699.848060:0:6660:0:(service.c:3183:ptlrpc_main()) ll_ost00_001: service thread [ffff9638aefd9400:6660] 1 exiting: rc = 0 00000100:00080000:3.0:1789366699.848276:0:5812:0:(pinger.c:548:ping_evictor_main()) Exiting Ping Evictor 00000100:00100000:3.0:1789366699.848384:0:6659:0:(service.c:3183:ptlrpc_main()) ll_ost00_000: service thread [ffff9638bffdec00:6659] 0 exiting: rc = 1 00000100:00100000:1.0:1789366699.852960:0:8065:0:(service.c:3183:ptlrpc_main()) ll_ost00_003: service thread [ffff9638aef9b000:8065] 3 exiting: rc = 0 00000100:00100000:3.0:1789366699.853301:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789366699.853314:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789366699.853322:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789366699.853328:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789366699.853333:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789366699.853339:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789366699.853345:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789366699.853354:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789366699.853386:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789366699.853401:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789366699.853406:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789366699.853411:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789366699.853417:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789366699.853422:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789366699.853427:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789366699.853431:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789366699.853436:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789366699.853441:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789366699.853446:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789366699.853451:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789366699.853455:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789366699.853459:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789366699.853463:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789366699.853468:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789366699.853474:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789366699.853478:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789366699.853483:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789366699.853488:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789366699.853493:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789366699.853498:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789366699.853510:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789366699.853564:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789366699.853584:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789366699.853589:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789366699.853594:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789366699.853599:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789366699.853604:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789366699.853610:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789366699.853615:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789366699.853620:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789366699.853627:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789366699.853632:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789366699.853637:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789366699.853642:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789366699.853647:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789366699.853652:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789366699.853656:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789366699.853661:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789366699.853667:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789366699.853671:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789366699.853676:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789366699.853681:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789366699.853687:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789366699.853694:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789366699.853699:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789366699.853707:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789366699.853712:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789366699.853759:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789366699.853766:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789366699.853771:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789366699.853777:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789366699.853902:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789366699.853908:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789366699.853915:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789366699.855750:0:7134:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_002: service thread [ffff963784b97a00:7134] 2 exiting: rc = 0 00000100:00100000:3.0:1789366699.855889:0:6663:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_001: service thread [ffff9638bffdf200:6663] 1 exiting: rc = 0 00000100:00100000:2.0:1789366699.856039:0:6662:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_000: service thread [ffff96388c48a600:6662] 0 exiting: rc = 1 00000100:00100000:3.0:1789366699.856198:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789366699.856213:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789366699.856230:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789366699.856236:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789366699.856241:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789366699.856246:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789366699.856251:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789366699.856256:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789366699.856262:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789366699.856268:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789366699.856273:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789366699.856279:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789366699.856284:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789366699.856290:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789366699.856296:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789366699.856302:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789366699.856308:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789366699.856314:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789366699.856323:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789366699.856332:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789366699.856339:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789366699.856344:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789366699.856350:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789366699.856355:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789366699.856360:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789366699.856365:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789366699.856369:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789366699.856377:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789366699.856382:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789366699.856387:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789366699.856393:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789366699.856398:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789366699.856401:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789366699.856406:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789366699.856412:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789366699.856417:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789366699.856422:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789366699.856433:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789366699.856439:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789366699.856444:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789366699.856451:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789366699.856456:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789366699.856461:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789366699.856467:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789366699.856472:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789366699.856477:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789366699.856483:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789366699.856487:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789366699.856492:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789366699.856497:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789366699.856510:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789366699.856742:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789366699.856749:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789366699.856754:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789366699.856759:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789366699.856765:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789366699.856769:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789366699.856774:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789366699.856843:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789366699.856850:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789366699.856855:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789366699.856860:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789366699.856865:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789366699.856870:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789366699.858596:0:6664:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_000: service thread [ffff963889951800:6664] 0 exiting: rc = 1 00000100:00100000:3.0:1789366699.859125:0:6665:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_001: service thread [ffff9638bf515000:6665] 1 exiting: rc = 0 00000100:00100000:0.0:1789366699.859434:0:6666:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_002: service thread [ffff9638a7294e00:6666] 2 exiting: rc = 0 00000100:00100000:3.0:1789366699.859608:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789366699.859615:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789366699.859620:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789366699.859624:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789366699.859629:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789366699.859634:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789366699.859648:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789366699.859664:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789366699.859669:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789366699.859674:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789366699.859680:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789366699.859685:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789366699.859692:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789366699.859696:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789366699.859701:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789366699.859706:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789366699.859710:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789366699.859715:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789366699.859749:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789366699.859756:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789366699.859761:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789366699.859768:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789366699.859774:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789366699.859939:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789366699.859948:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789366699.859954:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789366699.859961:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789366699.859968:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789366699.859975:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789366699.859982:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789366699.859988:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789366699.859995:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789366699.860001:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789366699.860008:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789366699.860015:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789366699.860022:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789366699.860027:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789366699.860033:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789366699.860038:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789366699.860042:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789366699.860047:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789366699.860051:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789366699.860062:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789366699.860066:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789366699.860070:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789366699.860075:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789366699.860080:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789366699.860093:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789366699.860097:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789366699.860101:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789366699.860105:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789366699.860110:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789366699.860114:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789366699.860118:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789366699.860123:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789366699.860127:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789366699.860131:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789366699.860135:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789366699.860140:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789366699.860144:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789366699.860148:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789366699.860152:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789366699.860157:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789366699.860161:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789366699.867769:0:6668:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_001: service thread [ffff9638a7295200:6668] 1 exiting: rc = 0 00000100:00100000:3.0:1789366699.868383:0:6667:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_000: service thread [ffff9638bf514200:6667] 0 exiting: rc = 1 00000100:00100000:2.0:1789366699.868513:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789366699.868522:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789366699.868528:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789366699.868533:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789366699.868538:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789366699.868543:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789366699.868549:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789366699.868556:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789366699.868562:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789366699.868567:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789366699.868590:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789366699.868595:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789366699.868600:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789366699.868603:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789366699.868608:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789366699.868611:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789366699.868614:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789366699.868618:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789366699.868621:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789366699.868625:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789366699.868629:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789366699.868632:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789366699.868636:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789366699.868638:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789366699.868642:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789366699.868645:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789366699.868649:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789366699.868653:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789366699.868657:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789366699.868660:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789366699.868663:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789366699.868666:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789366699.868669:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789366699.868672:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789366699.868675:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789366699.868679:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789366699.868682:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789366699.868685:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789366699.868688:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789366699.868691:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789366699.868694:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789366699.868698:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789366699.868702:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789366699.868706:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789366699.868709:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789366699.868756:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789366699.868762:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789366699.868768:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789366699.868773:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789366699.868779:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789366699.868785:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789366699.868799:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789366699.868805:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789366699.868811:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789366699.868817:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789366699.868823:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789366699.868829:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789366699.868835:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789366699.868841:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789366699.868846:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789366699.868852:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789366699.868857:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789366699.868863:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789366699.868879:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789366699.869632:0:6669:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_000: service thread [ffff9638bf514000:6669] 0 exiting: rc = 1 00000100:00100000:2.0:1789366699.869828:0:6670:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_001: service thread [ffff9638b7cb3000:6670] 1 exiting: rc = 0 00000100:00100000:0.0:1789366699.870144:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789366699.870156:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789366699.870164:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789366699.870170:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789366699.870177:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789366699.870184:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789366699.870312:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789366699.870323:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789366699.870329:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789366699.870336:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789366699.870358:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789366699.870367:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789366699.870374:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789366699.870385:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789366699.870395:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789366699.870401:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789366699.870408:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789366699.870414:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789366699.870424:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789366699.870430:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789366699.870436:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789366699.870442:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789366699.870469:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789366699.870481:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789366699.870490:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789366699.870505:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789366699.870512:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789366699.870529:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789366699.870536:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789366699.870550:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789366699.870557:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789366699.870563:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789366699.870570:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789366699.870578:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789366699.870597:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789366699.870604:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789366699.870610:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789366699.870615:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789366699.870623:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789366699.870629:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789366699.870636:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789366699.870643:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789366699.870650:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789366699.870656:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789366699.870663:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789366699.870671:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789366699.870687:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789366699.870695:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789366699.870701:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789366699.870708:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789366699.870713:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789366699.870738:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789366699.870745:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789366699.870753:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789366699.870761:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789366699.870768:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789366699.870794:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789366699.870805:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789366699.870826:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789366699.870833:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789366699.870839:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789366699.870846:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789366699.870853:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789366699.870860:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:02000400:1.0:1789366699.882674:0:13275:0:(tgt_mount.c:2184:server_put_super()) server umount lustre-OST0001 complete 00000001:02000400:3.0:1789366711.165444:0:13893:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg223-server.virtnet: executing load_modules_local 00000020:01000004:1.0:1789366716.523048:0:14352:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:1.0:1789366716.523054:0:14352:0:(obd_mount.c:926:lmd_print()) device: lustre-mdt1/mdt1 00000080:01200004:1.0:1789366716.523187:0:14352:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff963888959000 00000020:01000004:1.0:1789366716.523203:0:14352:0:(tgt_mount.c:2506:osd_start()) Attempting to start lustre-MDT0000, type=osd-zfs, lsifl=200005, mountfl=0 00000020:01000004:1.0:1789366716.523212:0:14352:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-zfs) 00000020:00000080:1.0:1789366716.523226:0:14352:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (ffff963882f599c0) 00000020:00000080:1.0:1789366716.523239:0:14352:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-zfs with refcount 2 00100000:10000000:2.0:1789366716.539253:0:14352:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:2.0:1789366716.542083:0:14352:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000003:0x11:0x0] (8/32) 00100000:10000000:2.0:1789366716.542633:0:14352:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-OST0000 under 339: rc = 0 00100000:10000000:2.0:1789366716.542843:0:14352:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-MDT0000 under 339: rc = 0 00100000:10000000:2.0:1789366716.543013:0:14352:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-OST0001 under 339: rc = 0 00100000:10000000:2.0:1789366716.543102:0:14352:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled params under 339: rc = 0 00100000:10000000:2.0:1789366716.543196:0:14352:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-client under 339: rc = 0 00100000:10000000:2.0:1789366716.543582:0:14352:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:2.0:1789366716.543667:0:14352:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled nodemap under 339: rc = 0 00100000:10000000:2.0:1789366716.544137:0:14352:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre under 341: rc = 0 00100000:10000000:2.0:1789366716.545445:0:14352:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled dt-0x0 under 483: rc = 0 00100000:10000000:2.0:1789366716.545630:0:14352:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled md-0x0 under 483: rc = 0 00100000:10000000:2.0:1789366716.546243:0:14352:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000 under 515: rc = 0 00100000:10000000:2.0:1789366716.546688:0:14352:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000-MDT0000 under 515: rc = 0 00100000:10000000:2.0:1789366716.547139:0:14352:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000 under 515: rc = 0 00100000:10000000:2.0:1789366716.547372:0:14352:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000-MDT0000 under 515: rc = 0 00100000:10000000:2.0:1789366716.547798:0:14352:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000 under 515: rc = 0 00100000:10000000:2.0:1789366716.548134:0:14352:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000-MDT0000 under 515: rc = 0 00100000:10000000:2.0:1789366716.548347:0:14352:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000 under 515: rc = 0 00100000:10000000:2.0:1789366716.548833:0:14352:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000 under 515: rc = 0 00100000:10000000:2.0:1789366716.549147:0:14352:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000-MDT0000 under 515: rc = 0 00100000:10000000:2.0:1789366716.549379:0:14352:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000-MDT0000 under 515: rc = 0 00100000:10000000:3.0:1789366716.550339:0:14352:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000-MDT0000 under 515: rc = 0 00100000:10000000:3.0:1789366716.550843:0:14352:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000 under 515: rc = 0 00100000:10000000:3.0:1789366716.551334:0:14352:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_11 under 534: rc = 0 00100000:10000000:3.0:1789366716.551834:0:14352:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_07 under 534: rc = 0 00100000:10000000:3.0:1789366716.552199:0:14352:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_08 under 534: rc = 0 00100000:10000000:3.0:1789366716.553116:0:14352:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_02 under 534: rc = 0 00100000:10000000:3.0:1789366716.553362:0:14352:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_14 under 534: rc = 0 00100000:10000000:3.0:1789366716.553835:0:14352:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_13 under 534: rc = 0 00100000:10000000:3.0:1789366716.554157:0:14352:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_05 under 534: rc = 0 00100000:10000000:3.0:1789366716.554399:0:14352:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_00 under 534: rc = 0 00100000:10000000:3.0:1789366716.554965:0:14352:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_04 under 534: rc = 0 00100000:10000000:3.0:1789366716.555232:0:14352:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_12 under 534: rc = 0 00100000:10000000:3.0:1789366716.555554:0:14352:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_01 under 534: rc = 0 00100000:10000000:3.0:1789366716.556041:0:14352:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_06 under 534: rc = 0 00100000:10000000:3.0:1789366716.556286:0:14352:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_10 under 534: rc = 0 00100000:10000000:3.0:1789366716.556596:0:14352:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_15 under 534: rc = 0 00100000:10000000:3.0:1789366716.557039:0:14352:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_03 under 534: rc = 0 00100000:10000000:3.0:1789366716.557276:0:14352:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_09 under 534: rc = 0 00100000:10000000:3.0:1789366716.557586:0:14352:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_01 under 534: rc = 0 00100000:10000000:3.0:1789366716.558050:0:14352:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_12 under 534: rc = 0 00100000:10000000:3.0:1789366716.558282:0:14352:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_04 under 534: rc = 0 00100000:10000000:3.0:1789366716.558669:0:14352:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_03 under 534: rc = 0 00100000:10000000:3.0:1789366716.559089:0:14352:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_09 under 534: rc = 0 00100000:10000000:3.0:1789366716.559351:0:14352:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_15 under 534: rc = 0 00100000:10000000:3.0:1789366716.559801:0:14352:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_10 under 534: rc = 0 00100000:10000000:3.0:1789366716.560124:0:14352:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_06 under 534: rc = 0 00100000:10000000:3.0:1789366716.560374:0:14352:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_14 under 534: rc = 0 00100000:10000000:3.0:1789366716.561063:0:14352:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_08 under 534: rc = 0 00100000:10000000:3.0:1789366716.561316:0:14352:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_02 under 534: rc = 0 00100000:10000000:3.0:1789366716.561651:0:14352:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_07 under 534: rc = 0 00100000:10000000:3.0:1789366716.562073:0:14352:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_11 under 534: rc = 0 00100000:10000000:3.0:1789366716.562335:0:14352:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_00 under 534: rc = 0 00100000:10000000:3.0:1789366716.562688:0:14352:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_05 under 534: rc = 0 00100000:10000000:3.0:1789366716.563157:0:14352:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_13 under 534: rc = 0 00100000:10000000:3.0:1789366716.563566:0:14352:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled [0x200000400:0x1:0x0] under 523: rc = 0 00100000:10000000:3.0:1789366716.564214:0:14352:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x2020000:0x0] (8/32) 00100000:10000000:3.0:1789366716.564375:0:14352:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000 under 488: rc = 0 00100000:10000000:3.0:1789366716.564633:0:14352:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x1020000:0x0] (8/32) 00100000:10000000:3.0:1789366716.564945:0:14352:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000 under 488: rc = 0 00100000:10000000:3.0:1789366716.565131:0:14352:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x20000:0x0] (8/32) 00100000:10000000:3.0:1789366716.565189:0:14352:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000 under 488: rc = 0 00100000:10000000:3.0:1789366716.565576:0:14352:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x1010000:0x0] (8/32) 00100000:10000000:3.0:1789366716.565657:0:14352:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000 under 484: rc = 0 00100000:10000000:3.0:1789366716.565980:0:14352:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x2010000:0x0] (8/32) 00100000:10000000:3.0:1789366716.566041:0:14352:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000 under 484: rc = 0 00100000:10000000:3.0:1789366716.566217:0:14352:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x10000:0x0] (8/32) 00100000:10000000:3.0:1789366716.566283:0:14352:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000 under 484: rc = 0 00000020:00000080:3.0:1789366716.566605:0:14352:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:3.0:1789366716.566615:0:14352:0:(osd_handler.c:1574:osd_obd_connect()) connect #0 00000020:00000080:3.0:1789366716.566626:0:14352:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x8da3486b955f4036 00000020:01000004:3.0:1789366716.566652:0:14352:0:(tgt_mount.c:2591:server_fill_super()) Found service lustre-MDT0000 on device lustre-mdt1/mdt1 00000020:01000000:3.0:1789366716.566658:0:14352:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:3.0:1789366716.566663:0:14352:0:(tgt_mount.c:101:server_register_mount()) register mount ffff963888959000 from MGS 00000020:01000004:3.0:1789366716.566666:0:14352:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:3.0:1789366716.566676:0:14352:0:(genops.c:413:class_newdev()) Allocate new device MGS (ffff963785d60000) 00000020:00000080:3.0:1789366716.566686:0:14352:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:3.0:1789366716.566958:0:14352:0:(tgt_mount.c:153:server_get_mount()) get mount ffff963888959000 from MGS, refs=2 00080000:01000000:3.0:1789366716.566964:0:14352:0:(osd_handler.c:1574:osd_obd_connect()) connect #1 00000020:00000080:3.0:1789366716.566970:0:14352:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x8da3486b955f4044 00000100:00100000:3.0:1789366716.567071:0:14352:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:3.0:1789366716.567203:0:14352:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:3.0:1789366716.567210:0:14352:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:3.0:1789366716.567937:0:14352:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:3.0:1789366716.567944:0:14352:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:2.0:1789366716.568660:0:14352:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789366716.569064:0:14352:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:2.0:1789366716.569070:0:14352:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:3.0:1789366716.569555:0:14352:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:3.0:1789366716.569562:0:14352:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:3.0:1789366716.570001:0:14352:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:3.0:1789366716.570008:0:14352:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:0.0:1789366716.571070:0:14358:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789366716.571074:0:14358:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789366716.571076:0:14358:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789366716.571338:0:14359:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789366716.571340:0:14359:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789366716.571342:0:14359:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789366716.572157:0:14352:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:1.0:1789366716.574611:0:14358:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:3.0:1789366716.582705:0:14352:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 20000000:01000000:3.0:1789366716.582930:0:14352:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:3.0:1789366716.582934:0:14352:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 10000000:01000000:3.0:1789366716.584417:0:14361:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:2.0:1789366716.584551:0:14352:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:2.0:1789366716.584647:0:14352:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:2.0:1789366716.585136:0:14352:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:2.0:1789366716.585506:0:14352:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789366716.588000:0:14352:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:2.0:1789366716.588027:0:14352:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:0.0:1789366716.590832:0:14352:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:0.0:1789366716.590846:0:14352:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:0.0:1789366716.592417:0:14352:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:0.0:1789366716.592427:0:14352:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:0.0:1789366716.593538:0:14352:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:0.0:1789366716.593560:0:14352:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.202.123@tcp' 00000020:01000004:0.0:1789366716.593562:0:14352:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:1.0:1789366716.593930:0:14352:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.202.123@tcp (typ=mgc) 00000020:00000080:1.0:1789366716.593941:0:14352:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.202.123@tcp (ffff963882f5b380) 00000020:00000080:1.0:1789366716.593954:0:14352:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:1.0:1789366716.594019:0:14352:0:(ldlm_lib.c:102:import_set_conn()) imp ffff963888958000@MGC192.168.202.123@tcp: add connection 192.168.202.123@tcp at head 00000100:00080000:3.0:1789366716.594034:0:14366:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 00010000:00010000:1.0:1789366716.594123:0:14352:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.202.123@tcp-0 is initialized 00000040:01000000:1.0:1789366716.594127:0:14352:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.123@tcp ctxt 1 is initialized 10000000:01000000:2.0:1789366716.594966:0:14367:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:1.0:1789366716.595031:0:14352:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.202.123@tcp (uuid 987e24be-cce8-4f54-8344-02fd27f3b2a2) 00000020:00000080:1.0:1789366716.595047:0:14352:0:(genops.c:1385:class_connect()) connect: client 987e24be-cce8-4f54-8344-02fd27f3b2a2, cookie 0x8da3486b955f4052 00000100:00080000:1.0:1789366716.595058:0:14352:0:(import.c:545:import_select_connection()) MGC192.168.202.123@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1789366716.595067:0:14352:0:(import.c:666:import_select_connection()) MGC192.168.202.123@tcp: import ffff963888958000 using connection 192.168.202.123@tcp/0@lo 00000100:00100000:1.0:1789366716.595100:0:14352:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff96388327ea00 x1876286758789632/t0(0) o250->MGC192.168.202.123@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1789366716.595134:0:14352:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import 987e24be-cce8-4f54-8344-02fd27f3b2a2->MGS 00000020:01000004:1.0:1789366716.595188:0:14352:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:1.0:1789366716.595194:0:14352:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:1.0:1789366716.595206:0:14352:0:(genops.c:413:class_newdev()) Allocate new device MDS (ffff963882f5cd40) 00000020:00000080:1.0:1789366716.595215:0:14352:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:0.0:1789366716.602791:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96388327ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:987e24be-cce8-4f54-8344-02fd27f3b2a2:3283:1876286758789632:0@lo:250:mount.lustre.0 00000100:00100000:0.0:1789366716.602868:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789366716.602963:0:14363:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286758789632 00000100:00100000:0.0:1789366716.602971:0:14363:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286758789632 00000100:00100000:0.0:1789366716.603008:0:14364:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789366716.603016:0:14364:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96388a049050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0+-99:3283:x1876286758789632:12345-0@lo:250:mount.lustre.0 00010000:00080000:0.0:1789366716.603040:0:14364:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from 987e24be-cce8-4f54-8344-02fd27f3b2a2@0@lo t0 exp 0000000000000000 cur 292 last 0 00000020:00000080:0.0:1789366716.603066:0:14364:0:(genops.c:1385:class_connect()) connect: client 987e24be-cce8-4f54-8344-02fd27f3b2a2, cookie 0x8da3486b955f4060 00000100:00080000:0.0:1789366716.603189:0:14364:0:(import.c:65:import_set_state_nolock()) ffff9638b704a800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789366716.603235:0:14364:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96388a049050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:987e24be-cce8-4f54-8344-02fd27f3b2a2+5:3283:x1876286758789632:12345-0@lo:250:mount.lustre.0 Request processed in 218us (368us total) trans 0 rc 0/0 00000100:00100000:0.0:1789366716.603242:0:14364:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789366716.603286:0:3283:0:(client.c:3126:ptlrpc_free_committed()) MGC192.168.202.123@tcp: committing for last_committed 0 gen 1 00000100:00080000:0.0:1789366716.603293:0:3283:0:(import.c:1177:ptlrpc_connect_interpret()) MGC192.168.202.123@tcp: connect to target with instance 0 00000100:00080000:0.0:1789366716.603301:0:3283:0:(import.c:1001:ptlrpc_connect_set_flags()) MGC192.168.202.123@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:0.0:1789366716.603306:0:3283:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:0.0:1789366716.603309:0:3283:0:(import.c:65:import_set_state_nolock()) ffff963888958000 MGS: changing import state from CONNECTING to FULL 10000000:01000000:0.0:1789366716.603317:0:3283:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:0.0:1789366716.603326:0:3283:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:0.0:1789366716.603332:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96388327ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:987e24be-cce8-4f54-8344-02fd27f3b2a2:3283:1876286758789632:0@lo:250:mount.lustre.0 00000100:00100000:1.0:1789366716.607652:0:14352:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1789366716.607947:0:14352:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:1.0:1789366716.607954:0:14352:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:1.0:1789366716.608451:0:14352:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:1.0:1789366716.608458:0:14352:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:1.0:1789366716.609265:0:14352:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:1.0:1789366716.609273:0:14352:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:1.0:1789366716.610103:0:14352:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1789366716.610259:0:14352:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:1.0:1789366716.610265:0:14352:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:1.0:1789366716.610878:0:14352:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:1.0:1789366716.610885:0:14352:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:1.0:1789366716.644440:0:14352:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1789366716.644845:0:14352:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:1.0:1789366716.644852:0:14352:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:1.0:1789366716.645917:0:14352:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:1.0:1789366716.645925:0:14352:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:1.0:1789366716.646377:0:14352:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1789366716.646584:0:14352:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:1.0:1789366716.646588:0:14352:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:1.0:1789366716.647034:0:14352:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:1.0:1789366716.647039:0:14352:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:3.0:1789366716.647454:0:14352:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1789366716.647600:0:14352:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:3.0:1789366716.647605:0:14352:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:3.0:1789366716.648144:0:14352:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:3.0:1789366716.648152:0:14352:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:3.0:1789366716.648684:0:14352:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1789366716.649002:0:14352:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:3.0:1789366716.649007:0:14352:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:3.0:1789366716.649335:0:14352:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:3.0:1789366716.649341:0:14352:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:3.0:1789366716.664162:0:14352:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1789366716.664373:0:14352:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:3.0:1789366716.664380:0:14352:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:3.0:1789366716.665763:0:14352:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:3.0:1789366716.665773:0:14352:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:3.0:1789366716.666594:0:14352:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:3.0:1789366716.666602:0:14352:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:3.0:1789366716.667619:0:14352:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:3.0:1789366716.667657:0:14352:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-mdt1/mdt1 10000000:01000000:3.0:1789366716.667664:0:14352:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.123@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:3.0:1789366716.668045:0:14352:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.123@tcp ctxt 0 is initialized 00000020:01000004:3.0:1789366716.668079:0:14352:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.202.123@tcp, index=0000, flags=0x20005 00000020:01000004:3.0:1789366716.668083:0:14352:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1789366716.668085:0:14352:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1789366716.668090:0:14352:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789366716.668092:0:14352:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789366716.668093:0:14352:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789366716.668094:0:14352:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789366716.668096:0:14352:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1789366716.668097:0:14352:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1789366716.668099:0:14352:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789366716.668100:0:14352:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1789366716.668102:0:14352:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020005 00000020:01000004:3.0:1789366716.668104:0:14352:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1789366716.668105:0:14352:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1789366716.668106:0:14352:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789366716.668107:0:14352:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789366716.668107:0:14352:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789366716.668108:0:14352:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789366716.668109:0:14352:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1789366716.668110:0:14352:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1789366716.668111:0:14352:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789366716.668112:0:14352:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1789366716.668138:0:14352:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:3.0:1789366716.668158:0:14352:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9638b6d56300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:987e24be-cce8-4f54-8344-02fd27f3b2a2:14352:1876286758789760:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1789366716.668226:0:14352:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789366716.668361:0:14352:0:(client.c:2716:ptlrpc_set_wait()) set ffff96388524b300 going to sleep for 11 seconds 00000100:00100000:2.0:1789366716.668423:0:14365:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286758789760 00000100:00100000:2.0:1789366716.668431:0:14365:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286758789760 00000100:00100000:2.0:1789366716.668467:0:14365:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789366716.668487:0:14365:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96388a04a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:987e24be-cce8-4f54-8344-02fd27f3b2a2+5:14352:x1876286758789760:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1789366716.668531:0:14365:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:2.0:1789366716.668535:0:14365:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:2.0:1789366716.668537:0:14365:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0000 is running on 0@lo 10000000:01000000:2.0:1789366716.669020:0:14386:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:3.0:1789366716.669329:0:14365:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 5 20000000:01000000:3.0:1789366716.670356:0:14387:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 0 20000000:01000000:3.0:1789366716.670362:0:14387:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0000_UUID is 0 (0) 20000000:01000000:3.0:1789366716.670365:0:14387:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0001_UUID is 1 (1) 00000040:00080000:3.0:1789366716.670401:0:14387:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 20000000:01000000:2.0:1789366716.670676:0:14365:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:2.0:1789366716.670685:0:14365:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:1.0:1789366716.678308:0:14365:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96388a04a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:987e24be-cce8-4f54-8344-02fd27f3b2a2+5:14352:x1876286758789760:12345-0@lo:253:mount.lustre.0 Request processed in 9824us (10071us total) trans 0 rc 0/0 00000100:00100000:1.0:1789366716.678327:0:14365:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789366716.678466:0:14352:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9638b6d56300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:987e24be-cce8-4f54-8344-02fd27f3b2a2:14352:1876286758789760:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1789366716.678550:0:14352:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:3.0:1789366716.678554:0:14352:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1789366716.678556:0:14352:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1789366716.678557:0:14352:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789366716.678559:0:14352:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789366716.678560:0:14352:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789366716.678561:0:14352:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789366716.678563:0:14352:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1789366716.678578:0:14352:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1789366716.678580:0:14352:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789366716.678581:0:14352:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1789366716.678599:0:14352:0:(tgt_mount.c:101:server_register_mount()) register mount ffff963888959000 from lustre-MDT0000 10000000:01000000:3.0:1789366716.678628:0:14352:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:3.0:1789366716.678630:0:14352:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:3.0:1789366716.678647:0:14352:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff963882f5b380 10000000:01000000:3.0:1789366716.678653:0:14352:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1789366716.678660:0:14352:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff963882f5b380 from 1 10000000:01000000:3.0:1789366716.678664:0:14352:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1789366716.678702:0:14352:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.123@tcp lock: ffff9638832d2600/0x8da3486b955f4067 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366716.678713:0:14352:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.123@tcp lock: ffff9638832d2600/0x8da3486b955f4067 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366716.678963:0:14352:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.123@tcp lock: ffff9638832d2600/0x8da3486b955f4067 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789366716.678985:0:14352:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9638b6d56300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:987e24be-cce8-4f54-8344-02fd27f3b2a2:14352:1876286758789888:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1789366716.679025:0:14352:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789366716.679077:0:14352:0:(client.c:2716:ptlrpc_set_wait()) set ffff96388524b240 going to sleep for 11 seconds 00000100:00100000:0.0:1789366716.679127:0:14363:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286758789888 00000100:00100000:0.0:1789366716.679133:0:14363:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286758789888 00000100:00100000:0.0:1789366716.679173:0:14363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1789366716.679182:0:14363:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96388a048050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:987e24be-cce8-4f54-8344-02fd27f3b2a2+5:14352:x1876286758789888:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789366716.679193:0:14363:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789366716.679206:0:14363:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9638b720c200/0x8da3486b955f406e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x8da3486b955f4067 expref: -99 pid: 14363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366716.679226:0:14363:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9638b720c200/0x8da3486b955f406e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8da3486b955f4067 expref: 6 pid: 14363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366716.679235:0:14363:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9638b720c200/0x8da3486b955f406e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8da3486b955f4067 expref: 6 pid: 14363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366716.679244:0:14363:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9638b720c200, rc 0) 00000100:00100000:0.0:1789366716.679279:0:14363:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96388a048050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:987e24be-cce8-4f54-8344-02fd27f3b2a2+6:14352:x1876286758789888:12345-0@lo:101:mount.lustre.0 Request processed in 98us (254us total) trans 0 rc 0/0 00000100:00100000:0.0:1789366716.679284:0:14363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789366716.679398:0:14352:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9638b6d56300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:987e24be-cce8-4f54-8344-02fd27f3b2a2:14352:1876286758789888:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789366716.679420:0:14352:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.123@tcp lock: ffff9638832d2600/0x8da3486b955f4067 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8da3486b955f406e expref: -99 pid: 14352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366716.679429:0:14352:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.123@tcp lock: ffff9638832d2600/0x8da3486b955f4067 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x8da3486b955f406e expref: -99 pid: 14352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789366716.679545:0:14352:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96388327f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:987e24be-cce8-4f54-8344-02fd27f3b2a2:14352:1876286758790016:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789366716.679575:0:14352:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789366716.679592:0:14352:0:(client.c:2716:ptlrpc_set_wait()) set ffff9638bf0cd6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789366716.679605:0:14365:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286758790016 00000100:00100000:1.0:1789366716.679609:0:14365:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286758790016 00000100:00100000:1.0:1789366716.679652:0:14365:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789366716.679660:0:14365:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96388a04b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:987e24be-cce8-4f54-8344-02fd27f3b2a2+6:14352:x1876286758790016:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789366716.680058:0:14365:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96388a04b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:987e24be-cce8-4f54-8344-02fd27f3b2a2+6:14352:x1876286758790016:12345-0@lo:501:mount.lustre.0 Request processed in 399us (481us total) trans 0 rc -2/-2 00000100:00100000:1.0:1789366716.680066:0:14365:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1789366716.680249:0:14352:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96388327f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:987e24be-cce8-4f54-8344-02fd27f3b2a2:14352:1876286758790016:0@lo:501:mount.lustre.0 10000000:01000000:3.0:1789366716.680272:0:14352:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.123@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:3.0:1789366716.680322:0:14352:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.123@tcp lock: ffff9638832d2600/0x8da3486b955f4067 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8da3486b955f406e expref: -99 pid: 14352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366716.680331:0:14352:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.123@tcp lock: ffff9638832d2600/0x8da3486b955f4067 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8da3486b955f406e expref: -99 pid: 14352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789366716.680339:0:14352:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff963888959000 10000000:01000000:3.0:1789366716.680349:0:14352:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1789366716.680353:0:14352:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff963888959000 10000000:01000000:3.0:1789366716.680355:0:14352:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:3.0:1789366716.680413:0:14352:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff963888959000 from 1 10000000:01000000:3.0:1789366716.680416:0:14352:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:3.0:1789366716.680437:0:14352:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.123@tcp lock: ffff9638832d2c00/0x8da3486b955f4075 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366716.680445:0:14352:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.123@tcp lock: ffff9638832d2c00/0x8da3486b955f4075 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366716.680454:0:14352:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.123@tcp lock: ffff9638832d2c00/0x8da3486b955f4075 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789366716.680467:0:14352:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9638b6d56a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:987e24be-cce8-4f54-8344-02fd27f3b2a2:14352:1876286758790144:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1789366716.680566:0:14352:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789366716.680601:0:14352:0:(client.c:2716:ptlrpc_set_wait()) set ffff96388524b900 going to sleep for 11 seconds 00000100:00100000:1.0:1789366716.680660:0:14364:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286758790144 00000100:00100000:1.0:1789366716.680665:0:14364:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286758790144 00000100:00100000:1.0:1789366716.680699:0:14364:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1789366716.680707:0:14364:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96388a048c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:987e24be-cce8-4f54-8344-02fd27f3b2a2+6:14352:x1876286758790144:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789366716.680739:0:14364:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789366716.680752:0:14364:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9638b6ce3a00/0x8da3486b955f407c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x8da3486b955f4075 expref: -99 pid: 14364 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366716.680768:0:14364:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9638b6ce3a00/0x8da3486b955f407c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8da3486b955f4075 expref: 7 pid: 14364 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366716.680777:0:14364:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9638b6ce3a00/0x8da3486b955f407c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8da3486b955f4075 expref: 7 pid: 14364 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366716.680790:0:14364:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9638b6ce3a00, rc 0) 00000100:00100000:1.0:1789366716.680822:0:14364:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96388a048c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:987e24be-cce8-4f54-8344-02fd27f3b2a2+7:14352:x1876286758790144:12345-0@lo:101:mount.lustre.0 Request processed in 116us (255us total) trans 0 rc 0/0 00000100:00100000:1.0:1789366716.680828:0:14364:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1789366716.680996:0:14352:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9638b6d56a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:987e24be-cce8-4f54-8344-02fd27f3b2a2:14352:1876286758790144:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789366716.681007:0:14352:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.123@tcp lock: ffff9638832d2c00/0x8da3486b955f4075 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8da3486b955f407c expref: -99 pid: 14352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366716.681016:0:14352:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.123@tcp lock: ffff9638832d2c00/0x8da3486b955f4075 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x8da3486b955f407c expref: -99 pid: 14352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789366716.681027:0:14352:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.123@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:3.0:1789366716.681146:0:14352:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.123@tcp lock: ffff9638832d2c00/0x8da3486b955f4075 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8da3486b955f407c expref: -99 pid: 14352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366716.681154:0:14352:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.123@tcp lock: ffff9638832d2c00/0x8da3486b955f4075 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8da3486b955f407c expref: -99 pid: 14352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789366716.681167:0:14352:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:3.0:1789366716.681170:0:14352:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1789366716.681174:0:14352:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff963888959000 10000000:01000000:3.0:1789366716.681177:0:14352:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:3.0:1789366716.681180:0:14352:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:3.0:1789366716.681182:0:14352:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:3.0:1789366716.681196:0:14352:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.123@tcp lock: ffff9638832d3200/0x8da3486b955f4083 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366716.681203:0:14352:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.123@tcp lock: ffff9638832d3200/0x8da3486b955f4083 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366716.681211:0:14352:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.123@tcp lock: ffff9638832d3200/0x8da3486b955f4083 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789366716.681223:0:14352:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9638b6d56a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:987e24be-cce8-4f54-8344-02fd27f3b2a2:14352:1876286758790272:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1789366716.681248:0:14352:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789366716.681318:0:14352:0:(client.c:2716:ptlrpc_set_wait()) set ffff96388524b900 going to sleep for 11 seconds 00000100:00100000:1.0:1789366716.681430:0:14365:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286758790272 00000100:00100000:1.0:1789366716.681435:0:14365:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286758790272 00000100:00100000:1.0:1789366716.681561:0:14365:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1789366716.681569:0:14365:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96388a048850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:987e24be-cce8-4f54-8344-02fd27f3b2a2+7:14352:x1876286758790272:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789366716.681577:0:14365:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789366716.681585:0:14365:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9638b6ce3e00/0x8da3486b955f408a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x8da3486b955f4083 expref: -99 pid: 14365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366716.681599:0:14365:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9638b6ce3e00/0x8da3486b955f408a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8da3486b955f4083 expref: 8 pid: 14365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366716.681609:0:14365:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9638b6ce3e00/0x8da3486b955f408a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8da3486b955f4083 expref: 8 pid: 14365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366716.681616:0:14365:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9638b6ce3e00, rc 0) 00000100:00100000:1.0:1789366716.681663:0:14365:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96388a048850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:987e24be-cce8-4f54-8344-02fd27f3b2a2+8:14352:x1876286758790272:12345-0@lo:101:mount.lustre.0 Request processed in 95us (414us total) trans 0 rc 0/0 00000100:00100000:1.0:1789366716.681669:0:14365:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1789366716.681747:0:14352:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9638b6d56a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:987e24be-cce8-4f54-8344-02fd27f3b2a2:14352:1876286758790272:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789366716.681757:0:14352:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.123@tcp lock: ffff9638832d3200/0x8da3486b955f4083 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8da3486b955f408a expref: -99 pid: 14352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366716.681765:0:14352:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.123@tcp lock: ffff9638832d3200/0x8da3486b955f4083 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x8da3486b955f408a expref: -99 pid: 14352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789366716.681808:0:14352:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9638b6d56a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:987e24be-cce8-4f54-8344-02fd27f3b2a2:14352:1876286758790400:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789366716.681832:0:14352:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789366716.681937:0:14352:0:(client.c:2716:ptlrpc_set_wait()) set ffff96388524b900 going to sleep for 11 seconds 00000100:00100000:2.0:1789366716.681988:0:14363:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286758790400 00000100:00100000:2.0:1789366716.681993:0:14363:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286758790400 00000100:00100000:2.0:1789366716.682026:0:14363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1789366716.682034:0:14363:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96388a049450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:987e24be-cce8-4f54-8344-02fd27f3b2a2+8:14352:x1876286758790400:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789366716.682567:0:14363:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96388a049450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:987e24be-cce8-4f54-8344-02fd27f3b2a2+9:14352:x1876286758790400:12345-0@lo:501:mount.lustre.0 Request processed in 532us (732us total) trans 0 rc 0/0 00000100:00100000:2.0:1789366716.682575:0:14363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1789366716.682664:0:14352:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9638b6d56a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:987e24be-cce8-4f54-8344-02fd27f3b2a2:14352:1876286758790400:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789366716.682694:0:14352:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9638b6d56a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:987e24be-cce8-4f54-8344-02fd27f3b2a2:14352:1876286758790528:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1789366716.682770:0:14352:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789366716.682791:0:14352:0:(client.c:2716:ptlrpc_set_wait()) set ffff96388524b900 going to sleep for 11 seconds 00000100:00100000:3.0:1789366716.682809:0:14364:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286758790528 00000100:00100000:3.0:1789366716.682813:0:14364:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286758790528 00000100:00100000:3.0:1789366716.682843:0:14364:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1789366716.682851:0:14364:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963784a98c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:987e24be-cce8-4f54-8344-02fd27f3b2a2+9:14352:x1876286758790528:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1789366716.683212:0:14364:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963784a98c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:987e24be-cce8-4f54-8344-02fd27f3b2a2+9:14352:x1876286758790528:12345-0@lo:503:mount.lustre.0 Request processed in 360us (441us total) trans 0 rc 0/0 00000100:00100000:3.0:1789366716.683219:0:14364:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1789366716.683258:0:14352:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9638b6d56a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:987e24be-cce8-4f54-8344-02fd27f3b2a2:14352:1876286758790528:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1789366716.684078:0:14389:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96378749bb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:987e24be-cce8-4f54-8344-02fd27f3b2a2:14389:1876286758790656:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789366716.684123:0:14389:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789366716.684197:0:14389:0:(client.c:2716:ptlrpc_set_wait()) set ffff963882b60e40 going to sleep for 11 seconds 00000100:00100000:3.0:1789366716.684234:0:14364:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286758790656 00000100:00100000:3.0:1789366716.684239:0:14364:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286758790656 00000100:00100000:3.0:1789366716.684309:0:14364:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1789366716.684317:0:14364:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638aefdd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:987e24be-cce8-4f54-8344-02fd27f3b2a2+9:14389:x1876286758790656:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789366716.684715:0:14364:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638aefdd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:987e24be-cce8-4f54-8344-02fd27f3b2a2+9:14389:x1876286758790656:12345-0@lo:502:llog_process_th.0 Request processed in 398us (590us total) trans 0 rc 0/0 00000100:00100000:3.0:1789366716.684750:0:14364:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1789366716.684821:0:14389:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96378749bb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:987e24be-cce8-4f54-8344-02fd27f3b2a2:14389:1876286758790656:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1789366716.684846:0:14389:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789366716.684867:0:14389:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789366716.684870:0:14389:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:0.0:1789366716.684883:0:14389:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:0.0:1789366716.684887:0:14389:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1789366716.684901:0:14389:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (ffff9638b4f2b380) 00000020:00000080:0.0:1789366716.684918:0:14389:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:0.0:1789366716.684924:0:14389:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:0.0:1789366716.684983:0:14389:0:(osd_handler.c:1574:osd_obd_connect()) connect #2 00000020:00000080:0.0:1789366716.684990:0:14389:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x8da3486b955f4098 00000020:00000080:0.0:1789366716.685198:0:14389:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:0.0:1789366716.685202:0:14389:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789366716.685206:0:14389:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789366716.685207:0:14389:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:0.0:1789366716.685210:0:14389:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789366716.685213:0:14389:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789366716.685215:0:14389:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:0.0:1789366716.685218:0:14389:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1789366716.685225:0:14389:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (ffff9638b4f2cd40) 00000020:00000080:0.0:1789366716.685234:0:14389:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:0.0:1789366716.685237:0:14389:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:0.0:1789366716.685239:0:14389:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:0.0:1789366716.685242:0:14389:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:0.0:1789366716.685247:0:14389:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1789366716.685290:0:14389:0:(tgt_mount.c:153:server_get_mount()) get mount ffff963888959000 from lustre-MDT0000, refs=3 00000020:00000080:0.0:1789366716.685302:0:14389:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (ffff9638b4f28000) 00000020:00000080:0.0:1789366716.685310:0:14389:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:0.0:1789366716.685352:0:14389:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:0.0:1789366716.685359:0:14389:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x8da3486b955f40ad 00000020:00000080:0.0:1789366716.685455:0:14389:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:0.0:1789366716.685461:0:14389:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:0.0:1789366716.685465:0:14389:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0x8da3486b955f40b4 00080000:01000000:0.0:1789366716.685470:0:14389:0:(osd_handler.c:1574:osd_obd_connect()) connect #3 00000020:00000080:0.0:1789366716.685484:0:14389:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x8da3486b955f40bb 00010000:00010000:1.0:1789366716.730292:0:14389:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:00000004:1.0:1789366716.730774:0:14389:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 4294967520 00000001:00080000:1.0:1789366716.730961:0:14389:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:1.0:1789366716.731379:0:14389:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (ffff963882f58000) 00000020:00000080:1.0:1789366716.731392:0:14389:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:1.0:1789366716.731441:0:14389:0:(osd_handler.c:1574:osd_obd_connect()) connect #4 00000020:00000080:1.0:1789366716.731446:0:14389:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x8da3486b955f40c9 00000020:00000080:0.0:1789366716.731892:0:14389:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:0.0:1789366716.734225:0:14389:0:(genops.c:1385:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0x8da3486b955f40d0 00000020:00000080:1.0:1789366716.734788:0:14389:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:1.0:1789366716.734797:0:14389:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789366716.734802:0:14389:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789366716.734804:0:14389:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:1.0:1789366716.734807:0:14389:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789366716.734811:0:14389:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789366716.734812:0:14389:0:(obd_config.c:1563:class_process_config()) marker 8 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:1.0:1789366716.734816:0:14389:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:1.0:1789366716.734842:0:14389:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:1.0:1789366716.734900:0:14389:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789366716.734904:0:14389:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789366716.734905:0:14389:0:(obd_config.c:1563:class_process_config()) marker 8 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:1.0:1789366716.734907:0:14389:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1789366716.734908:0:14389:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #10 00000020:01000000:1.0:1789366716.734909:0:14389:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1789366716.734911:0:14389:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1789366716.734912:0:14389:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1789366716.734914:0:14389:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789366716.734915:0:14389:0:(obd_config.c:1563:class_process_config()) marker 10 (0x6) lustre sys.timeout 00000020:01000000:1.0:1789366716.734916:0:14389:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1789366716.734919:0:14389:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-mdt1/mdt1 00000020:00000080:1.0:1789366716.734921:0:14389:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789366716.734922:0:14389:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-OST0000 add osc 00000020:00000080:1.0:1789366716.734924:0:14389:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1789366716.734928:0:14389:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.202.123@tcp to nid 0x20000c0a8ca7b (192.168.202.123@tcp) 00000020:01000000:1.0:1789366716.734948:0:14389:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:1.0:1789366716.734950:0:14389:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1789366716.734961:0:14389:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff9638bfe799c0) 00000020:00000080:1.0:1789366716.734970:0:14389:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type osp with refcount 2 00000020:00000080:1.0:1789366716.734973:0:14389:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1789366716.735010:0:14389:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:1.0:1789366716.735018:0:14389:0:(osd_handler.c:1574:osd_obd_connect()) connect #5 00000020:00000080:1.0:1789366716.735023:0:14389:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x8da3486b955f40de 00010000:00080000:1.0:1789366716.735047:0:14389:0:(ldlm_lib.c:102:import_set_conn()) imp ffff963887022000@lustre-OST0000-osc-MDT0000: add connection 192.168.202.123@tcp at head 00010000:00010000:1.0:1789366716.735229:0:14389:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-1 is initialized 00000040:01000000:1.0:1789366716.735573:0:14389:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:1.0:1789366716.735616:0:14389:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:1.0:1789366716.736672:0:14389:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789366716.736788:0:14389:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].2, 64 off8320 00000040:00080000:1.0:1789366716.736837:0:14389:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1, 64 off8256 00000040:00080000:0.0:1789366716.737134:0:14393:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1789366716.737138:0:14393:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xa:0x0] at index 2 of catalog [0x1:0x2:0x0] 00000020:00000080:0.0:1789366716.737700:0:14389:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1789366716.737711:0:14389:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:0.0:1789366716.737758:0:14389:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:0.0:1789366716.737771:0:14389:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x8da3486b955f40e5 00000100:00080000:0.0:1789366716.737779:0:14389:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1789366716.737788:0:14389:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff963887022000 using connection 192.168.202.123@tcp/0@lo 00000100:00100000:0.0:1789366716.737817:0:14389:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff96378749bb80 x1876286758790784/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1789366716.737915:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96378749bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3283:1876286758790784:0@lo:8:llog_process_th.0 00000400:00000100:1.0:1789366716.737962:0:3283:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1876286758790784 offset 0 length 520: 4 00000100:00080000:0.0:1789366716.738012:0:14389:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:0.0:1789366716.738059:0:14389:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789366716.738062:0:14389:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789366716.738064:0:14389:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-OST0000 add osc 00000020:01000000:0.0:1789366716.738065:0:14389:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1789366716.738067:0:14389:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #15 00000020:01000000:0.0:1789366716.738068:0:14389:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1789366716.738069:0:14389:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1789366716.738070:0:14389:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1789366716.738072:0:14389:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789366716.738072:0:14389:0:(obd_config.c:1563:class_process_config()) marker 15 (0x6) lustre sys.timeout 00000020:01000000:0.0:1789366716.738074:0:14389:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1789366716.738077:0:14389:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-mdt1/mdt1 00000020:00000080:0.0:1789366716.738079:0:14389:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789366716.738079:0:14389:0:(obd_config.c:1563:class_process_config()) marker 18 (0x1) lustre-OST0001 add osc 00000020:00000080:0.0:1789366716.738081:0:14389:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1789366716.738083:0:14389:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.202.123@tcp to nid 0x20000c0a8ca7b (192.168.202.123@tcp) 00000020:01000000:0.0:1789366716.738095:0:14389:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:0.0:1789366716.738096:0:14389:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1789366716.738104:0:14389:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff9638b4f299c0) 00000020:00000080:0.0:1789366716.738111:0:14389:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osp with refcount 2 00000020:00000080:0.0:1789366716.738118:0:14389:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1789366716.738155:0:14389:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:0.0:1789366716.738160:0:14389:0:(osd_handler.c:1574:osd_obd_connect()) connect #6 00000020:00000080:0.0:1789366716.738165:0:14389:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x8da3486b955f40f3 00010000:00080000:0.0:1789366716.738184:0:14389:0:(ldlm_lib.c:102:import_set_conn()) imp ffff963882f31800@lustre-OST0001-osc-MDT0000: add connection 192.168.202.123@tcp at head 00010000:00010000:0.0:1789366716.738328:0:14389:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-2 is initialized 00000040:01000000:0.0:1789366716.738607:0:14389:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:0.0:1789366716.738628:0:14389:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:0.0:1789366716.741350:0:14389:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1789366716.741580:0:14389:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].2, 64 off8320 00000040:00080000:0.0:1789366716.741698:0:14389:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].1, 64 off8256 00000040:00080000:1.0:1789366716.742257:0:14395:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1789366716.742262:0:14395:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xc:0x0] at index 2 of catalog [0x1:0x5:0x0] 00000020:00000080:0.0:1789366716.743113:0:14389:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1789366716.743125:0:14389:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:0.0:1789366716.743149:0:14389:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:0.0:1789366716.743163:0:14389:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x8da3486b955f40fa 00000100:00080000:0.0:1789366716.743171:0:14389:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1789366716.743180:0:14389:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff963882f31800 using connection 192.168.202.123@tcp/0@lo 00000100:00100000:0.0:1789366716.743209:0:14389:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff963787499880 x1876286758790912/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1789366716.743264:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff963787499880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3283:1876286758790912:0@lo:8:llog_process_th.0 00000400:00000100:1.0:1789366716.743308:0:3283:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1876286758790912 offset 0 length 520: 4 00000100:00080000:0.0:1789366716.743352:0:14389:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:0.0:1789366716.743400:0:14389:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789366716.743403:0:14389:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789366716.743405:0:14389:0:(obd_config.c:1563:class_process_config()) marker 18 (0x2) lustre-OST0001 add osc 00000020:01000000:0.0:1789366716.743406:0:14389:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789366716.743409:0:14389:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789366716.743410:0:14389:0:(obd_config.c:1563:class_process_config()) marker 22 (0x1) lustre sys.timeout 00000020:00000080:0.0:1789366716.743412:0:14389:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1789366716.743413:0:14389:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1789366716.743414:0:14389:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789366716.743415:0:14389:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789366716.743416:0:14389:0:(obd_config.c:1563:class_process_config()) marker 22 (0x2) lustre sys.timeout 00000020:01000000:0.0:1789366716.743423:0:14389:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789366716.743425:0:14389:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789366716.743426:0:14389:0:(obd_config.c:1563:class_process_config()) marker 26 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1789366716.743428:0:14389:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:0.0:1789366716.743454:0:14389:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff963787498700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:987e24be-cce8-4f54-8344-02fd27f3b2a2:14389:1876286758791040:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789366716.743576:0:14389:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789366716.743599:0:14389:0:(client.c:2716:ptlrpc_set_wait()) set ffff9638b70ff3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789366716.743684:0:14365:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286758791040 00000100:00100000:2.0:1789366716.743691:0:14365:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286758791040 00000100:00100000:2.0:1789366716.743761:0:14365:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1789366716.743772:0:14365:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638aefde050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:987e24be-cce8-4f54-8344-02fd27f3b2a2+9:14389:x1876286758791040:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789366716.744285:0:14365:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638aefde050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:987e24be-cce8-4f54-8344-02fd27f3b2a2+9:14389:x1876286758791040:12345-0@lo:502:llog_process_th.0 Request processed in 513us (706us total) trans 0 rc 0/0 00000100:00100000:2.0:1789366716.744294:0:14365:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1789366716.744384:0:14389:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff963787498700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:987e24be-cce8-4f54-8344-02fd27f3b2a2:14389:1876286758791040:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1789366716.744408:0:14389:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789366716.744413:0:14389:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789366716.744415:0:14389:0:(obd_config.c:1563:class_process_config()) marker 26 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1789366716.744419:0:14389:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 37 count 37 00000020:01000000:3.0:1789366716.744487:0:14352:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-36 (rc=0) 10000000:01000000:3.0:1789366716.744503:0:14352:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.123@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:3.0:1789366716.744522:0:14352:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.123@tcp lock: ffff9638832d3200/0x8da3486b955f4083 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8da3486b955f408a expref: -99 pid: 14352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366716.744534:0:14352:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.123@tcp lock: ffff9638832d3200/0x8da3486b955f4083 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8da3486b955f408a expref: -99 pid: 14352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789366716.744549:0:14352:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff963888959000 from 1 10000000:01000000:3.0:1789366716.744552:0:14352:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1789366716.744578:0:14352:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.123@tcp lock: ffff9638832d2800/0x8da3486b955f4101 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366716.744591:0:14352:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.123@tcp lock: ffff9638832d2800/0x8da3486b955f4101 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366716.744601:0:14352:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.123@tcp lock: ffff9638832d2800/0x8da3486b955f4101 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789366716.744628:0:14352:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9638b6d56a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:987e24be-cce8-4f54-8344-02fd27f3b2a2:14352:1876286758791168:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1789366716.744671:0:14352:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789366716.744713:0:14352:0:(client.c:2716:ptlrpc_set_wait()) set ffff96388524b0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789366716.744741:0:14364:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286758791168 00000100:00100000:0.0:1789366716.744748:0:14364:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286758791168 00000100:00100000:0.0:1789366716.744781:0:14364:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1789366716.744789:0:14364:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638aefdcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:987e24be-cce8-4f54-8344-02fd27f3b2a2+9:14352:x1876286758791168:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789366716.744799:0:14364:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789366716.744813:0:14364:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9638b720c600/0x8da3486b955f4108 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x8da3486b955f4101 expref: -99 pid: 14364 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366716.744833:0:14364:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9638b720c600/0x8da3486b955f4108 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8da3486b955f4101 expref: 10 pid: 14364 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366716.744844:0:14364:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9638b720c600/0x8da3486b955f4108 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8da3486b955f4101 expref: 10 pid: 14364 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366716.744865:0:14364:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9638b720c600, rc 0) 00000100:00100000:3.0:1789366716.745024:0:14352:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9638b6d56a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:987e24be-cce8-4f54-8344-02fd27f3b2a2:14352:1876286758791168:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1789366716.745027:0:14364:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638aefdcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:987e24be-cce8-4f54-8344-02fd27f3b2a2+10:14352:x1876286758791168:12345-0@lo:101:mount.lustre.0 Request processed in 236us (354us total) trans 0 rc 0/0 00010000:00010000:3.0:1789366716.745040:0:14352:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.123@tcp lock: ffff9638832d2800/0x8da3486b955f4101 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8da3486b955f4108 expref: -99 pid: 14352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789366716.745053:0:14364:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00010000:3.0:1789366716.745057:0:14352:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.123@tcp lock: ffff9638832d2800/0x8da3486b955f4101 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x8da3486b955f4108 expref: -99 pid: 14352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789366716.745584:0:14352:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9638b6d56a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:987e24be-cce8-4f54-8344-02fd27f3b2a2:14352:1876286758791296:0@lo:256:mount.lustre.0 00000100:00100000:3.0:1789366716.745618:0:14352:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789366716.745672:0:14365:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286758791296 00000100:00100000:2.0:1789366716.745677:0:14365:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286758791296 00000100:00100000:2.0:1789366716.745771:0:14365:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1789366716.745779:0:14365:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638aefdf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:987e24be-cce8-4f54-8344-02fd27f3b2a2+10:14352:x1876286758791296:12345-0@lo:256:mount.lustre.0 20000000:01000000:2.0:1789366716.745794:0:14365:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:2.0:1789366716.745801:0:14365:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:3.0:1789366716.745969:0:14352:0:(client.c:2716:ptlrpc_set_wait()) set ffff96388524b0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789366716.746027:0:14365:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638aefdf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:987e24be-cce8-4f54-8344-02fd27f3b2a2+10:14352:x1876286758791296:12345-0@lo:256:mount.lustre.0 Request processed in 248us (412us total) trans 0 rc 0/0 00000100:00100000:2.0:1789366716.746035:0:14365:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1789366716.746044:0:14352:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9638b6d56a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:987e24be-cce8-4f54-8344-02fd27f3b2a2:14352:1876286758791296:0@lo:256:mount.lustre.0 10000000:01000000:3.0:1789366716.746553:0:14352:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.123@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1789366716.746572:0:14352:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.123@tcp lock: ffff9638832d2800/0x8da3486b955f4101 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8da3486b955f4108 expref: -99 pid: 14352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366716.746581:0:14352:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.123@tcp lock: ffff9638832d2800/0x8da3486b955f4101 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8da3486b955f4108 expref: -99 pid: 14352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789366716.746589:0:14352:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff963888959000 from 1 10000000:01000000:3.0:1789366716.746591:0:14352:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1789366716.746610:0:14352:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.123@tcp lock: ffff9638832d2a00/0x8da3486b955f410f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366716.746682:0:14352:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.123@tcp lock: ffff9638832d2a00/0x8da3486b955f410f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366716.746691:0:14352:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.123@tcp lock: ffff9638832d2a00/0x8da3486b955f410f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789366716.746705:0:14352:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9638b6d56a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:987e24be-cce8-4f54-8344-02fd27f3b2a2:14352:1876286758791424:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1789366716.746785:0:14352:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789366716.746815:0:14352:0:(client.c:2716:ptlrpc_set_wait()) set ffff96388524b0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789366716.746829:0:14364:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286758791424 00000100:00100000:0.0:1789366716.746835:0:14364:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286758791424 00000100:00100000:0.0:1789366716.746984:0:14364:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1789366716.746994:0:14364:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963785842450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:987e24be-cce8-4f54-8344-02fd27f3b2a2+10:14352:x1876286758791424:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789366716.747003:0:14364:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789366716.747016:0:14364:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9638b720ca00/0x8da3486b955f4116 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x8da3486b955f410f expref: -99 pid: 14364 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366716.747034:0:14364:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9638b720ca00/0x8da3486b955f4116 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8da3486b955f410f expref: 11 pid: 14364 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366716.747044:0:14364:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9638b720ca00/0x8da3486b955f4116 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8da3486b955f410f expref: 11 pid: 14364 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366716.747052:0:14364:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9638b720ca00, rc 0) 00000100:00100000:0.0:1789366716.747095:0:14364:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963785842450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:987e24be-cce8-4f54-8344-02fd27f3b2a2+11:14352:x1876286758791424:12345-0@lo:101:mount.lustre.0 Request processed in 104us (310us total) trans 0 rc 0/0 00000100:00100000:0.0:1789366716.747102:0:14364:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1789366716.747151:0:14352:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9638b6d56a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:987e24be-cce8-4f54-8344-02fd27f3b2a2:14352:1876286758791424:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789366716.747164:0:14352:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.123@tcp lock: ffff9638832d2a00/0x8da3486b955f410f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8da3486b955f4116 expref: -99 pid: 14352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366716.747173:0:14352:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.123@tcp lock: ffff9638832d2a00/0x8da3486b955f410f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x8da3486b955f4116 expref: -99 pid: 14352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789366716.747213:0:14352:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9638b6d56a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:987e24be-cce8-4f54-8344-02fd27f3b2a2:14352:1876286758791552:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789366716.747235:0:14352:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789366716.747255:0:14352:0:(client.c:2716:ptlrpc_set_wait()) set ffff96388524b0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789366716.747271:0:14365:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286758791552 00000100:00100000:2.0:1789366716.747276:0:14365:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286758791552 00000100:00100000:2.0:1789366716.747304:0:14365:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1789366716.747315:0:14365:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963785840850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:987e24be-cce8-4f54-8344-02fd27f3b2a2+11:14352:x1876286758791552:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789366716.747704:0:14365:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963785840850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:987e24be-cce8-4f54-8344-02fd27f3b2a2+11:14352:x1876286758791552:12345-0@lo:501:mount.lustre.0 Request processed in 389us (467us total) trans 0 rc 0/0 00000100:00100000:2.0:1789366716.747712:0:14365:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1789366716.747945:0:14352:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9638b6d56a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:987e24be-cce8-4f54-8344-02fd27f3b2a2:14352:1876286758791552:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789366716.747976:0:14352:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9638b6d56a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:987e24be-cce8-4f54-8344-02fd27f3b2a2:14352:1876286758791680:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1789366716.748012:0:14352:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789366716.748039:0:14352:0:(client.c:2716:ptlrpc_set_wait()) set ffff96388524b0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789366716.748125:0:14363:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286758791680 00000100:00100000:2.0:1789366716.748129:0:14363:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286758791680 00000100:00100000:2.0:1789366716.748160:0:14363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1789366716.748167:0:14363:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963785841850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:987e24be-cce8-4f54-8344-02fd27f3b2a2+11:14352:x1876286758791680:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1789366716.748314:0:14363:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963785841850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:987e24be-cce8-4f54-8344-02fd27f3b2a2+11:14352:x1876286758791680:12345-0@lo:503:mount.lustre.0 Request processed in 147us (301us total) trans 0 rc 0/0 00000100:00100000:2.0:1789366716.748322:0:14363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1789366716.748346:0:14352:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9638b6d56a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:987e24be-cce8-4f54-8344-02fd27f3b2a2:14352:1876286758791680:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1789366716.751192:0:14397:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff963787498700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:987e24be-cce8-4f54-8344-02fd27f3b2a2:14397:1876286758791808:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789366716.751255:0:14397:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789366716.751327:0:14397:0:(client.c:2716:ptlrpc_set_wait()) set ffff9638b70ff000 going to sleep for 11 seconds 00000100:00100000:2.0:1789366716.751396:0:14365:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286758791808 00000100:00100000:2.0:1789366716.751402:0:14365:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286758791808 00000100:00100000:2.0:1789366716.751456:0:14365:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1789366716.751462:0:14365:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963785842050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:987e24be-cce8-4f54-8344-02fd27f3b2a2+11:14397:x1876286758791808:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789366716.751735:0:14365:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963785842050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:987e24be-cce8-4f54-8344-02fd27f3b2a2+11:14397:x1876286758791808:12345-0@lo:502:llog_process_th.0 Request processed in 254us (462us total) trans 0 rc 0/0 00000100:00100000:2.0:1789366716.751742:0:14365:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1789366716.751950:0:14397:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff963787498700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:987e24be-cce8-4f54-8344-02fd27f3b2a2:14397:1876286758791808:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1789366716.751982:0:14397:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789366716.751991:0:14397:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789366716.751993:0:14397:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1789366716.752001:0:14397:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff963888959000 00000020:00000080:1.0:1789366716.752003:0:14397:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1789366716.752010:0:14397:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789366716.752011:0:14397:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789366716.752013:0:14397:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:1.0:1789366716.752015:0:14397:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789366716.752017:0:14397:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789366716.752018:0:14397:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1789366716.752021:0:14397:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff963888959000 00000020:00000080:1.0:1789366716.752022:0:14397:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1789366716.752138:0:14397:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789366716.752142:0:14397:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789366716.752143:0:14397:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:1.0:1789366716.752146:0:14397:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789366716.752149:0:14397:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789366716.752150:0:14397:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1789366716.752154:0:14397:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff963888959000 00000020:00000080:1.0:1789366716.752156:0:14397:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1789366716.752191:0:14397:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96388327f100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:987e24be-cce8-4f54-8344-02fd27f3b2a2:14397:1876286758791936:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789366716.752224:0:14397:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789366716.752284:0:14397:0:(client.c:2716:ptlrpc_set_wait()) set ffff9638ba5f6240 going to sleep for 11 seconds 00000100:00100000:2.0:1789366716.752371:0:14365:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286758791936 00000100:00100000:2.0:1789366716.752375:0:14365:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286758791936 00000100:00100000:2.0:1789366716.752400:0:14365:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1789366716.752405:0:14365:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963785841050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:987e24be-cce8-4f54-8344-02fd27f3b2a2+11:14397:x1876286758791936:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789366716.752487:0:14365:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963785841050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:987e24be-cce8-4f54-8344-02fd27f3b2a2+11:14397:x1876286758791936:12345-0@lo:502:llog_process_th.0 Request processed in 81us (262us total) trans 0 rc 0/0 00000100:00100000:2.0:1789366716.752492:0:14365:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1789366716.752570:0:14397:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96388327f100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:987e24be-cce8-4f54-8344-02fd27f3b2a2:14397:1876286758791936:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1789366716.752588:0:14397:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789366716.752592:0:14397:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789366716.752594:0:14397:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:1.0:1789366716.752597:0:14397:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:2.0:1789366716.752676:0:14352:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:2.0:1789366716.752698:0:14352:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.123@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1789366716.752739:0:14352:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.123@tcp lock: ffff9638832d2a00/0x8da3486b955f410f lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8da3486b955f4116 expref: -99 pid: 14352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366716.752750:0:14352:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.123@tcp lock: ffff9638832d2a00/0x8da3486b955f410f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8da3486b955f4116 expref: -99 pid: 14352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789366716.752786:0:14352:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1789366716.752789:0:14352:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff963888959000 10000000:01000000:2.0:1789366716.752792:0:14352:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff963888959000 10000000:01000000:2.0:1789366716.752795:0:14352:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1789366716.752801:0:14352:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff963888959000 from 1 10000000:01000000:2.0:1789366716.752803:0:14352:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1789366716.752828:0:14352:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.123@tcp lock: ffff9638902c9800/0x8da3486b955f411d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366716.752893:0:14352:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.123@tcp lock: ffff9638902c9800/0x8da3486b955f411d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366716.752903:0:14352:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.123@tcp lock: ffff9638902c9800/0x8da3486b955f411d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789366716.752916:0:14352:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9638aef24000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:987e24be-cce8-4f54-8344-02fd27f3b2a2:14352:1876286758792064:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1789366716.752952:0:14352:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789366716.752964:0:14352:0:(client.c:2716:ptlrpc_set_wait()) set ffff9638988c5e40 going to sleep for 11 seconds 00000100:00100000:1.0:1789366716.752988:0:14365:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286758792064 00000100:00100000:1.0:1789366716.752992:0:14365:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286758792064 00000100:00100000:1.0:1789366716.753020:0:14365:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1789366716.753027:0:14365:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963785843850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:987e24be-cce8-4f54-8344-02fd27f3b2a2+11:14352:x1876286758792064:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789366716.753101:0:14365:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789366716.753115:0:14365:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9638b6ce2000/0x8da3486b955f4124 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x8da3486b955f411d expref: -99 pid: 14365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366716.753135:0:14365:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9638b6ce2000/0x8da3486b955f4124 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8da3486b955f411d expref: 12 pid: 14365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366716.753146:0:14365:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9638b6ce2000/0x8da3486b955f4124 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8da3486b955f411d expref: 12 pid: 14365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366716.753167:0:14365:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9638b6ce2000, rc 0) 00000100:00100000:1.0:1789366716.753196:0:14365:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963785843850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:987e24be-cce8-4f54-8344-02fd27f3b2a2+12:14352:x1876286758792064:12345-0@lo:101:mount.lustre.0 Request processed in 169us (243us total) trans 0 rc 0/0 00000100:00100000:2.0:1789366716.753201:0:14352:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9638aef24000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:987e24be-cce8-4f54-8344-02fd27f3b2a2:14352:1876286758792064:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1789366716.753202:0:14365:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00010000:00010000:2.0:1789366716.753212:0:14352:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.123@tcp lock: ffff9638902c9800/0x8da3486b955f411d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x8da3486b955f4124 expref: -99 pid: 14352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366716.753231:0:14352:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.123@tcp lock: ffff9638902c9800/0x8da3486b955f411d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x8da3486b955f4124 expref: -99 pid: 14352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789366716.753283:0:14352:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9638aef24000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:987e24be-cce8-4f54-8344-02fd27f3b2a2:14352:1876286758792192:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789366716.753307:0:14352:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789366716.753329:0:14364:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286758792192 00000100:00100000:0.0:1789366716.753334:0:14364:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286758792192 00000100:00100000:2.0:1789366716.753341:0:14352:0:(client.c:2716:ptlrpc_set_wait()) set ffff9638988c5e40 going to sleep for 11 seconds 00000100:00100000:0.0:1789366716.753358:0:14364:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1789366716.753364:0:14364:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963785843050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:987e24be-cce8-4f54-8344-02fd27f3b2a2+12:14352:x1876286758792192:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789366716.753572:0:14364:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963785843050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:987e24be-cce8-4f54-8344-02fd27f3b2a2+12:14352:x1876286758792192:12345-0@lo:501:mount.lustre.0 Request processed in 207us (263us total) trans 0 rc 0/0 00000100:00100000:0.0:1789366716.753586:0:14364:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1789366716.753592:0:14352:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9638aef24000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:987e24be-cce8-4f54-8344-02fd27f3b2a2:14352:1876286758792192:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789366716.753616:0:14352:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9638aef24000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:987e24be-cce8-4f54-8344-02fd27f3b2a2:14352:1876286758792320:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1789366716.753663:0:14352:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789366716.753684:0:14352:0:(client.c:2716:ptlrpc_set_wait()) set ffff9638988c5e40 going to sleep for 11 seconds 00000100:00100000:0.0:1789366716.753700:0:14363:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286758792320 00000100:00100000:0.0:1789366716.753704:0:14363:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286758792320 00000100:00100000:0.0:1789366716.753765:0:14363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1789366716.753773:0:14363:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963785841450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:987e24be-cce8-4f54-8344-02fd27f3b2a2+12:14352:x1876286758792320:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1789366716.753918:0:14363:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963785841450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:987e24be-cce8-4f54-8344-02fd27f3b2a2+12:14352:x1876286758792320:12345-0@lo:503:mount.lustre.0 Request processed in 145us (253us total) trans 0 rc 0/0 00000100:00100000:0.0:1789366716.753925:0:14363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1789366716.753994:0:14352:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9638aef24000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:987e24be-cce8-4f54-8344-02fd27f3b2a2:14352:1876286758792320:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1789366716.755019:0:14398:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9638aef24000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:987e24be-cce8-4f54-8344-02fd27f3b2a2:14398:1876286758792448:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789366716.755078:0:14398:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789366716.755115:0:14398:0:(client.c:2716:ptlrpc_set_wait()) set ffff9638988c5540 going to sleep for 11 seconds 00000100:00100000:1.0:1789366716.755205:0:14364:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286758792448 00000100:00100000:1.0:1789366716.755210:0:14364:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286758792448 00000100:00100000:1.0:1789366716.755249:0:14364:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1789366716.755258:0:14364:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963785840450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:987e24be-cce8-4f54-8344-02fd27f3b2a2+12:14398:x1876286758792448:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789366716.755472:0:14364:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963785840450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:987e24be-cce8-4f54-8344-02fd27f3b2a2+12:14398:x1876286758792448:12345-0@lo:502:llog_process_th.0 Request processed in 214us (393us total) trans 0 rc 0/0 00000100:00100000:1.0:1789366716.755480:0:14364:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1789366716.755607:0:14398:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9638aef24000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:987e24be-cce8-4f54-8344-02fd27f3b2a2:14398:1876286758792448:0@lo:502:llog_process_th.0 00000020:01000004:2.0:1789366716.755671:0:14398:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:2.0:1789366716.755685:0:14398:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (ffff9638986a3380) 00000020:00000080:2.0:1789366716.755703:0:14398:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type lwp with refcount 2 00000020:01000004:2.0:1789366716.755884:0:14398:0:(tgt_mount.c:153:server_get_mount()) get mount ffff963888959000 from lustre-MDT0000, refs=4 00000020:01000004:2.0:1789366716.755888:0:14398:0:(tgt_mount.c:187:server_put_mount()) put mount ffff963888959000 from lustre-MDT0000, refs=4 00000020:01000004:2.0:1789366716.755891:0:14398:0:(obd_mount.c:710:lustre_put_lsi()) put ffff963888959000 4 00010000:00080000:2.0:1789366716.755917:0:14398:0:(ldlm_lib.c:102:import_set_conn()) imp ffff96388497c000@lustre-MDT0000-lwp-MDT0000: add connection 192.168.202.123@tcp at head 00010000:00010000:2.0:1789366716.758179:0:14398:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-3 is initialized 00000020:00000080:2.0:1789366716.760566:0:14398:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:2.0:1789366716.760605:0:14398:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1789366716.760618:0:14398:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0x8da3486b955f4132 00000100:00080000:2.0:1789366716.760628:0:14398:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1789366716.760657:0:14398:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff96388497c000 using connection 192.168.202.123@tcp/0@lo 00000100:00100000:2.0:1789366716.760701:0:14398:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9638aef24000 x1876286758792576/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1789366716.760761:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9638aef24000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3283:1876286758792576:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1789366716.760824:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789366716.760872:0:14370:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286758792576 00000100:00100000:3.0:1789366716.760880:0:14370:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286758792576 00000100:00080000:2.0:1789366716.760883:0:14398:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:3.0:1789366716.760920:0:14370:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789366716.760928:0:14370:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638aef25180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3283:x1876286758792576:12345-0@lo:38:llog_process_th.0 00000100:00100000:3.0:1789366716.761001:0:14370:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638aef25180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3283:x1876286758792576:12345-0@lo:38:llog_process_th.0 Request processed in 71us (175us total) trans 0 rc -11/-11 00000100:00100000:3.0:1789366716.761010:0:14370:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789366716.761026:0:3283:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1789366716.761036:0:3283:0:(import.c:65:import_set_state_nolock()) ffff96388497c000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1789366716.761041:0:3283:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:2.0:1789366716.761045:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9638aef24000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3283:1876286758792576:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1789366716.761134:0:14398:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9638aef24000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:987e24be-cce8-4f54-8344-02fd27f3b2a2:14398:1876286758792704:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789366716.761246:0:14398:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789366716.761270:0:14365:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286758792704 00000100:00100000:2.0:1789366716.761274:0:14365:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286758792704 00000100:00100000:2.0:1789366716.761308:0:14365:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1789366716.761316:0:14365:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963785842c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:987e24be-cce8-4f54-8344-02fd27f3b2a2+12:14398:x1876286758792704:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789366716.761534:0:14365:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963785842c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:987e24be-cce8-4f54-8344-02fd27f3b2a2+12:14398:x1876286758792704:12345-0@lo:502:llog_process_th.0 Request processed in 220us (288us total) trans 0 rc 0/0 00000100:00100000:2.0:1789366716.761541:0:14365:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1789366716.761577:0:14398:0:(client.c:2716:ptlrpc_set_wait()) set ffff9638b6da7000 going to sleep for 11 seconds 00000100:00100000:2.0:1789366716.761589:0:14398:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9638aef24000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:987e24be-cce8-4f54-8344-02fd27f3b2a2:14398:1876286758792704:0@lo:502:llog_process_th.0 00000040:00080000:2.0:1789366716.761619:0:14398:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:0.0:1789366716.761748:0:14352:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:0.0:1789366716.761769:0:14352:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.123@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1789366716.761786:0:14352:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.123@tcp lock: ffff9638902c9800/0x8da3486b955f411d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x8da3486b955f4124 expref: -99 pid: 14352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366716.761796:0:14352:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.123@tcp lock: ffff9638902c9800/0x8da3486b955f411d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x8da3486b955f4124 expref: -99 pid: 14352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1789366716.761841:0:14352:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1789366716.761843:0:14352:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1789366716.761844:0:14352:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789366716.761846:0:14352:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789366716.761847:0:14352:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789366716.761848:0:14352:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789366716.761849:0:14352:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1789366716.761851:0:14352:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1789366716.761852:0:14352:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789366716.761854:0:14352:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1789366716.761857:0:14352:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020005 00000020:01000004:0.0:1789366716.761860:0:14352:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1789366716.761861:0:14352:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1789366716.761862:0:14352:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789366716.761863:0:14352:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789366716.761870:0:14352:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789366716.761871:0:14352:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789366716.761872:0:14352:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1789366716.761873:0:14352:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1789366716.761874:0:14352:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789366716.761875:0:14352:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1789366716.761888:0:14352:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:0.0:1789366716.761896:0:14352:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96378749ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:987e24be-cce8-4f54-8344-02fd27f3b2a2:14352:1876286758792832:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1789366716.761934:0:14352:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789366716.761961:0:14352:0:(client.c:2716:ptlrpc_set_wait()) set ffff9638b70ffa80 going to sleep for 11 seconds 00000100:00100000:2.0:1789366716.761966:0:14363:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286758792832 00000100:00100000:2.0:1789366716.761970:0:14363:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286758792832 00000100:00100000:2.0:1789366716.762002:0:14363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1789366716.762018:0:14363:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963785843c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:987e24be-cce8-4f54-8344-02fd27f3b2a2+12:14352:x1876286758792832:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1789366716.762037:0:14363:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:2.0:1789366716.762050:0:14363:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:2.0:1789366716.793450:0:14363:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1789366716.793486:0:14363:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:3.0:1789366716.793565:0:14386:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1789366716.793569:0:14386:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1789366716.793588:0:14386:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9638832d3000/0x8da3486b955f4139 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366716.793601:0:14386:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9638b720c600/0x8da3486b955f4108 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8da3486b955f4101 expref: 12 pid: 14364 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366716.793607:0:14386:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9638832d3000/0x8da3486b955f4139 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366716.793703:0:14386:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9638b720c600/0x8da3486b955f4108 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x8da3486b955f4101 expref: 12 pid: 14364 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366716.793714:0:14386:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9638b720c600/0x8da3486b955f4108 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x8da3486b955f4101 expref: 12 pid: 14364 timeout: 392 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789366716.793802:0:14386:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9638b6d56a00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14386:1876286758792960:0@lo:104: 00000100:00100000:3.0:1789366716.793852:0:14386:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789366716.793971:0:14386:0:(client.c:2716:ptlrpc_set_wait()) set ffff96388a34d000 going to sleep for 11 seconds 00000100:00100000:2.0:1789366716.794023:0:14353:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286758792960 00000100:00100000:2.0:1789366716.794029:0:14353:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286758792960 00000100:00100000:2.0:1789366716.794143:0:14353:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789366716.794150:0:14353:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638b6d57800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:987e24be-cce8-4f54-8344-02fd27f3b2a2+3:14386:x1876286758792960:12345-0@lo:104: 00010000:00010000:2.0:1789366716.794161:0:14353:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.123@tcp lock: ffff9638832d2800/0x8da3486b955f4101 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x8da3486b955f4108 expref: -99 pid: 14352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366716.794237:0:14353:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1789366716.794243:0:14353:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638b6d57800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:987e24be-cce8-4f54-8344-02fd27f3b2a2+3:14386:x1876286758792960:12345-0@lo:104: Request processed in 94us (391us total) trans 0 rc 0/0 00000100:00100000:2.0:1789366716.794250:0:14353:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:1.0:1789366716.794296:0:14359:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789366716.794301:0:14359:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.123@tcp lock: ffff9638832d2800/0x8da3486b955f4101 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x8da3486b955f4108 expref: -99 pid: 14352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366716.794307:0:14359:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9638832d2800 already unused, calling callback (ffffffffc1cc7c20) 10000000:00010000:1.0:1789366716.794310:0:14359:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.123@tcp lock: ffff9638832d2800/0x8da3486b955f4101 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x8da3486b955f4108 expref: -99 pid: 14352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366716.794316:0:14359:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.123@tcp lock: ffff9638832d2800/0x8da3486b955f4101 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x8da3486b955f4108 expref: -99 pid: 14352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789366716.794321:0:14359:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.123@tcp lock: ffff9638832d2800/0x8da3486b955f4101 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x8da3486b955f4108 expref: -99 pid: 14352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789366716.794324:0:14359:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1789366716.794376:0:14359:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.123@tcp lock: ffff9638832d2800/0x8da3486b955f4101 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8da3486b955f4108 expref: -99 pid: 14352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366716.794385:0:14359:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789366716.794402:0:14359:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.123@tcp lock: ffff9638832d2800/0x8da3486b955f4101 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8da3486b955f4108 expref: -99 pid: 14352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366716.794407:0:14359:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.123@tcp lock: ffff9638832d2800/0x8da3486b955f4101 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8da3486b955f4108 expref: -99 pid: 14352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366716.794425:0:14359:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789366716.794427:0:14359:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789366716.794429:0:14359:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789366716.794436:0:14386:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9638b6d56a00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14386:1876286758792960:0@lo:104: 00010000:00010000:0.0:1789366716.794456:0:14386:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9638832d3000/0x8da3486b955f4139 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789366716.794537:0:3287:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789366716.794547:0:3287:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96388327f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:987e24be-cce8-4f54-8344-02fd27f3b2a2:3287:1876286758793088:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789366716.794572:0:3287:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789366716.794653:0:14355:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286758793088 00000100:00100000:1.0:1789366716.794657:0:14355:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286758793088 00010000:00010000:1.0:1789366716.794670:0:14355:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9638b720c600/0x8da3486b955f4108 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8da3486b955f4101 expref: 13 pid: 14364 timeout: 392 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789366716.794692:0:14355:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789366716.794698:0:14355:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638aef24000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:987e24be-cce8-4f54-8344-02fd27f3b2a2+13:3287:x1876286758793088:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789366716.794706:0:14355:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789366716.794709:0:14355:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9638b720c600/0x8da3486b955f4108 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8da3486b955f4101 expref: 13 pid: 14364 timeout: 392 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366716.794742:0:14355:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9638b720c600/0x8da3486b955f4108 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x8da3486b955f4101 expref: 13 pid: 14364 timeout: 392 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366716.794753:0:14355:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9638b720c600/0x8da3486b955f4108 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x8da3486b955f4101 expref: 13 pid: 14364 timeout: 392 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366716.794762:0:14355:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9638832d3000/0x8da3486b955f4139 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366716.794775:0:14355:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9638832d3000/0x8da3486b955f4139 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1789366716.794784:0:14355:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001215426s 00010000:00010000:1.0:1789366716.794787:0:14355:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9638832d3000/0x8da3486b955f4139 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366716.794791:0:14355:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9638832d3000/0x8da3486b955f4139 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366716.794796:0:14355:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9638832d3000/0x8da3486b955f4139 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366716.794800:0:14355:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9638832d3000/0x8da3486b955f4139 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366716.794803:0:14355:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9638832d3000 already unused, calling callback (ffffffffc16df520) 00010000:00010000:1.0:1789366716.794805:0:14355:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9638832d3000/0x8da3486b955f4139 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366716.794810:0:14355:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9638832d3000/0x8da3486b955f4139 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366716.794818:0:14355:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9638832d3000/0x8da3486b955f4139 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366716.794823:0:14355:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789366716.794845:0:14355:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638aef24000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:987e24be-cce8-4f54-8344-02fd27f3b2a2+12:3287:x1876286758793088:12345-0@lo:103:ldlm_bl.0 Request processed in 148us (272us total) trans 0 rc 0/0 00000100:00100000:1.0:1789366716.794849:0:14355:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:1.0:1789366716.794867:0:14386:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9638832d3000/0x8da3486b955f4139 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366716.794872:0:14386:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9638832d3000/0x8da3486b955f4139 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366716.794878:0:14386:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9638832d3000/0x8da3486b955f4139 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789366716.794948:0:3287:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96388327f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:987e24be-cce8-4f54-8344-02fd27f3b2a2:3287:1876286758793088:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789366716.799527:0:14363:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963785843c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:987e24be-cce8-4f54-8344-02fd27f3b2a2+11:14352:x1876286758792832:12345-0@lo:253:mount.lustre.0 Request processed in 37503us (37584us total) trans 0 rc 0/0 00000100:00100000:2.0:1789366716.799543:0:14363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1789366716.799651:0:14352:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96378749ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:987e24be-cce8-4f54-8344-02fd27f3b2a2:14352:1876286758792832:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1789366716.799681:0:14352:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:0.0:1789366716.799685:0:14352:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1789366716.799686:0:14352:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1789366716.799687:0:14352:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789366716.799688:0:14352:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789366716.799690:0:14352:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789366716.799691:0:14352:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789366716.799692:0:14352:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1789366716.799694:0:14352:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1789366716.799696:0:14352:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789366716.799697:0:14352:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1789366716.799714:0:14352:0:(tgt_mount.c:2698:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:1.0:1789366716.803364:0:14352:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/8/4) registered 00080000:10000000:1.0:1789366716.803522:0:14352:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:1.0:1789366716.803814:0:14352:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00080000:10000000:1.0:1789366716.803957:0:14352:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:1.0:1789366716.804205:0:14352:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/8/4) registered 00080000:10000000:1.0:1789366716.804356:0:14352:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00080000:10000000:1.0:1789366716.805012:0:14352:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/8/4) registered 00080000:10000000:1.0:1789366716.805160:0:14352:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8/1) registered 00080000:10000000:1.0:1789366716.805409:0:14352:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/8/4) registered 00080000:10000000:1.0:1789366716.805650:0:14352:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8/1) registered 00080000:10000000:1.0:1789366716.805930:0:14352:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xf:0x0] (8/8/4) registered 00080000:10000000:1.0:1789366716.806080:0:14352:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8/1) registered 00000020:00080000:1.0:1789366716.827316:0:14352:0:(update_trans.c:1496:distribute_txn_commit_batchid_init()) lustre-MDT0000: committed batchid 8 00000040:01000000:1.0:1789366716.827848:0:14352:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000020:00080000:2.0:1789366716.828001:0:14409:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 8 00000020:00080000:2.0:1789366716.828006:0:14409:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000040:01000000:1.0:1789366716.828129:0:14410:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:00080000:1.0:1789366716.828197:0:14410:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:01000000:2.0:1789366716.829946:0:14352:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:2.0:1789366716.830072:0:14352:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789366716.831428:0:14410:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:1.0:1789366716.831482:0:14410:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00080000:1.0:1789366716.831484:0:14410:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00000004:00000080:2.0:1789366716.831942:0:14352:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:2.0:1789366716.831959:0:14352:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:2.0:1789366716.832154:0:14352:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1789366716.833282:0:14352:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:2.0:1789366716.834030:0:14352:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:2.0:1789366716.834065:0:14352:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:2.0:1789366716.834655:0:14352:0:(llog_cat.c:403:llog_cat_set_first_idx()) catlog [0xa:0x7:0x0] first idx 0, last_idx 1 00080000:10000000:2.0:1789366716.835766:0:14352:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x36:0x0] (8/8/4) registered 00000001:00000004:2.0:1789366716.841225:0:14352:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000001:00080000:1.0:1789366716.876872:0:14352:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:1.0:1789366716.876901:0:14352:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffa15081c8b988 00100000:10000000:1.0:1789366716.876918:0:14352:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:2.0:1789366716.877300:0:14352:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1789366716.877313:0:14352:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.123@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1789366716.877327:0:14352:0:(tgt_mount.c:2464:server_fill_super_common()) Server sb, dev=45 00000080:00000004:2.0:1789366716.877344:0:14352:0:(super25.c:182:lustre_fill_super()) lustre-mdt1/mdt1: Mount complete 00010000:00010000:0.0:1789366717.625005:0:14358:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1789366717.817022:0:14367:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1789366717.817028:0:14367:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff963888959000 from 6 10000000:01000000:2.0:1789366717.817033:0:14367:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1789366717.817075:0:14367:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.123@tcp lock: ffff9638902c9600/0x8da3486b955f4140 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366717.817086:0:14367:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.123@tcp lock: ffff9638902c9600/0x8da3486b955f4140 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366717.817098:0:14367:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.123@tcp lock: ffff9638902c9600/0x8da3486b955f4140 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789366717.817122:0:14367:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9638aef26300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:987e24be-cce8-4f54-8344-02fd27f3b2a2:14367:1876286758793216:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789366717.817187:0:14367:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789366717.817244:0:14367:0:(client.c:2716:ptlrpc_set_wait()) set ffff963885b879c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789366717.817270:0:14364:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286758793216 00000100:00100000:3.0:1789366717.817280:0:14364:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286758793216 00000100:00100000:3.0:1789366717.817332:0:14364:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1789366717.817342:0:14364:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638987e7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:987e24be-cce8-4f54-8344-02fd27f3b2a2+11:14367:x1876286758793216:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789366717.817357:0:14364:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789366717.817371:0:14364:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9638832d3600/0x8da3486b955f4147 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x8da3486b955f4140 expref: -99 pid: 14364 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366717.817397:0:14364:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9638832d3600/0x8da3486b955f4147 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8da3486b955f4140 expref: 12 pid: 14364 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366717.817409:0:14364:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9638832d3600/0x8da3486b955f4147 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8da3486b955f4140 expref: 12 pid: 14364 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366717.817418:0:14364:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9638832d3600, rc 0) 00000100:00100000:3.0:1789366717.817471:0:14364:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638987e7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:987e24be-cce8-4f54-8344-02fd27f3b2a2+12:14367:x1876286758793216:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 131us (284us total) trans 0 rc 0/0 00000100:00100000:3.0:1789366717.817478:0:14364:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1789366717.817802:0:14367:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9638aef26300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:987e24be-cce8-4f54-8344-02fd27f3b2a2:14367:1876286758793216:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789366717.817816:0:14367:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.123@tcp lock: ffff9638902c9600/0x8da3486b955f4140 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8da3486b955f4147 expref: -99 pid: 14367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366717.817837:0:14367:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.123@tcp lock: ffff9638902c9600/0x8da3486b955f4140 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x8da3486b955f4147 expref: -99 pid: 14367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789366717.817940:0:14367:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9638aef26300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:987e24be-cce8-4f54-8344-02fd27f3b2a2:14367:1876286758793344:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1789366717.818031:0:14367:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789366717.818061:0:14367:0:(client.c:2716:ptlrpc_set_wait()) set ffff963885b879c0 going to sleep for 11 seconds 00000040:00080000:1.0:1789366717.818330:0:14406:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1789366717.818335:0:14406:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000100:00100000:3.0:1789366717.818886:0:14363:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286758793344 00000100:00100000:3.0:1789366717.818894:0:14363:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286758793344 00000100:00100000:3.0:1789366717.818934:0:14363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1789366717.818944:0:14363:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638987e6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:987e24be-cce8-4f54-8344-02fd27f3b2a2+12:14367:x1876286758793344:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:3.0:1789366717.819602:0:14363:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1789366717.819621:0:14363:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1789366717.819639:0:14363:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 6 00000100:00100000:3.0:1789366717.819765:0:14363:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638987e6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:987e24be-cce8-4f54-8344-02fd27f3b2a2+12:14367:x1876286758793344:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 822us (1732us total) trans 0 rc 0/0 00000100:00100000:3.0:1789366717.819773:0:14363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000040:00080000:1.0:1789366717.819783:0:14406:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:1.0:1789366717.819789:0:14406:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1789366717.819825:0:14367:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9638aef26300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:987e24be-cce8-4f54-8344-02fd27f3b2a2:14367:1876286758793344:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1789366717.819881:0:14367:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.123@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1789366717.819891:0:14367:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.123@tcp lock: ffff9638902c9600/0x8da3486b955f4140 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8da3486b955f4147 expref: -99 pid: 14367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366717.819901:0:14367:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.123@tcp lock: ffff9638902c9600/0x8da3486b955f4140 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8da3486b955f4147 expref: -99 pid: 14367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366718.648921:0:14359:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1789366718.841187:0:14406:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1789366718.841210:0:14406:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1789366718.841250:0:14406:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:1.0:1789366718.841258:0:14406:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:3.0:1789366719.675823:0:14358:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1789366719.742228:0:14654:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg223-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:1.0:1789366720.698627:0:14359:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1789366721.693239:0:14804:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fff7fbe23c0 20000000:00000080:0.0:1789366721.693257:0:14804:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff96388564cc00 uarg=0000000000000000 20000000:01000000:0.0:1789366721.693290:0:14804:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:0.0:1789366721.693298:0:14804:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:0.0:1789366721.693307:0:14804:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:3.0:1789366721.696810:0:14805:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 2 count 10 20000000:00000400:1.0:1789366721.696960:0:14804:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 10000000:01000000:1.0:1789366721.706282:0:14804:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1789366721.706315:0:14804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9638b6ce2200/0x8da3486b955f414e lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366721.706334:0:14804:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9638b720ca00/0x8da3486b955f4116 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8da3486b955f410f expref: 11 pid: 14364 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366721.706343:0:14804:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9638b6ce2200/0x8da3486b955f414e lrc: 4/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366721.706389:0:14804:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9638b720ca00/0x8da3486b955f4116 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x8da3486b955f410f expref: 11 pid: 14364 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366721.706408:0:14804:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9638b720ca00/0x8da3486b955f4116 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x8da3486b955f410f expref: 11 pid: 14364 timeout: 397 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789366721.706549:0:14804:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96388327ea00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:14804:1876286758793472:0@lo:104: 00000100:00100000:1.0:1789366721.706638:0:14804:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789366721.706715:0:14804:0:(client.c:2716:ptlrpc_set_wait()) set ffff9638bffac240 going to sleep for 11 seconds 00000100:00100000:3.0:1789366721.706828:0:14354:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286758793472 00000100:00100000:3.0:1789366721.706838:0:14354:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286758793472 00000100:00100000:3.0:1789366721.706892:0:14354:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789366721.706903:0:14354:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96388327ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:987e24be-cce8-4f54-8344-02fd27f3b2a2+3:14804:x1876286758793472:12345-0@lo:104: 00010000:00010000:3.0:1789366721.706916:0:14354:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.123@tcp lock: ffff9638832d2a00/0x8da3486b955f410f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x8da3486b955f4116 expref: -99 pid: 14352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366721.706983:0:14354:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1789366721.706989:0:14354:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96388327ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:987e24be-cce8-4f54-8344-02fd27f3b2a2+3:14804:x1876286758793472:12345-0@lo:104: Request processed in 89us (352us total) trans 0 rc 0/0 00000100:00100000:3.0:1789366721.706997:0:14354:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00010000:3.0:1789366721.707019:0:14358:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789366721.707026:0:14358:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.123@tcp lock: ffff9638832d2a00/0x8da3486b955f410f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x8da3486b955f4116 expref: -99 pid: 14352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366721.707050:0:14358:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9638832d2a00 already unused, calling callback (ffffffffc1cc7c20) 10000000:00010000:3.0:1789366721.707054:0:14358:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.123@tcp lock: ffff9638832d2a00/0x8da3486b955f410f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x8da3486b955f4116 expref: -99 pid: 14352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366721.707063:0:14358:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.123@tcp lock: ffff9638832d2a00/0x8da3486b955f410f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x8da3486b955f4116 expref: -99 pid: 14352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789366721.707070:0:14358:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.123@tcp lock: ffff9638832d2a00/0x8da3486b955f410f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x8da3486b955f4116 expref: -99 pid: 14352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789366721.707076:0:14358:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1789366721.707108:0:14358:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.123@tcp lock: ffff9638832d2a00/0x8da3486b955f410f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8da3486b955f4116 expref: -99 pid: 14352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366721.707115:0:14358:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789366721.707135:0:14358:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.123@tcp lock: ffff9638832d2a00/0x8da3486b955f410f lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8da3486b955f4116 expref: -99 pid: 14352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366721.707143:0:14358:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.123@tcp lock: ffff9638832d2a00/0x8da3486b955f410f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8da3486b955f4116 expref: -99 pid: 14352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366721.707161:0:14358:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789366721.707163:0:14358:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789366721.707165:0:14358:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789366721.707172:0:3286:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789366721.707282:0:3286:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9638b6d54380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:987e24be-cce8-4f54-8344-02fd27f3b2a2:3286:1876286758793600:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789366721.707315:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789366721.707404:0:14357:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286758793600 00000100:00100000:3.0:1789366721.707409:0:14357:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286758793600 00010000:00010000:3.0:1789366721.707433:0:14357:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9638b720ca00/0x8da3486b955f4116 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8da3486b955f410f expref: 12 pid: 14364 timeout: 397 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789366721.707476:0:14357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789366721.707484:0:14357:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638b6d57480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:987e24be-cce8-4f54-8344-02fd27f3b2a2+12:3286:x1876286758793600:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789366721.707668:0:14357:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789366721.707674:0:14357:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9638b720ca00/0x8da3486b955f4116 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8da3486b955f410f expref: 12 pid: 14364 timeout: 397 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366721.707686:0:14357:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9638b720ca00/0x8da3486b955f4116 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x8da3486b955f410f expref: 12 pid: 14364 timeout: 397 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366721.707703:0:14357:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9638b6ce2200/0x8da3486b955f414e lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366721.707711:0:14357:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9638b6ce2200/0x8da3486b955f414e lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366721.707750:0:14357:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9638b6ce2200/0x8da3486b955f414e lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366721.707757:0:14357:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9638b6ce2200/0x8da3486b955f414e lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366721.707764:0:14357:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9638b6ce2200/0x8da3486b955f414e lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366721.707772:0:14357:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9638b6ce2200/0x8da3486b955f414e lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366721.707778:0:14357:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9638b6ce2200 already unused, calling callback (ffffffffc16df520) 00010000:00010000:3.0:1789366721.707782:0:14357:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9638b6ce2200/0x8da3486b955f414e lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366721.707796:0:14357:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9638b6ce2200/0x8da3486b955f414e lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366721.707805:0:14357:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9638b6ce2200/0x8da3486b955f414e lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366721.707816:0:14357:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789366721.707858:0:14357:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638b6d57480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:987e24be-cce8-4f54-8344-02fd27f3b2a2+12:3286:x1876286758793600:12345-0@lo:103:ldlm_bl.0 Request processed in 375us (543us total) trans 0 rc 0/0 00000100:00100000:3.0:1789366721.707865:0:14357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789366721.708013:0:3286:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9638b6d54380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:987e24be-cce8-4f54-8344-02fd27f3b2a2:3286:1876286758793600:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789366721.708071:0:14804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9638b720ca00/0x8da3486b955f4116 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x8da3486b955f410f expref: 11 pid: 14364 timeout: 397 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789366721.708089:0:14804:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96388327ea00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:14804:1876286758793472:0@lo:104: 00010000:00010000:1.0:1789366721.708103:0:14804:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9638b6ce2200/0x8da3486b955f414e lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366721.708112:0:14804:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9638b6ce2200/0x8da3486b955f414e lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366721.708118:0:14804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9638b6ce2200/0x8da3486b955f414e lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366721.708123:0:14804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9638b6ce2200/0x8da3486b955f414e lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366721.721856:0:14359:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1789366721.975916:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789366721.975933:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1789366721.975937:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789366721.975940:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1789366721.975942:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1789366721.975946:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1789366721.975950:0:8:0:(import.c:65:import_set_state_nolock()) ffff96388497c000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1789366721.975966:0:8:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff96388497c000 using connection 192.168.202.123@tcp/0@lo 00000100:00100000:0.0:1789366721.976000:0:8:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff96378749ad80 x1876286758793728/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1789366721.976175:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96378749ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3283:1876286758793728:0@lo:38:kworker.0 00000100:00100000:2.0:1789366721.976240:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789366721.977246:0:14372:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286758793728 00000100:00100000:0.0:1789366721.977257:0:14372:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286758793728 00000100:00100000:0.0:1789366721.977293:0:14372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789366721.977301:0:14372:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638aef24700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3283:x1876286758793728:12345-0@lo:38:kworker.0 00010000:00080000:0.0:1789366721.977338:0:14372:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 297 last 0 00000020:00000080:0.0:1789366721.977371:0:14372:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0x8da3486b955f4155 00000004:00100000:0.0:1789366721.977387:0:14372:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1789366721.977520:0:14372:0:(import.c:65:import_set_state_nolock()) ffff96389050e800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789366721.977595:0:14372:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638aef24700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3283:x1876286758793728:12345-0@lo:38:kworker.0 Request processed in 284us (1345us total) trans 0 rc 0/0 00000100:00100000:0.0:1789366721.977603:0:14372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1789366721.982816:0:3283:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff96378749ad80 x1876286758793728/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789366731 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1789366721.982838:0:3283:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 2 00000100:00080000:2.0:1789366721.982847:0:3283:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:2.0:1789366721.982853:0:3283:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1789366721.982857:0:3283:0:(import.c:65:import_set_state_nolock()) ffff96388497c000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1789366721.982864:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96378749ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3283:1876286758793728:0@lo:38:kworker.0 00010000:00010000:3.0:1789366722.744104:0:14358:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1789366723.575812:0:14367:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1789366723.575819:0:14367:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff963888959000 from 10 10000000:01000000:3.0:1789366723.575825:0:14367:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1789366723.575866:0:14367:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.123@tcp lock: ffff9638832d2000/0x8da3486b955f415c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366723.575878:0:14367:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.123@tcp lock: ffff9638832d2000/0x8da3486b955f415c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366723.575889:0:14367:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.123@tcp lock: ffff9638832d2000/0x8da3486b955f415c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789366723.575923:0:14367:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9638b6d54000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:987e24be-cce8-4f54-8344-02fd27f3b2a2:14367:1876286758793856:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789366723.575980:0:14367:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789366723.576064:0:14367:0:(client.c:2716:ptlrpc_set_wait()) set ffff96388a34d0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789366723.577534:0:14365:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286758793856 00000100:00100000:0.0:1789366723.577551:0:14365:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286758793856 00000100:00100000:0.0:1789366723.577615:0:14365:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1789366723.577626:0:14365:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638987e6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:987e24be-cce8-4f54-8344-02fd27f3b2a2+11:14367:x1876286758793856:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789366723.577640:0:14365:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789366723.577656:0:14365:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9638b720d200/0x8da3486b955f4163 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x8da3486b955f415c expref: -99 pid: 14365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366723.577679:0:14365:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9638b720d200/0x8da3486b955f4163 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8da3486b955f415c expref: 12 pid: 14365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366723.577690:0:14365:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9638b720d200/0x8da3486b955f4163 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8da3486b955f415c expref: 12 pid: 14365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366723.577698:0:14365:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9638b720d200, rc 0) 00000100:00100000:0.0:1789366723.577774:0:14365:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638987e6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:987e24be-cce8-4f54-8344-02fd27f3b2a2+12:14367:x1876286758793856:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 150us (1793us total) trans 0 rc 0/0 00000100:00100000:0.0:1789366723.577782:0:14365:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1789366723.577829:0:14367:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9638b6d54000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:987e24be-cce8-4f54-8344-02fd27f3b2a2:14367:1876286758793856:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789366723.577845:0:14367:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.123@tcp lock: ffff9638832d2000/0x8da3486b955f415c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8da3486b955f4163 expref: -99 pid: 14367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366723.577855:0:14367:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.123@tcp lock: ffff9638832d2000/0x8da3486b955f415c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x8da3486b955f4163 expref: -99 pid: 14367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789366723.577921:0:14367:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff963787498a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:987e24be-cce8-4f54-8344-02fd27f3b2a2:14367:1876286758793984:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789366723.577948:0:14367:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789366723.577972:0:14367:0:(client.c:2716:ptlrpc_set_wait()) set ffff96388347a900 going to sleep for 11 seconds 00000100:00100000:0.0:1789366723.577984:0:14364:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286758793984 00000100:00100000:0.0:1789366723.577993:0:14364:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286758793984 00000100:00100000:0.0:1789366723.578013:0:14364:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1789366723.578018:0:14364:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638987e6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:987e24be-cce8-4f54-8344-02fd27f3b2a2+12:14367:x1876286758793984:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789366723.578245:0:14364:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638987e6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:987e24be-cce8-4f54-8344-02fd27f3b2a2+12:14367:x1876286758793984:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 225us (295us total) trans 0 rc 0/0 00000100:00100000:0.0:1789366723.578252:0:14364:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1789366723.578281:0:14367:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff963787498a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:987e24be-cce8-4f54-8344-02fd27f3b2a2:14367:1876286758793984:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789366723.578319:0:14367:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff963787498a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:987e24be-cce8-4f54-8344-02fd27f3b2a2:14367:1876286758794112:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789366723.578355:0:14367:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789366723.578367:0:14367:0:(client.c:2716:ptlrpc_set_wait()) set ffff96388347a900 going to sleep for 11 seconds 00000100:00100000:0.0:1789366723.578378:0:14364:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286758794112 00000100:00100000:0.0:1789366723.578381:0:14364:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286758794112 00000100:00100000:0.0:1789366723.578400:0:14364:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1789366723.578406:0:14364:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638987e5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:987e24be-cce8-4f54-8344-02fd27f3b2a2+12:14367:x1876286758794112:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789366723.578535:0:14364:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638987e5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:987e24be-cce8-4f54-8344-02fd27f3b2a2+12:14367:x1876286758794112:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 129us (180us total) trans 0 rc 0/0 00000100:00100000:0.0:1789366723.578542:0:14364:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1789366723.578589:0:14367:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff963787498a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:987e24be-cce8-4f54-8344-02fd27f3b2a2:14367:1876286758794112:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1789366723.579271:0:14936:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:0.0:1789366723.579316:0:14367:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:0.0:1789366723.579328:0:14367:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.123@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1789366723.579335:0:14367:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.123@tcp lock: ffff9638832d2000/0x8da3486b955f415c lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8da3486b955f4163 expref: -99 pid: 14367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366723.579345:0:14367:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.123@tcp lock: ffff9638832d2000/0x8da3486b955f415c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8da3486b955f4163 expref: -99 pid: 14367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366723.771121:0:14359:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1789366724.705399:0:15053:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1789366724.705402:0:15053:0:(obd_mount.c:926:lmd_print()) device: lustre-ost1/ost1 00000080:01200004:2.0:1789366724.705472:0:15053:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9638a739f800 00000020:01000004:2.0:1789366724.705483:0:15053:0:(tgt_mount.c:2506:osd_start()) Attempting to start lustre-OST0000, type=osd-zfs, lsifl=200002, mountfl=0 00000020:01000004:2.0:1789366724.705493:0:15053:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-zfs) 00000020:00000080:2.0:1789366724.705504:0:15053:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff9638986a0000) 00000020:00000080:2.0:1789366724.705515:0:15053:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type osd-zfs with refcount 2 00100000:10000000:2.0:1789366724.716129:0:15053:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:2.0:1789366724.716412:0:15053:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0000: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:2.0:1789366724.717165:0:15053:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:2.0:1789366724.717402:0:15053:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00100000:10000000:2.0:1789366724.717598:0:15053:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0000: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:2.0:1789366724.718132:0:15053:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled lustre-client under 403: rc = 0 00100000:10000000:2.0:1789366724.718228:0:15053:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled params under 403: rc = 0 00100000:10000000:2.0:1789366724.718327:0:15053:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled lustre-OST0000 under 403: rc = 0 00100000:10000000:2.0:1789366724.718785:0:15053:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x20000 under 647: rc = 0 00100000:10000000:2.0:1789366724.719139:0:15053:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x20000-OST0000 under 647: rc = 0 00100000:10000000:2.0:1789366724.719383:0:15053:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x2020000-OST0000 under 647: rc = 0 00100000:10000000:2.0:1789366724.719633:0:15053:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x2020000 under 647: rc = 0 00100000:10000000:2.0:1789366724.719933:0:15053:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x1020000-OST0000 under 647: rc = 0 00100000:10000000:2.0:1789366724.720164:0:15053:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x1020000 under 647: rc = 0 00000020:00000080:2.0:1789366724.720634:0:15053:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:2.0:1789366724.720646:0:15053:0:(osd_handler.c:1574:osd_obd_connect()) connect #0 00000020:00000080:2.0:1789366724.720655:0:15053:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x8da3486b955f4171 00000020:01000004:2.0:1789366724.720662:0:15053:0:(tgt_mount.c:2591:server_fill_super()) Found service lustre-OST0000 on device lustre-ost1/ost1 00000020:01000004:2.0:1789366724.720679:0:15053:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.202.123@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1789366724.720682:0:15053:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.202.123@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1789366724.720686:0:15053:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-OST0000 00000020:01000004:2.0:1789366724.720689:0:15053:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:2.0:1789366724.720697:0:15053:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff9638986a4d40) 00000020:00000080:2.0:1789366724.720703:0:15053:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type ost with refcount 2 00000100:00100000:2.0:1789366724.723693:0:15053:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789366724.723886:0:15053:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:2.0:1789366724.723893:0:15053:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:2.0:1789366724.727245:0:15053:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:2.0:1789366724.727257:0:15053:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:2.0:1789366724.727520:0:15053:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:2.0:1789366724.727528:0:15053:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:0.0:1789366724.728702:0:15053:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1789366724.728929:0:15053:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:0.0:1789366724.728934:0:15053:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:0.0:1789366724.729341:0:15053:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:0.0:1789366724.729349:0:15053:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:2.0:1789366724.740832:0:15053:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789366724.741240:0:15053:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:2.0:1789366724.741249:0:15053:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:2.0:1789366724.742059:0:15053:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:2.0:1789366724.742066:0:15053:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:0.0:1789366724.742578:0:15053:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:0.0:1789366724.742585:0:15053:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:2.0:1789366724.744010:0:15053:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789366724.744134:0:15053:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:2.0:1789366724.744137:0:15053:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:2.0:1789366724.744616:0:15053:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:2.0:1789366724.744621:0:15053:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:2.0:1789366724.764934:0:15053:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789366724.765148:0:15053:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:2.0:1789366724.765155:0:15053:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:2.0:1789366724.768257:0:15053:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:2.0:1789366724.768275:0:15053:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:2.0:1789366724.768997:0:15053:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:2.0:1789366724.769023:0:15053:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost1/ost1 10000000:01000000:2.0:1789366724.769029:0:15053:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.123@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:2.0:1789366724.776241:0:15053:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.123@tcp ctxt 0 is initialized 00000020:01000004:2.0:1789366724.776276:0:15053:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.202.123@tcp, index=0000, flags=0x20002 00000020:01000004:2.0:1789366724.776280:0:15053:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1789366724.776282:0:15053:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1789366724.776283:0:15053:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789366724.776284:0:15053:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789366724.776285:0:15053:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789366724.776287:0:15053:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789366724.776288:0:15053:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1789366724.776289:0:15053:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789366724.776291:0:15053:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1789366724.776294:0:15053:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020002 00000020:01000004:2.0:1789366724.776296:0:15053:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1789366724.776297:0:15053:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1789366724.776298:0:15053:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789366724.776299:0:15053:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789366724.776301:0:15053:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789366724.776302:0:15053:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789366724.776303:0:15053:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1789366724.776304:0:15053:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789366724.776308:0:15053:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1789366724.776338:0:15053:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:2.0:1789366724.776358:0:15053:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9638aef27100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:987e24be-cce8-4f54-8344-02fd27f3b2a2:15053:1876286758794240:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1789366724.776429:0:15053:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789366724.776545:0:14364:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286758794240 00000100:00100000:0.0:1789366724.776553:0:14364:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286758794240 00000100:00100000:0.0:1789366724.776615:0:14364:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1789366724.776624:0:14364:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638987e7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:987e24be-cce8-4f54-8344-02fd27f3b2a2+12:15053:x1876286758794240:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1789366724.776662:0:14364:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:0.0:1789366724.776666:0:14364:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0000 is running on 0@lo 20000000:01000000:0.0:1789366724.776669:0:14364:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:2.0:1789366724.777229:0:15053:0:(client.c:2716:ptlrpc_set_wait()) set ffff963898937a80 going to sleep for 11 seconds 00000100:00100000:1.0:1789366724.782280:0:14364:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638987e7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:987e24be-cce8-4f54-8344-02fd27f3b2a2+12:15053:x1876286758794240:12345-0@lo:253:mount.lustre.0 Request processed in 5649us (5842us total) trans 0 rc 0/0 00000100:00100000:1.0:1789366724.782294:0:14364:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1789366724.782386:0:15053:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9638aef27100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:987e24be-cce8-4f54-8344-02fd27f3b2a2:15053:1876286758794240:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1789366724.782403:0:15053:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:2.0:1789366724.782406:0:15053:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1789366724.782408:0:15053:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1789366724.782409:0:15053:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789366724.782410:0:15053:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789366724.782411:0:15053:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789366724.782412:0:15053:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789366724.782414:0:15053:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1789366724.782416:0:15053:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789366724.782417:0:15053:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1789366724.782437:0:15053:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9638a739f800 from lustre-OST0000 10000000:01000000:2.0:1789366724.782466:0:15053:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:2.0:1789366724.782470:0:15053:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:2.0:1789366724.782476:0:15053:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff963882f5b380 local copy 00010000:00010000:2.0:1789366724.782486:0:15053:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.123@tcp lock: ffff9638832d2600/0x8da3486b955f4067 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x8da3486b955f406e expref: -99 pid: 14352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789366724.782746:0:15053:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9638aef27100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:987e24be-cce8-4f54-8344-02fd27f3b2a2:15053:1876286758794368:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789366724.782783:0:15053:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789366724.782824:0:15053:0:(client.c:2716:ptlrpc_set_wait()) set ffff963898937780 going to sleep for 11 seconds 00000100:00100000:3.0:1789366724.782889:0:14363:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286758794368 00000100:00100000:3.0:1789366724.782895:0:14363:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286758794368 00000100:00100000:3.0:1789366724.782988:0:14363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1789366724.782998:0:14363:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638987e4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:987e24be-cce8-4f54-8344-02fd27f3b2a2+12:15053:x1876286758794368:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789366724.783147:0:14363:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638987e4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:987e24be-cce8-4f54-8344-02fd27f3b2a2+12:15053:x1876286758794368:12345-0@lo:501:mount.lustre.0 Request processed in 150us (363us total) trans 0 rc -2/-2 00000100:00100000:3.0:1789366724.783153:0:14363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1789366724.783210:0:15053:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9638aef27100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:987e24be-cce8-4f54-8344-02fd27f3b2a2:15053:1876286758794368:0@lo:501:mount.lustre.0 10000000:01000000:2.0:1789366724.783222:0:15053:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.202.123@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:2.0:1789366724.783345:0:15053:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.202.123@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:2.0:1789366724.783352:0:15053:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.123@tcp lock: ffff9638832d2600/0x8da3486b955f4067 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x8da3486b955f406e expref: -99 pid: 14352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366724.783367:0:15053:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.123@tcp lock: ffff9638832d2600/0x8da3486b955f4067 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x8da3486b955f406e expref: -99 pid: 14352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789366724.783385:0:15053:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9638a739f800 10000000:01000000:2.0:1789366724.783390:0:15053:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1789366724.783394:0:15053:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff963882f5b380 10000000:01000000:2.0:1789366724.783396:0:15053:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:2.0:1789366724.783400:0:15053:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff963882f5b380 from 1 10000000:01000000:2.0:1789366724.783403:0:15053:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:2.0:1789366724.783424:0:15053:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.123@tcp lock: ffff9638902c9000/0x8da3486b955f417f lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366724.783431:0:15053:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.123@tcp lock: ffff9638902c9000/0x8da3486b955f417f lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366724.783439:0:15053:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.123@tcp lock: ffff9638902c9000/0x8da3486b955f417f lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789366724.783452:0:15053:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9638aef27100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:987e24be-cce8-4f54-8344-02fd27f3b2a2:15053:1876286758794496:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1789366724.783476:0:15053:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789366724.783551:0:15053:0:(client.c:2716:ptlrpc_set_wait()) set ffff963898937780 going to sleep for 11 seconds 00000100:00100000:1.0:1789366724.783597:0:14365:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286758794496 00000100:00100000:1.0:1789366724.783602:0:14365:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286758794496 00000100:00100000:1.0:1789366724.783624:0:14365:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1789366724.783631:0:14365:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638987e6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:987e24be-cce8-4f54-8344-02fd27f3b2a2+12:15053:x1876286758794496:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789366724.783640:0:14365:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789366724.783652:0:14365:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9638b6ce2c00/0x8da3486b955f4186 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x8da3486b955f417f expref: -99 pid: 14365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366724.783672:0:14365:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9638b6ce2c00/0x8da3486b955f4186 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8da3486b955f417f expref: 13 pid: 14365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366724.783693:0:14365:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9638b6ce2c00/0x8da3486b955f4186 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8da3486b955f417f expref: 13 pid: 14365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366724.783703:0:14365:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9638b6ce2c00, rc 0) 00000100:00100000:1.0:1789366724.783766:0:14365:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638987e6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:987e24be-cce8-4f54-8344-02fd27f3b2a2+13:15053:x1876286758794496:12345-0@lo:101:mount.lustre.0 Request processed in 136us (290us total) trans 0 rc 0/0 00000100:00100000:1.0:1789366724.783773:0:14365:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1789366724.783847:0:15053:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9638aef27100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:987e24be-cce8-4f54-8344-02fd27f3b2a2:15053:1876286758794496:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789366724.783859:0:15053:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.123@tcp lock: ffff9638902c9000/0x8da3486b955f417f lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8da3486b955f4186 expref: -99 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366724.783868:0:15053:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.123@tcp lock: ffff9638902c9000/0x8da3486b955f417f lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x8da3486b955f4186 expref: -99 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789366724.783893:0:15053:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.123@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:2.0:1789366724.783914:0:15053:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.123@tcp lock: ffff9638902c9000/0x8da3486b955f417f lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8da3486b955f4186 expref: -99 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366724.783921:0:15053:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.123@tcp lock: ffff9638902c9000/0x8da3486b955f417f lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8da3486b955f4186 expref: -99 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789366724.783927:0:15053:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:2.0:1789366724.783930:0:15053:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1789366724.783935:0:15053:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:2.0:1789366724.783937:0:15053:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:2.0:1789366724.783949:0:15053:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.123@tcp lock: ffff9638902c8400/0x8da3486b955f418d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366724.783957:0:15053:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.123@tcp lock: ffff9638902c8400/0x8da3486b955f418d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366724.783977:0:15053:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.123@tcp lock: ffff9638902c8400/0x8da3486b955f418d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789366724.783988:0:15053:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9638aef27100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:987e24be-cce8-4f54-8344-02fd27f3b2a2:15053:1876286758794624:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1789366724.784010:0:15053:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789366724.784028:0:15053:0:(client.c:2716:ptlrpc_set_wait()) set ffff963898937780 going to sleep for 11 seconds 00000100:00100000:1.0:1789366724.784083:0:14365:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286758794624 00000100:00100000:1.0:1789366724.784087:0:14365:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286758794624 00000100:00100000:1.0:1789366724.784103:0:14365:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1789366724.784109:0:14365:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638987e7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:987e24be-cce8-4f54-8344-02fd27f3b2a2+13:15053:x1876286758794624:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789366724.784115:0:14365:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789366724.784123:0:14365:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9638b6ce2800/0x8da3486b955f4194 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x8da3486b955f418d expref: -99 pid: 14365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366724.784136:0:14365:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9638b6ce2800/0x8da3486b955f4194 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8da3486b955f418d expref: 14 pid: 14365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366724.784143:0:14365:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9638b6ce2800/0x8da3486b955f4194 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8da3486b955f418d expref: 14 pid: 14365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366724.784150:0:14365:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9638b6ce2800, rc 0) 00000100:00100000:1.0:1789366724.784186:0:14365:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638987e7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:987e24be-cce8-4f54-8344-02fd27f3b2a2+14:15053:x1876286758794624:12345-0@lo:101:mount.lustre.0 Request processed in 77us (174us total) trans 0 rc 0/0 00000100:00100000:1.0:1789366724.784192:0:14365:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1789366724.784259:0:15053:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9638aef27100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:987e24be-cce8-4f54-8344-02fd27f3b2a2:15053:1876286758794624:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789366724.784270:0:15053:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.123@tcp lock: ffff9638902c8400/0x8da3486b955f418d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x8da3486b955f4194 expref: -99 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366724.784278:0:15053:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.123@tcp lock: ffff9638902c8400/0x8da3486b955f418d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x8da3486b955f4194 expref: -99 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1789366724.784892:0:15053:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:2.0:1789366724.785682:0:15053:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1789366724.785971:0:15053:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:2.0:1789366724.786015:0:15053:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:2.0:1789366724.786048:0:15053:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:2.0:1789366724.786094:0:15053:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:2.0:1789366724.786131:0:15053:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:2.0:1789366724.786166:0:15053:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:2.0:1789366724.786232:0:15053:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:2.0:1789366724.786239:0:15053:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:2.0:1789366724.786313:0:15053:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9638aef27100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:987e24be-cce8-4f54-8344-02fd27f3b2a2:15053:1876286758794752:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789366724.786376:0:15053:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789366724.786412:0:15053:0:(client.c:2716:ptlrpc_set_wait()) set ffff963898937d80 going to sleep for 11 seconds 00000100:00100000:0.0:1789366724.786515:0:14364:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286758794752 00000100:00100000:0.0:1789366724.786522:0:14364:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286758794752 00000100:00100000:0.0:1789366724.786558:0:14364:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1789366724.786578:0:14364:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638987e7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:987e24be-cce8-4f54-8344-02fd27f3b2a2+14:15053:x1876286758794752:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789366724.786897:0:14364:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638987e7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:987e24be-cce8-4f54-8344-02fd27f3b2a2+14:15053:x1876286758794752:12345-0@lo:501:mount.lustre.0 Request processed in 319us (520us total) trans 0 rc 0/0 00000100:00100000:0.0:1789366724.786905:0:14364:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1789366724.787177:0:15053:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9638aef27100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:987e24be-cce8-4f54-8344-02fd27f3b2a2:15053:1876286758794752:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789366724.787209:0:15053:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9638aef27100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:987e24be-cce8-4f54-8344-02fd27f3b2a2:15053:1876286758794880:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1789366724.787246:0:15053:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789366724.787275:0:15053:0:(client.c:2716:ptlrpc_set_wait()) set ffff963898937d80 going to sleep for 11 seconds 00000100:00100000:0.0:1789366724.787294:0:14364:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286758794880 00000100:00100000:0.0:1789366724.787300:0:14364:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286758794880 00000100:00100000:0.0:1789366724.787329:0:14364:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1789366724.787336:0:14364:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638987e5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:987e24be-cce8-4f54-8344-02fd27f3b2a2+14:15053:x1876286758794880:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1789366724.787631:0:14364:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638987e5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:987e24be-cce8-4f54-8344-02fd27f3b2a2+14:15053:x1876286758794880:12345-0@lo:503:mount.lustre.0 Request processed in 295us (384us total) trans 0 rc 0/0 00000100:00100000:0.0:1789366724.787648:0:14364:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1789366724.787816:0:15053:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9638aef27100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:987e24be-cce8-4f54-8344-02fd27f3b2a2:15053:1876286758794880:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1789366724.788773:0:15053:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1789366724.788830:0:15053:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9638aef27100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:987e24be-cce8-4f54-8344-02fd27f3b2a2:15053:1876286758795008:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789366724.788873:0:15053:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789366724.788967:0:15053:0:(client.c:2716:ptlrpc_set_wait()) set ffff963898937d80 going to sleep for 11 seconds 00000100:00100000:3.0:1789366724.790029:0:14363:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286758795008 00000100:00100000:3.0:1789366724.790038:0:14363:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286758795008 00000100:00100000:3.0:1789366724.790090:0:14363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1789366724.790099:0:14363:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638987e4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:987e24be-cce8-4f54-8344-02fd27f3b2a2+14:15053:x1876286758795008:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789366724.790476:0:14363:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638987e4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:987e24be-cce8-4f54-8344-02fd27f3b2a2+14:15053:x1876286758795008:12345-0@lo:502:mount.lustre.0 Request processed in 378us (1600us total) trans 0 rc 0/0 00000100:00100000:3.0:1789366724.790484:0:14363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1789366724.790575:0:15053:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9638aef27100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:987e24be-cce8-4f54-8344-02fd27f3b2a2:15053:1876286758795008:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1789366724.790899:0:15053:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:2.0:1789366724.790952:0:15053:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:2.0:1789366724.790998:0:15053:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:2.0:1789366724.791046:0:15053:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:2.0:1789366724.791083:0:15053:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:2.0:1789366724.791133:0:15053:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:2.0:1789366724.791201:0:15053:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:2.0:1789366724.791242:0:15053:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:2.0:1789366724.791277:0:15053:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 80 off9712 00000040:00080000:2.0:1789366724.791320:0:15053:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9936 00000040:00080000:2.0:1789366724.791610:0:15053:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].11, 224 off10160 00000040:00080000:2.0:1789366724.791657:0:15053:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].12, 120 off10280 00000100:00100000:2.0:1789366724.791695:0:15053:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9638aef27100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:987e24be-cce8-4f54-8344-02fd27f3b2a2:15053:1876286758795136:0@lo:502:mount.lustre.0 00010000:00010000:3.0:1789366724.791814:0:14358:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789366724.791975:0:15053:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789366724.792048:0:15053:0:(client.c:2716:ptlrpc_set_wait()) set ffff963898937d80 going to sleep for 11 seconds 00000100:00100000:0.0:1789366724.792084:0:14364:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286758795136 00000100:00100000:0.0:1789366724.792090:0:14364:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286758795136 00000100:00100000:0.0:1789366724.792171:0:14364:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1789366724.792181:0:14364:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638987e5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:987e24be-cce8-4f54-8344-02fd27f3b2a2+14:15053:x1876286758795136:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789366724.792403:0:14364:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638987e5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:987e24be-cce8-4f54-8344-02fd27f3b2a2+14:15053:x1876286758795136:12345-0@lo:502:mount.lustre.0 Request processed in 223us (427us total) trans 0 rc 0/0 00000100:00100000:0.0:1789366724.792410:0:14364:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1789366724.795781:0:15053:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9638aef27100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:987e24be-cce8-4f54-8344-02fd27f3b2a2:15053:1876286758795136:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1789366724.795958:0:15053:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].13, 224 off10504 00000040:00080000:2.0:1789366724.795975:0:15053:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 14 00000020:01000000:3.0:1789366724.799952:0:15067:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1789366724.799961:0:15067:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-ost1/ost1 00000020:00000080:3.0:1789366724.799967:0:15067:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789366724.799968:0:15067:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-OST0000 add ost 00000020:00000080:3.0:1789366724.799972:0:15067:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1789366724.799984:0:15067:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff963785d64d40) 00000020:00000080:3.0:1789366724.800002:0:15067:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type obdfilter with refcount 2 00000020:00000080:3.0:1789366724.800006:0:15067:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1789366724.800072:0:15067:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9638a739f800 from lustre-OST0000, refs=2 00080000:01000000:3.0:1789366724.800078:0:15067:0:(osd_handler.c:1574:osd_obd_connect()) connect #1 00000020:00000080:3.0:1789366724.800082:0:15067:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x8da3486b955f41a2 00010000:00010000:3.0:1789366724.803230:0:15067:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-2 is initialized 00000001:00000004:3.0:1789366724.805297:0:15067:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 4294967324 00080000:10000000:3.0:1789366724.807348:0:15067:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00000020:00000080:3.0:1789366724.809518:0:15067:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:3.0:1789366724.809531:0:15067:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789366724.809550:0:15067:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789366724.809552:0:15067:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-OST0000 add ost 00000020:01000000:3.0:1789366724.809555:0:15067:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1789366724.809558:0:15067:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #16 00000020:01000000:3.0:1789366724.809569:0:15067:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1789366724.809571:0:15067:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1789366724.809573:0:15067:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1789366724.809576:0:15067:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789366724.809577:0:15067:0:(obd_config.c:1563:class_process_config()) marker 16 (0x6) lustre sys.timeout 00000020:01000000:3.0:1789366724.809579:0:15067:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789366724.809582:0:15067:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789366724.809583:0:15067:0:(obd_config.c:1563:class_process_config()) marker 23 (0x1) lustre sys.timeout 00000020:00000080:3.0:1789366724.809586:0:15067:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1789366724.809588:0:15067:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1789366724.809590:0:15067:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789366724.809593:0:15067:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789366724.809594:0:15067:0:(obd_config.c:1563:class_process_config()) marker 23 (0x2) lustre sys.timeout 00000020:01000000:3.0:1789366724.809596:0:15067:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789366724.809599:0:15067:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789366724.809600:0:15067:0:(obd_config.c:1563:class_process_config()) marker 27 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1789366724.809602:0:15067:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:3.0:1789366724.809662:0:15067:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789366724.809665:0:15067:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789366724.809666:0:15067:0:(obd_config.c:1563:class_process_config()) marker 27 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1789366724.809670:0:15067:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 14 count 14 00000020:01000000:0.0:1789366724.810124:0:15053:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-13 (rc=0) 10000000:01000000:0.0:1789366724.810154:0:15053:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.123@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:0.0:1789366724.810169:0:15053:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.123@tcp lock: ffff9638902c8400/0x8da3486b955f418d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x8da3486b955f4194 expref: -99 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366724.810181:0:15053:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.123@tcp lock: ffff9638902c8400/0x8da3486b955f418d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x8da3486b955f4194 expref: -99 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789366724.810188:0:15053:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9638a739f800 from 1 10000000:01000000:0.0:1789366724.810192:0:15053:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1789366724.810228:0:15053:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.123@tcp lock: ffff9638b720c600/0x8da3486b955f41a9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366724.810235:0:15053:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.123@tcp lock: ffff9638b720c600/0x8da3486b955f41a9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366724.810248:0:15053:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.123@tcp lock: ffff9638b720c600/0x8da3486b955f41a9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789366724.810274:0:15053:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff963787498a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:987e24be-cce8-4f54-8344-02fd27f3b2a2:15053:1876286758795264:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1789366724.810358:0:15053:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789366724.810411:0:15053:0:(client.c:2716:ptlrpc_set_wait()) set ffff9638bffacc00 going to sleep for 11 seconds 00000100:00100000:3.0:1789366724.810479:0:14363:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286758795264 00000100:00100000:3.0:1789366724.810487:0:14363:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286758795264 00000100:00100000:3.0:1789366724.810537:0:14363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1789366724.810547:0:14363:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638987e4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:987e24be-cce8-4f54-8344-02fd27f3b2a2+14:15053:x1876286758795264:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789366724.810572:0:14363:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789366724.810585:0:14363:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9638832d3400/0x8da3486b955f41b0 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x8da3486b955f41a9 expref: -99 pid: 14363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366724.810610:0:14363:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9638832d3400/0x8da3486b955f41b0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8da3486b955f41a9 expref: 15 pid: 14363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366724.810630:0:14363:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9638832d3400/0x8da3486b955f41b0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8da3486b955f41a9 expref: 15 pid: 14363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366724.810640:0:14363:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9638832d3400, rc 0) 00000100:00100000:3.0:1789366724.810680:0:14363:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638987e4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:987e24be-cce8-4f54-8344-02fd27f3b2a2+15:15053:x1876286758795264:12345-0@lo:101:mount.lustre.0 Request processed in 135us (323us total) trans 0 rc 0/0 00000100:00100000:3.0:1789366724.810687:0:14363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1789366724.811985:0:15053:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff963787498a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:987e24be-cce8-4f54-8344-02fd27f3b2a2:15053:1876286758795264:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789366724.812006:0:15053:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.123@tcp lock: ffff9638b720c600/0x8da3486b955f41a9 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8da3486b955f41b0 expref: -99 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366724.812016:0:15053:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.123@tcp lock: ffff9638b720c600/0x8da3486b955f41a9 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x8da3486b955f41b0 expref: -99 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1789366724.812494:0:15053:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:0.0:1789366724.813087:0:15053:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1789366724.813317:0:15053:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:0.0:1789366724.813360:0:15053:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:0.0:1789366724.813419:0:15053:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:0.0:1789366724.813426:0:15053:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:0.0:1789366724.813487:0:15053:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff963787498a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:987e24be-cce8-4f54-8344-02fd27f3b2a2:15053:1876286758795392:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789366724.813544:0:15053:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789366724.813591:0:15053:0:(client.c:2716:ptlrpc_set_wait()) set ffff9638bffacc00 going to sleep for 11 seconds 00000100:00100000:1.0:1789366724.813678:0:14364:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286758795392 00000100:00100000:1.0:1789366724.813685:0:14364:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286758795392 00000100:00100000:1.0:1789366724.813754:0:14364:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1789366724.813763:0:14364:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638987e4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:987e24be-cce8-4f54-8344-02fd27f3b2a2+15:15053:x1876286758795392:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789366724.813946:0:14364:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638987e4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:987e24be-cce8-4f54-8344-02fd27f3b2a2+15:15053:x1876286758795392:12345-0@lo:501:mount.lustre.0 Request processed in 184us (401us total) trans 0 rc 0/0 00000100:00100000:1.0:1789366724.813953:0:14364:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1789366724.815883:0:15053:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff963787498a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:987e24be-cce8-4f54-8344-02fd27f3b2a2:15053:1876286758795392:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789366724.815933:0:15053:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff963787498a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:987e24be-cce8-4f54-8344-02fd27f3b2a2:15053:1876286758795520:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1789366724.815993:0:15053:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789366724.816036:0:15053:0:(client.c:2716:ptlrpc_set_wait()) set ffff9638bffacc00 going to sleep for 11 seconds 00000100:00100000:1.0:1789366724.816102:0:14365:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286758795520 00000100:00100000:1.0:1789366724.816108:0:14365:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286758795520 00000100:00100000:1.0:1789366724.816153:0:14365:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1789366724.816161:0:14365:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638af305850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:987e24be-cce8-4f54-8344-02fd27f3b2a2+15:15053:x1876286758795520:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1789366724.816339:0:14365:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638af305850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:987e24be-cce8-4f54-8344-02fd27f3b2a2+15:15053:x1876286758795520:12345-0@lo:503:mount.lustre.0 Request processed in 177us (345us total) trans 0 rc 0/0 00000100:00100000:1.0:1789366724.816347:0:14365:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1789366724.818440:0:15053:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff963787498a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:987e24be-cce8-4f54-8344-02fd27f3b2a2:15053:1876286758795520:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1789366724.819018:0:15053:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1789366724.819118:0:15053:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff963787498a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:987e24be-cce8-4f54-8344-02fd27f3b2a2:15053:1876286758795648:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789366724.819183:0:15053:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789366724.819234:0:15053:0:(client.c:2716:ptlrpc_set_wait()) set ffff963882b60780 going to sleep for 11 seconds 00000100:00100000:2.0:1789366724.819932:0:14363:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286758795648 00000100:00100000:2.0:1789366724.819940:0:14363:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286758795648 00000100:00100000:2.0:1789366724.820018:0:14363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1789366724.820028:0:14363:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638af304450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:987e24be-cce8-4f54-8344-02fd27f3b2a2+15:15053:x1876286758795648:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789366724.820226:0:14363:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638af304450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:987e24be-cce8-4f54-8344-02fd27f3b2a2+15:15053:x1876286758795648:12345-0@lo:502:mount.lustre.0 Request processed in 200us (1043us total) trans 0 rc 0/0 00000100:00100000:2.0:1789366724.820233:0:14363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1789366724.820318:0:15053:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff963787498a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:987e24be-cce8-4f54-8344-02fd27f3b2a2:15053:1876286758795648:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1789366724.820586:0:15053:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:0.0:1789366724.820642:0:15053:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:0.0:1789366724.820694:0:15053:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:0.0:1789366724.820766:0:15053:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:0.0:1789366724.820807:0:15053:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:0.0:1789366724.820854:0:15053:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:0.0:1789366724.820887:0:15053:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:0.0:1789366724.820917:0:15053:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000100:00100000:0.0:1789366724.820943:0:15053:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff963787498a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:987e24be-cce8-4f54-8344-02fd27f3b2a2:15053:1876286758795776:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789366724.820985:0:15053:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789366724.822098:0:15053:0:(client.c:2716:ptlrpc_set_wait()) set ffff9638bffacc00 going to sleep for 11 seconds 00000100:00100000:1.0:1789366724.822186:0:14365:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286758795776 00000100:00100000:1.0:1789366724.822194:0:14365:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286758795776 00000100:00100000:1.0:1789366724.822231:0:14365:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1789366724.822239:0:14365:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638af307850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:987e24be-cce8-4f54-8344-02fd27f3b2a2+15:15053:x1876286758795776:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789366724.822451:0:14365:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638af307850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:987e24be-cce8-4f54-8344-02fd27f3b2a2+15:15053:x1876286758795776:12345-0@lo:502:mount.lustre.0 Request processed in 212us (1465us total) trans 0 rc 0/0 00000100:00100000:1.0:1789366724.822459:0:14365:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1789366724.824343:0:15053:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff963787498a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:987e24be-cce8-4f54-8344-02fd27f3b2a2:15053:1876286758795776:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1789366724.824518:0:15053:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:0.0:1789366724.824533:0:15053:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 9 count 10 00000020:01000000:1.0:1789366724.826482:0:15071:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789366724.826494:0:15071:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789366724.826497:0:15071:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1789366724.826505:0:15071:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9638a739f800 00000020:00000080:1.0:1789366724.826508:0:15071:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1789366724.826516:0:15071:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789366724.826518:0:15071:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789366724.826520:0:15071:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:1.0:1789366724.826522:0:15071:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789366724.826538:0:15071:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789366724.826539:0:15071:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1789366724.826544:0:15071:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9638a739f800 00000020:00000080:1.0:1789366724.826547:0:15071:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1789366724.826614:0:15071:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789366724.826619:0:15071:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789366724.826620:0:15071:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:1.0:1789366724.826623:0:15071:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789366724.826625:0:15071:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789366724.826627:0:15071:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1789366724.826631:0:15071:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9638a739f800 00000020:00000080:1.0:1789366724.826632:0:15071:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1789366724.826672:0:15071:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789366724.826676:0:15071:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789366724.826678:0:15071:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:1.0:1789366724.826681:0:15071:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 10 count 10 00000020:01000000:0.0:1789366724.833637:0:15053:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:0.0:1789366724.833695:0:15053:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.123@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1789366724.833735:0:15053:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.123@tcp lock: ffff9638b720c600/0x8da3486b955f41a9 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8da3486b955f41b0 expref: -99 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366724.833748:0:15053:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.123@tcp lock: ffff9638b720c600/0x8da3486b955f41a9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8da3486b955f41b0 expref: -99 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789366724.833895:0:15053:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1789366724.833899:0:15053:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9638a739f800 10000000:01000000:0.0:1789366724.833902:0:15053:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9638a739f800 10000000:01000000:0.0:1789366724.833906:0:15053:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1789366724.833912:0:15053:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9638a739f800 from 1 10000000:01000000:0.0:1789366724.833920:0:15053:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1789366724.833955:0:15053:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.123@tcp lock: ffff9638b720c000/0x8da3486b955f41b7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366724.833964:0:15053:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.123@tcp lock: ffff9638b720c000/0x8da3486b955f41b7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366724.833976:0:15053:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.123@tcp lock: ffff9638b720c000/0x8da3486b955f41b7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789366724.834001:0:15053:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff963787498a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:987e24be-cce8-4f54-8344-02fd27f3b2a2:15053:1876286758795904:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1789366724.834066:0:15053:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789366724.834105:0:15053:0:(client.c:2716:ptlrpc_set_wait()) set ffff9638bffacc00 going to sleep for 11 seconds 00000100:00100000:1.0:1789366724.836250:0:14365:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286758795904 00000100:00100000:1.0:1789366724.836265:0:14365:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286758795904 00000100:00100000:1.0:1789366724.836355:0:14365:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1789366724.836366:0:14365:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638af305050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:987e24be-cce8-4f54-8344-02fd27f3b2a2+15:15053:x1876286758795904:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789366724.836384:0:14365:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789366724.836401:0:14365:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9638b6ce2a00/0x8da3486b955f41be lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x8da3486b955f41b7 expref: -99 pid: 14365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366724.836427:0:14365:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9638b6ce2a00/0x8da3486b955f41be lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8da3486b955f41b7 expref: 16 pid: 14365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366724.836439:0:14365:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9638b6ce2a00/0x8da3486b955f41be lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8da3486b955f41b7 expref: 16 pid: 14365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366724.836447:0:14365:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9638b6ce2a00, rc 0) 00000100:00100000:1.0:1789366724.836528:0:14365:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638af305050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:987e24be-cce8-4f54-8344-02fd27f3b2a2+16:15053:x1876286758795904:12345-0@lo:101:mount.lustre.0 Request processed in 164us (2461us total) trans 0 rc 0/0 00000100:00100000:1.0:1789366724.836541:0:14365:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1789366724.836630:0:15053:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff963787498a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:987e24be-cce8-4f54-8344-02fd27f3b2a2:15053:1876286758795904:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789366724.836647:0:15053:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.123@tcp lock: ffff9638b720c000/0x8da3486b955f41b7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x8da3486b955f41be expref: -99 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366724.836657:0:15053:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.123@tcp lock: ffff9638b720c000/0x8da3486b955f41b7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x8da3486b955f41be expref: -99 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1789366724.837254:0:15053:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000040:00080000:0.0:1789366724.837587:0:15053:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1789366724.837838:0:15053:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:0.0:1789366724.837879:0:15053:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:0.0:1789366724.837923:0:15053:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:0.0:1789366724.837974:0:15053:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:0.0:1789366724.838012:0:15053:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:0.0:1789366724.838056:0:15053:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:0.0:1789366724.838086:0:15053:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:0.0:1789366724.838115:0:15053:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:0.0:1789366724.838168:0:15053:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:0.0:1789366724.838201:0:15053:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:0.0:1789366724.838232:0:15053:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:0.0:1789366724.838278:0:15053:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:0.0:1789366724.838314:0:15053:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:0.0:1789366724.838345:0:15053:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:0.0:1789366724.838394:0:15053:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:0.0:1789366724.838427:0:15053:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:0.0:1789366724.838456:0:15053:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:0.0:1789366724.838500:0:15053:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:0.0:1789366724.838550:0:15053:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:0.0:1789366724.838596:0:15053:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:0.0:1789366724.838639:0:15053:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:0.0:1789366724.838678:0:15053:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:0.0:1789366724.838735:0:15053:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:0.0:1789366724.838801:0:15053:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:0.0:1789366724.838845:0:15053:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 128 off12440 00000040:00080000:0.0:1789366724.838881:0:15053:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12664 00000040:00080000:0.0:1789366724.838927:0:15053:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12888 00000040:00080000:0.0:1789366724.838967:0:15053:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off12968 00000040:00080000:0.0:1789366724.839040:0:15053:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13192 00000040:00080000:0.0:1789366724.839047:0:15053:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 29 count 30 00000100:00100000:0.0:1789366724.839130:0:15053:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff963787498a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:987e24be-cce8-4f54-8344-02fd27f3b2a2:15053:1876286758796032:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789366724.839191:0:15053:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789366724.840483:0:15053:0:(client.c:2716:ptlrpc_set_wait()) set ffff9638bffacc00 going to sleep for 11 seconds 00000100:00100000:3.0:1789366724.840553:0:14363:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286758796032 00000100:00100000:3.0:1789366724.840570:0:14363:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286758796032 00000100:00100000:3.0:1789366724.840617:0:14363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1789366724.840626:0:14363:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638af306c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:987e24be-cce8-4f54-8344-02fd27f3b2a2+16:15053:x1876286758796032:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789366724.840919:0:14363:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638af306c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:987e24be-cce8-4f54-8344-02fd27f3b2a2+16:15053:x1876286758796032:12345-0@lo:501:mount.lustre.0 Request processed in 292us (1726us total) trans 0 rc 0/0 00000100:00100000:3.0:1789366724.840927:0:14363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1789366724.846468:0:15053:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff963787498a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:987e24be-cce8-4f54-8344-02fd27f3b2a2:15053:1876286758796032:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789366724.846531:0:15053:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff963787498a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:987e24be-cce8-4f54-8344-02fd27f3b2a2:15053:1876286758796160:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1789366724.846617:0:15053:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789366724.846656:0:15053:0:(client.c:2716:ptlrpc_set_wait()) set ffff9638bffacc00 going to sleep for 11 seconds 00000100:00100000:1.0:1789366724.847674:0:14365:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286758796160 00000100:00100000:1.0:1789366724.847684:0:14365:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286758796160 00000100:00100000:1.0:1789366724.847755:0:14365:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1789366724.847765:0:14365:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638af307050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:987e24be-cce8-4f54-8344-02fd27f3b2a2+16:15053:x1876286758796160:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1789366724.847980:0:14365:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638af307050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:987e24be-cce8-4f54-8344-02fd27f3b2a2+16:15053:x1876286758796160:12345-0@lo:503:mount.lustre.0 Request processed in 216us (1363us total) trans 0 rc 0/0 00000100:00100000:1.0:1789366724.847988:0:14365:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1789366724.848096:0:15053:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff963787498a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:987e24be-cce8-4f54-8344-02fd27f3b2a2:15053:1876286758796160:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1789366724.848690:0:15053:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1789366724.848802:0:15053:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff963787498a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:987e24be-cce8-4f54-8344-02fd27f3b2a2:15053:1876286758796288:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789366724.848851:0:15053:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789366724.848877:0:15053:0:(client.c:2716:ptlrpc_set_wait()) set ffff963887ce6000 going to sleep for 11 seconds 00000100:00100000:1.0:1789366724.848944:0:14365:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286758796288 00000100:00100000:1.0:1789366724.848950:0:14365:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286758796288 00000100:00100000:1.0:1789366724.848972:0:14365:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1789366724.848980:0:14365:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638af304850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:987e24be-cce8-4f54-8344-02fd27f3b2a2+16:15053:x1876286758796288:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789366724.849156:0:14365:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638af304850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:987e24be-cce8-4f54-8344-02fd27f3b2a2+16:15053:x1876286758796288:12345-0@lo:502:mount.lustre.0 Request processed in 176us (305us total) trans 0 rc 0/0 00000100:00100000:1.0:1789366724.849164:0:14365:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1789366724.849231:0:15053:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff963787498a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:987e24be-cce8-4f54-8344-02fd27f3b2a2:15053:1876286758796288:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1789366724.849483:0:15053:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:0.0:1789366724.849534:0:15053:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:0.0:1789366724.849590:0:15053:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:0.0:1789366724.849634:0:15053:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:0.0:1789366724.849672:0:15053:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:0.0:1789366724.849752:0:15053:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:0.0:1789366724.849789:0:15053:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:0.0:1789366724.849816:0:15053:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:0.0:1789366724.849864:0:15053:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:0.0:1789366724.849897:0:15053:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:0.0:1789366724.849926:0:15053:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:0.0:1789366724.849973:0:15053:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:0.0:1789366724.850011:0:15053:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:0.0:1789366724.850040:0:15053:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:0.0:1789366724.850079:0:15053:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:0.0:1789366724.850109:0:15053:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:0.0:1789366724.850137:0:15053:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:0.0:1789366724.850173:0:15053:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:0.0:1789366724.850215:0:15053:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:0.0:1789366724.850244:0:15053:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:0.0:1789366724.850281:0:15053:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:0.0:1789366724.850310:0:15053:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:0.0:1789366724.850338:0:15053:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:0.0:1789366724.850386:0:15053:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:0.0:1789366724.850426:0:15053:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 128 off12440 00000040:00080000:0.0:1789366724.850474:0:15053:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12664 00000040:00080000:0.0:1789366724.850526:0:15053:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12888 00000040:00080000:0.0:1789366724.850581:0:15053:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off12968 00000040:00080000:0.0:1789366724.850621:0:15053:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13192 00000040:00080000:0.0:1789366724.850686:0:15053:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13416 00000040:00080000:0.0:1789366724.850751:0:15053:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13504 00000040:00080000:0.0:1789366724.850785:0:15053:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13632 00000040:00080000:0.0:1789366724.850819:0:15053:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13776 00000040:00080000:0.0:1789366724.850870:0:15053:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13904 00000040:00080000:0.0:1789366724.850922:0:15053:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14128 00000040:00080000:0.0:1789366724.850975:0:15053:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14352 00000040:00080000:0.0:1789366724.851017:0:15053:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14432 00000040:00080000:0.0:1789366724.851058:0:15053:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14656 00000040:00080000:0.0:1789366724.851108:0:15053:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14880 00000040:00080000:0.0:1789366724.851148:0:15053:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 120 off15000 00000100:00100000:0.0:1789366724.851191:0:15053:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff963787498a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:987e24be-cce8-4f54-8344-02fd27f3b2a2:15053:1876286758796416:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789366724.851253:0:15053:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789366724.851279:0:15053:0:(client.c:2716:ptlrpc_set_wait()) set ffff963887ce6000 going to sleep for 11 seconds 00000100:00100000:1.0:1789366724.851604:0:14365:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286758796416 00000100:00100000:1.0:1789366724.851612:0:14365:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286758796416 00000100:00100000:1.0:1789366724.851650:0:14365:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1789366724.851658:0:14365:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638af305c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:987e24be-cce8-4f54-8344-02fd27f3b2a2+16:15053:x1876286758796416:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789366724.851902:0:14365:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638af305c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:987e24be-cce8-4f54-8344-02fd27f3b2a2+16:15053:x1876286758796416:12345-0@lo:502:mount.lustre.0 Request processed in 244us (648us total) trans 0 rc 0/0 00000100:00100000:1.0:1789366724.851910:0:14365:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1789366724.857077:0:15053:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff963787498a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:987e24be-cce8-4f54-8344-02fd27f3b2a2:15053:1876286758796416:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1789366724.857243:0:15053:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 224 off15224 00000040:00080000:0.0:1789366724.857259:0:15053:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 41 count 42 00000020:01000004:3.0:1789366724.858762:0:15076:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:3.0:1789366724.858780:0:15076:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff963785d619c0) 00000020:00000080:3.0:1789366724.858807:0:15076:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type lwp with refcount 2 00000020:01000004:3.0:1789366724.858909:0:15076:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9638a739f800 from lustre-OST0000, refs=3 00000020:01000004:3.0:1789366724.858914:0:15076:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9638a739f800 from lustre-OST0000, refs=3 00000020:01000004:3.0:1789366724.858916:0:15076:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9638a739f800 3 00010000:00080000:3.0:1789366724.858948:0:15076:0:(ldlm_lib.c:102:import_set_conn()) imp ffff963784ab7800@lustre-MDT0000-lwp-OST0000: add connection 192.168.202.123@tcp at head 00010000:00010000:3.0:1789366724.860640:0:15076:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-4 is initialized 00000020:00000080:3.0:1789366724.860876:0:15076:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:3.0:1789366724.860910:0:15076:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1789366724.860922:0:15076:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0x8da3486b955f41cc 00000100:00080000:3.0:1789366724.860932:0:15076:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1789366724.860943:0:15076:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff963784ab7800 using connection 192.168.202.123@tcp/0@lo 00000100:00100000:3.0:1789366724.860985:0:15076:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9638b6d55f80 x1876286758796544/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1789366724.861038:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9638b6d55f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3283:1876286758796544:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1789366724.861106:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789366724.861180:0:14371:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286758796544 00000100:00100000:3.0:1789366724.861187:0:14371:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286758796544 00000100:00100000:3.0:1789366724.861216:0:14371:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789366724.861223:0:14371:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638b6d57b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3283:x1876286758796544:12345-0@lo:38:llog_process_th.0 00010000:00080000:3.0:1789366724.861244:0:14371:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 300 last 0 00000020:00000080:3.0:1789366724.861282:0:14371:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0x8da3486b955f41d3 00000004:00100000:3.0:1789366724.861296:0:14371:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1789366724.861324:0:14371:0:(import.c:65:import_set_state_nolock()) ffff963784ab3800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789366724.861373:0:14371:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638b6d57b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3283:x1876286758796544:12345-0@lo:38:llog_process_th.0 Request processed in 149us (266us total) trans 0 rc 0/0 00000100:00100000:3.0:1789366724.861380:0:14371:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:3.0:1789366724.861418:0:3283:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9638b6d55f80 x1876286758796544/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789366734 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789366724.861428:0:3283:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1789366724.861435:0:3283:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 2 00000100:00080000:3.0:1789366724.861442:0:3283:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:3.0:1789366724.861446:0:3283:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1789366724.861448:0:3283:0:(import.c:65:import_set_state_nolock()) ffff963784ab7800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1789366724.861454:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9638b6d55f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3283:1876286758796544:0@lo:38:llog_process_th.0 00000100:00080000:3.0:1789366724.861472:0:15076:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1789366724.861493:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789366724.861512:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1789366724.861515:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789366724.861518:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000040:00080000:2.0:1789366724.864183:0:15076:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 42 count 42 00000020:01000000:0.0:1789366724.864313:0:15053:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:0.0:1789366724.864342:0:15053:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.123@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1789366724.864363:0:15053:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.123@tcp lock: ffff9638b720c000/0x8da3486b955f41b7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x8da3486b955f41be expref: -99 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366724.864374:0:15053:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.123@tcp lock: ffff9638b720c000/0x8da3486b955f41b7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x8da3486b955f41be expref: -99 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1789366724.864420:0:15053:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1789366724.864425:0:15053:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1789366724.864427:0:15053:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789366724.864428:0:15053:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789366724.864429:0:15053:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789366724.864430:0:15053:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789366724.864431:0:15053:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1789366724.864433:0:15053:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789366724.864434:0:15053:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1789366724.864438:0:15053:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020002 00000020:01000004:0.0:1789366724.864440:0:15053:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1789366724.864441:0:15053:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1789366724.864442:0:15053:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789366724.864443:0:15053:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789366724.864444:0:15053:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789366724.864445:0:15053:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789366724.864446:0:15053:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1789366724.864447:0:15053:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789366724.864448:0:15053:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1789366724.864472:0:15053:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:0.0:1789366724.864488:0:15053:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff963787498a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:987e24be-cce8-4f54-8344-02fd27f3b2a2:15053:1876286758796800:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1789366724.864547:0:15053:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789366724.864581:0:15053:0:(client.c:2716:ptlrpc_set_wait()) set ffff963887ce6600 going to sleep for 11 seconds 00000100:00100000:3.0:1789366724.864681:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9638b6d55f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3284:1876286758796672:0@lo:400:kworker.0 00000100:00100000:3.0:1789366724.864714:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789366724.864976:0:14365:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286758796800 00000100:00100000:1.0:1789366724.864984:0:14365:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286758796800 00000100:00100000:1.0:1789366724.865033:0:14365:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1789366724.865043:0:14365:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638af306450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:987e24be-cce8-4f54-8344-02fd27f3b2a2+16:15053:x1876286758796800:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1789366724.865080:0:14365:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:1.0:1789366724.865095:0:14365:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:0.0:1789366724.871260:0:14370:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286758796672 00000100:00100000:0.0:1789366724.871273:0:14370:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286758796672 00000100:00100000:0.0:1789366724.873994:0:14370:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789366724.874009:0:14370:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638b6d55880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3284:x1876286758796672:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789366724.874108:0:14370:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638b6d55880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3284:x1876286758796672:12345-0@lo:400:kworker.0 Request processed in 103us (9392us total) trans 0 rc 0/0 00000100:00100000:0.0:1789366724.874115:0:14370:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:0.0:1789366724.874182:0:3284:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9638b6d55f80 x1876286758796672/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789366740 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789366724.874197:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9638b6d55f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3284:1876286758796672:0@lo:400:kworker.0 20000000:01000000:2.0:1789366724.885415:0:14365:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1789366724.885436:0:14365:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:1.0:1789366724.885524:0:14386:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1789366724.885530:0:14386:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1789366724.885552:0:14386:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9638b6ce3600/0x8da3486b955f41da lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366724.885581:0:14386:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9638832d3600/0x8da3486b955f4147 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8da3486b955f4140 expref: 16 pid: 14364 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366724.885590:0:14386:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9638b6ce3600/0x8da3486b955f41da lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366724.885632:0:14386:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9638832d3600/0x8da3486b955f4147 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x8da3486b955f4140 expref: 16 pid: 14364 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366724.885646:0:14386:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9638832d3600/0x8da3486b955f4147 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x8da3486b955f4140 expref: 16 pid: 14364 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789366724.885661:0:14386:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96388327ea00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14386:1876286758796928:0@lo:104: 00000100:00100000:1.0:1789366724.885782:0:14386:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789366724.885828:0:14354:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286758796928 00000100:00100000:2.0:1789366724.885837:0:14354:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286758796928 00000100:00100000:1.0:1789366724.885848:0:14386:0:(client.c:2716:ptlrpc_set_wait()) set ffff9638bf1dd840 going to sleep for 11 seconds 00000100:00100000:2.0:1789366724.885898:0:14354:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789366724.885922:0:14354:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96388327fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:987e24be-cce8-4f54-8344-02fd27f3b2a2+3:14386:x1876286758796928:12345-0@lo:104: 00010000:00010000:2.0:1789366724.885935:0:14354:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.123@tcp lock: ffff9638902c9600/0x8da3486b955f4140 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x8da3486b955f4147 expref: -99 pid: 14367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366724.885982:0:14354:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1789366724.885986:0:14354:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96388327fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:987e24be-cce8-4f54-8344-02fd27f3b2a2+3:14386:x1876286758796928:12345-0@lo:104: Request processed in 68us (205us total) trans 0 rc 0/0 00000100:00100000:2.0:1789366724.885992:0:14354:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:2.0:1789366724.886015:0:14359:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789366724.886021:0:14359:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.123@tcp lock: ffff9638902c9600/0x8da3486b955f4140 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x8da3486b955f4147 expref: -99 pid: 14367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366724.886029:0:14359:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9638902c9600 already unused, calling callback (ffffffffc1cc7c20) 10000000:00010000:2.0:1789366724.886034:0:14359:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.123@tcp lock: ffff9638902c9600/0x8da3486b955f4140 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x8da3486b955f4147 expref: -99 pid: 14367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366724.886043:0:14359:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.123@tcp lock: ffff9638902c9600/0x8da3486b955f4140 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x8da3486b955f4147 expref: -99 pid: 14367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789366724.886050:0:14359:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.123@tcp lock: ffff9638902c9600/0x8da3486b955f4140 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x8da3486b955f4147 expref: -99 pid: 14367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789366724.886056:0:14359:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1789366724.886086:0:14359:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.123@tcp lock: ffff9638902c9600/0x8da3486b955f4140 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8da3486b955f4147 expref: -99 pid: 14367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366724.886091:0:14359:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789366724.886107:0:14359:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.123@tcp lock: ffff9638902c9600/0x8da3486b955f4140 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8da3486b955f4147 expref: -99 pid: 14367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366724.886120:0:14359:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.123@tcp lock: ffff9638902c9600/0x8da3486b955f4140 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8da3486b955f4147 expref: -99 pid: 14367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789366724.886123:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9638aef27100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:987e24be-cce8-4f54-8344-02fd27f3b2a2:3285:1876286758797056:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789366724.886134:0:14359:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789366724.886137:0:14359:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789366724.886139:0:14359:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789366724.886159:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789366724.886177:0:14386:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96388327ea00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14386:1876286758796928:0@lo:104: 00010000:00010000:2.0:1789366724.886194:0:14386:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9638b6ce3600/0x8da3486b955f41da lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789366724.886223:0:14356:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286758797056 00000100:00100000:2.0:1789366724.886225:0:14356:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286758797056 00010000:00010000:2.0:1789366724.886237:0:14356:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9638832d3600/0x8da3486b955f4147 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8da3486b955f4140 expref: 17 pid: 14364 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789366724.886262:0:14356:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789366724.886268:0:14356:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638b6d54700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:987e24be-cce8-4f54-8344-02fd27f3b2a2+17:3285:x1876286758797056:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789366724.886275:0:14356:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789366724.886278:0:14356:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9638832d3600/0x8da3486b955f4147 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8da3486b955f4140 expref: 17 pid: 14364 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366724.886289:0:14356:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9638832d3600/0x8da3486b955f4147 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x8da3486b955f4140 expref: 17 pid: 14364 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366724.886299:0:14356:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9638832d3600/0x8da3486b955f4147 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x8da3486b955f4140 expref: 17 pid: 14364 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366724.886308:0:14356:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9638b6ce3600/0x8da3486b955f41da lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366724.886318:0:14356:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9638b6ce3600/0x8da3486b955f41da lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1789366724.886325:0:14356:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001215426s 00010000:00010000:2.0:1789366724.886328:0:14356:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9638b6ce3600/0x8da3486b955f41da lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366724.886333:0:14356:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9638b6ce3600/0x8da3486b955f41da lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366724.886337:0:14356:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9638b6ce3600/0x8da3486b955f41da lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366724.886341:0:14356:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9638b6ce3600/0x8da3486b955f41da lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366724.886345:0:14356:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9638b6ce3600 already unused, calling callback (ffffffffc16df520) 00010000:00010000:2.0:1789366724.886349:0:14356:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9638b6ce3600/0x8da3486b955f41da lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366724.886357:0:14356:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9638b6ce3600/0x8da3486b955f41da lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366724.886376:0:14356:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9638b6ce3600/0x8da3486b955f41da lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366724.886385:0:14356:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789366724.886393:0:14386:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9638b6ce3600/0x8da3486b955f41da lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366724.886402:0:14386:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9638b6ce3600/0x8da3486b955f41da lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366724.886410:0:14386:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9638b6ce3600/0x8da3486b955f41da lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789366724.886422:0:14356:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638b6d54700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:987e24be-cce8-4f54-8344-02fd27f3b2a2+16:3285:x1876286758797056:12345-0@lo:103:ldlm_bl.0 Request processed in 153us (263us total) trans 0 rc 0/0 00000100:00100000:2.0:1789366724.886434:0:14356:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789366724.886488:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9638aef27100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:987e24be-cce8-4f54-8344-02fd27f3b2a2:3285:1876286758797056:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789366724.891712:0:14365:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638af306450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:987e24be-cce8-4f54-8344-02fd27f3b2a2+15:15053:x1876286758796800:12345-0@lo:253:mount.lustre.0 Request processed in 26662us (27156us total) trans 0 rc 0/0 00000100:00100000:2.0:1789366724.891756:0:14365:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1789366724.891872:0:15053:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff963787498a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:987e24be-cce8-4f54-8344-02fd27f3b2a2:15053:1876286758796800:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1789366724.891902:0:15053:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:0.0:1789366724.891905:0:15053:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1789366724.891907:0:15053:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1789366724.891908:0:15053:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789366724.891909:0:15053:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789366724.891911:0:15053:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789366724.891912:0:15053:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789366724.891914:0:15053:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1789366724.891916:0:15053:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789366724.891917:0:15053:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1789366724.891932:0:15053:0:(tgt_mount.c:2698:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:1.0:1789366724.896349:0:15053:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:1.0:1789366724.896532:0:15053:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:1.0:1789366724.896697:0:15053:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:1.0:1789366724.896937:0:15053:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:1.0:1789366724.897087:0:15053:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:1.0:1789366724.897219:0:15053:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:1.0:1789366724.898094:0:15053:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934592 00002000:00080000:0.0:1789366724.944178:0:15053:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:0.0:1789366724.944186:0:15053:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:0.0:1789366724.944212:0:15053:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1789366724.944269:0:15053:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.123@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1789366724.944285:0:15053:0:(tgt_mount.c:2464:server_fill_super_common()) Server sb, dev=48 00000080:00000004:0.0:1789366724.944312:0:15053:0:(super25.c:182:lustre_fill_super()) lustre-ost1/ost1: Mount complete 00010000:00010000:3.0:1789366725.815878:0:14358:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1789366726.072441:0:14367:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1789366726.072450:0:14367:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff963888959000 from 7 10000000:01000000:2.0:1789366726.072455:0:14367:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1789366726.072497:0:14367:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.123@tcp lock: ffff9638902c8c00/0x8da3486b955f41e1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366726.072509:0:14367:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.123@tcp lock: ffff9638902c8c00/0x8da3486b955f41e1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366726.072520:0:14367:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.123@tcp lock: ffff9638902c8c00/0x8da3486b955f41e1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789366726.072545:0:14367:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9638aef26d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:987e24be-cce8-4f54-8344-02fd27f3b2a2:14367:1876286758797184:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789366726.072628:0:14367:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789366726.072680:0:14367:0:(client.c:2716:ptlrpc_set_wait()) set ffff9638b6da09c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789366726.074461:0:14363:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286758797184 00000100:00100000:1.0:1789366726.074473:0:14363:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286758797184 00000100:00100000:1.0:1789366726.074520:0:14363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1789366726.074530:0:14363:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638af307450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:987e24be-cce8-4f54-8344-02fd27f3b2a2+15:14367:x1876286758797184:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789366726.074546:0:14363:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789366726.074576:0:14363:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9638b6ce2400/0x8da3486b955f41e8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x8da3486b955f41e1 expref: -99 pid: 14363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366726.074600:0:14363:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9638b6ce2400/0x8da3486b955f41e8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8da3486b955f41e1 expref: 16 pid: 14363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366726.074612:0:14363:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9638b6ce2400/0x8da3486b955f41e8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8da3486b955f41e1 expref: 16 pid: 14363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366726.074621:0:14363:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9638b6ce2400, rc 0) 00000100:00100000:1.0:1789366726.074684:0:14363:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638af307450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:987e24be-cce8-4f54-8344-02fd27f3b2a2+16:14367:x1876286758797184:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 156us (2056us total) trans 0 rc 0/0 00000100:00100000:1.0:1789366726.074692:0:14363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1789366726.074774:0:14367:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9638aef26d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:987e24be-cce8-4f54-8344-02fd27f3b2a2:14367:1876286758797184:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789366726.074800:0:14367:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.123@tcp lock: ffff9638902c8c00/0x8da3486b955f41e1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8da3486b955f41e8 expref: -99 pid: 14367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366726.074809:0:14367:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.123@tcp lock: ffff9638902c8c00/0x8da3486b955f41e1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x8da3486b955f41e8 expref: -99 pid: 14367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789366726.074868:0:14367:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96388327c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:987e24be-cce8-4f54-8344-02fd27f3b2a2:14367:1876286758797312:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1789366726.074903:0:14367:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789366726.074938:0:14367:0:(client.c:2716:ptlrpc_set_wait()) set ffff9638bd392180 going to sleep for 11 seconds 00000100:00100000:2.0:1789366726.075572:0:14365:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286758797312 00000100:00100000:2.0:1789366726.075578:0:14365:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286758797312 00000100:00100000:2.0:1789366726.075976:0:14365:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1789366726.075985:0:14365:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638bfe9b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:987e24be-cce8-4f54-8344-02fd27f3b2a2+16:14367:x1876286758797312:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1789366726.076002:0:14365:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1789366726.076019:0:14365:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1789366726.076023:0:14365:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 7 00000100:00100000:2.0:1789366726.076102:0:14365:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638bfe9b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:987e24be-cce8-4f54-8344-02fd27f3b2a2+16:14367:x1876286758797312:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 118us (1198us total) trans 0 rc 0/0 00000100:00100000:2.0:1789366726.076110:0:14365:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1789366726.076428:0:14367:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96388327c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:987e24be-cce8-4f54-8344-02fd27f3b2a2:14367:1876286758797312:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1789366726.076482:0:14367:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.123@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1789366726.076490:0:14367:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.123@tcp lock: ffff9638902c8c00/0x8da3486b955f41e1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8da3486b955f41e8 expref: -99 pid: 14367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366726.076500:0:14367:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.123@tcp lock: ffff9638902c8c00/0x8da3486b955f41e1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8da3486b955f41e8 expref: -99 pid: 14367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366726.840536:0:14359:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789366726.904172:0:3283:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789366716/real 1789366716] req@ffff963787499880 x1876286758790912/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789366726 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789366726.904226:0:3283:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff963787499880 x1876286758790912/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789366726 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789366726.904238:0:3283:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789366716/real 1789366716] req@ffff96378749bb80 x1876286758790784/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789366726 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789366726.904250:0:3283:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff96378749bb80 x1876286758790784/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789366726 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1789366726.904268:0:3283:0:(import.c:65:import_set_state_nolock()) ffff963882f31800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1789366726.904295:0:3283:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1789366726.904300:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff963787499880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3283:1876286758790912:0@lo:8:llog_process_th.0 00000100:00080000:2.0:1789366726.904306:0:3283:0:(import.c:65:import_set_state_nolock()) ffff963887022000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1789366726.904312:0:3283:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1789366726.904316:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96378749bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3283:1876286758790784:0@lo:8:llog_process_th.0 00000100:00080000:1.0:1789366726.904380:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789366726.904386:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:1.0:1789366726.904389:0:37:0:(import.c:65:import_set_state_nolock()) ffff963887022000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1789366726.904395:0:37:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 292 00000100:00080000:1.0:1789366726.904400:0:37:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00100000:0.0:1789366726.904407:0:3286:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96388327c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:987e24be-cce8-4f54-8344-02fd27f3b2a2:3286:1876286758797440:0@lo:400:kworker.0 00000100:00080000:1.0:1789366726.904412:0:37:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff963887022000 using connection 192.168.202.123@tcp/0@lo 00000100:00100000:1.0:1789366726.904437:0:37:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff96388327dc00 x1876286758797568/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1789366726.904465:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789366726.904469:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1789366726.904472:0:37:0:(import.c:65:import_set_state_nolock()) ffff963882f31800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1789366726.904478:0:37:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 292 00000100:00100000:0.0:1789366726.904481:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1789366726.904484:0:37:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1789366726.904491:0:37:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff963882f31800 using connection 192.168.202.123@tcp/0@lo 00000100:00100000:1.0:1789366726.904506:0:37:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff96388327d180 x1876286758797696/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1789366726.904556:0:3286:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789366726.904566:0:3286:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96388327d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3286:1876286758797824:0@lo:400:kworker.0 00000100:00100000:1.0:1789366726.904577:0:14363:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286758797440 00000100:00100000:1.0:1789366726.904584:0:14363:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286758797440 00000100:00100000:0.0:1789366726.904597:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789366726.904633:0:14363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1789366726.904639:0:3285:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789366726.904644:0:14363:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638bfe9ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:987e24be-cce8-4f54-8344-02fd27f3b2a2+16:3286:x1876286758797440:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789366726.904652:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96388327ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3285:1876286758797952:0@lo:400:kworker.0 00000100:00100000:0.0:1789366726.904692:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789366726.904711:0:14363:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638bfe9ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:987e24be-cce8-4f54-8344-02fd27f3b2a2+16:3286:x1876286758797440:12345-0@lo:400:kworker.0 Request processed in 69us (232us total) trans 0 rc 0/0 00000100:00100000:1.0:1789366726.904742:0:14363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1789366726.904768:0:14370:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286758797824 00000100:00100000:0.0:1789366726.904773:0:14370:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286758797824 00000100:00100000:1.0:1789366726.904806:0:3286:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96388327c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:987e24be-cce8-4f54-8344-02fd27f3b2a2:3286:1876286758797440:0@lo:400:kworker.0 00000100:00100000:0.0:1789366726.904817:0:14370:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286758797952 00000100:00100000:0.0:1789366726.904821:0:14370:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286758797952 00000100:00100000:0.0:1789366726.904852:0:14370:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789366726.904859:0:14370:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963787498a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3286:x1876286758797824:12345-0@lo:400:kworker.0 00000100:00080000:1.0:1789366726.904869:0:14366:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789366726.904913:0:14370:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963787498a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3286:x1876286758797824:12345-0@lo:400:kworker.0 Request processed in 55us (316us total) trans 0 rc 0/0 00000100:00100000:0.0:1789366726.904927:0:14370:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789366726.904941:0:14370:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1789366726.904948:0:14370:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96378749a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3285:x1876286758797952:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789366726.904994:0:14370:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96378749a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3285:x1876286758797952:12345-0@lo:400:kworker.0 Request processed in 47us (301us total) trans 0 rc 0/0 00000100:00100000:0.0:1789366726.905000:0:14370:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:0.0:1789366726.905032:0:3285:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff96388327ce00 x1876286758797952/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789366742 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789366726.905043:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96388327ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3285:1876286758797952:0@lo:400:kworker.0 00010000:00080000:1.0:1789366726.905088:0:3286:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff96388327d500 x1876286758797824/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789366742 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789366726.905098:0:3286:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96388327d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3286:1876286758797824:0@lo:400:kworker.0 00000100:00100000:2.0:1789366726.905697:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96388327dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3283:1876286758797568:0@lo:8:kworker.0 00000100:00100000:2.0:1789366726.905757:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789366726.905779:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96388327d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3283:1876286758797696:0@lo:8:kworker.0 00000100:00100000:2.0:1789366726.905795:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789366726.906054:0:15055:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286758797568 00000100:00100000:0.0:1789366726.906060:0:15055:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286758797568 00000100:00100000:0.0:1789366726.906086:0:15055:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286758797696 00000100:00100000:0.0:1789366726.906088:0:15055:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286758797696 00000100:00100000:0.0:1789366726.906101:0:15055:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789366726.906107:0:15055:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638aef24e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3283:x1876286758797568:12345-0@lo:8:kworker.0 00010000:00080000:0.0:1789366726.906132:0:15055:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 302 last 0 00000020:00000080:0.0:1789366726.906160:0:15055:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x8da3486b955f41ef 00002000:00100000:0.0:1789366726.906175:0:15055:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff963888972800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a06 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:0.0:1789366726.906179:0:15055:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:0.0:1789366726.906182:0:15055:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:0.0:1789366726.906496:0:15055:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1789366726.906516:0:15055:0:(import.c:65:import_set_state_nolock()) ffff963888972000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789366726.906578:0:15055:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638aef24e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3283:x1876286758797568:12345-0@lo:8:kworker.0 Request processed in 470us (820us total) trans 0 rc 0/0 00000100:00100000:0.0:1789366726.906587:0:15055:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789366726.906611:0:15055:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789366726.906615:0:15055:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638aef25880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3283:x1876286758797696:12345-0@lo:8:kworker.0 00010000:00020000:0.0:1789366726.906625:0:15055:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1789366726.906656:0:15055:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638aef25880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3283:x1876286758797696:12345-0@lo:8:kworker.0 Request processed in 40us (860us total) trans 0 rc -19/-19 00000100:00100000:0.0:1789366726.906663:0:15055:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1789366726.906744:0:3283:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff96388327dc00 x1876286758797568/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1789366741 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789366726.906755:0:3283:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1789366726.906762:0:3283:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 2 00000100:00080000:2.0:1789366726.906770:0:3283:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1789366726.906775:0:3283:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:2.0:1789366726.906784:0:3283:0:(import.c:65:import_set_state_nolock()) ffff963887022000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1789366726.906897:0:3283:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1789366726.906903:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96388327dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3283:1876286758797568:0@lo:8:kworker.0 00000100:00080000:2.0:1789366726.906916:0:3283:0:(import.c:65:import_set_state_nolock()) ffff963882f31800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1789366726.906919:0:3283:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1789366726.906922:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96388327d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3283:1876286758797696:0@lo:8:kworker.0 00000004:00080000:0.0:1789366726.907257:0:14393:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000100:00100000:2.0:1789366726.907285:0:3284:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000004:00080000:3.0:1789366726.907306:0:14394:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x240000400:0x6:0x0] 00000100:00100000:3.0:1789366726.907331:0:14394:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9638b6d54a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14394:1876286758798208:0@lo:5:osp-pre-0-0.0 00000100:00100000:3.0:1789366726.907376:0:14394:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789366726.907406:0:14394:0:(client.c:2716:ptlrpc_set_wait()) set ffff9638bf1dd900 going to sleep for 11 seconds 00000100:00100000:1.0:1789366726.907431:0:15056:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286758798208 00000100:00100000:1.0:1789366726.907438:0:15056:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286758798208 00000100:00100000:1.0:1789366726.907493:0:15056:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789366726.907504:0:15056:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638b6d56680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:14394:x1876286758798208:12345-0@lo:5:osp-pre-0-0.0 00000100:00080000:3.0:1789366726.907515:0:14366:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789366726.907559:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9638b6d56d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3284:1876286758798080:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789366726.907591:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:0.0:1789366726.908109:0:14393:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 302372389263ns, next at 0ns, rc = 0 00000100:00100000:3.0:1789366726.908585:0:15058:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286758798080 00000100:00100000:3.0:1789366726.908592:0:15058:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286758798080 00000100:00100000:3.0:1789366726.910616:0:15058:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789366726.910630:0:15058:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638aef27b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3284:x1876286758798080:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789366726.911828:0:15058:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789366726.911935:0:15058:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638aef27b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3284:x1876286758798080:12345-0@lo:13:osp-pre-0-0.0 Request processed in 1305us (4342us total) trans 0 rc 0/0 00000100:00100000:3.0:1789366726.911945:0:15058:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00002000:00080000:1.0:1789366726.912022:0:15056:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x240000400 00002000:00080000:1.0:1789366726.912031:0:15056:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -27 00002000:02000040:1.0:1789366726.912036:0:15056:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x240000400:7 to 0x240000400:33) 00010000:00080000:2.0:1789366726.912769:0:3284:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9638b6d56d80 x1876286758798080/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789366742 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789366726.912795:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9638b6d56d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3284:1876286758798080:0@lo:13:osp-pre-0-0.0 00002000:00010000:1.0:1789366726.922576:0:15056:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789366726.922588:0:15056:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009a47f876/0x8da3486b955f41f6 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366726.922604:0:15056:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x21:0x0].0x0 since=302s v=(0 0) 00010000:00010000:1.0:1789366726.922609:0:15056:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789366726.922615:0:15056:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009a47f876/0x8da3486b955f41f6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366726.922633:0:15056:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009a47f876/0x8da3486b955f41f6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366726.922642:0:15056:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009a47f876/0x8da3486b955f41f6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366726.922650:0:15056:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009a47f876/0x8da3486b955f41f6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366726.922754:0:15056:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1789366726.923200:0:15056:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789366726.923207:0:15056:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005557b111/0x8da3486b955f41fd lrc: 3/0,1 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366726.923217:0:15056:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x20:0x0].0x0 since=302s v=(0 0) 00010000:00010000:1.0:1789366726.923228:0:15056:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789366726.923233:0:15056:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005557b111/0x8da3486b955f41fd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366726.923243:0:15056:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005557b111/0x8da3486b955f41fd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366726.923252:0:15056:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005557b111/0x8da3486b955f41fd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366726.923341:0:15056:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005557b111/0x8da3486b955f41fd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366726.923596:0:14358:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789366726.923605:0:14358:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009a47f876/0x8da3486b955f41f6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366726.923613:0:14358:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9638b6ce3c00 already unused, calling callback (ffffffffc16df520) 00010000:00010000:2.0:1789366726.923618:0:14358:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009a47f876/0x8da3486b955f41f6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366726.923627:0:14358:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009a47f876/0x8da3486b955f41f6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366726.923645:0:14358:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009a47f876/0x8da3486b955f41f6 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366726.923664:0:14358:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009a47f876/0x8da3486b955f41f6 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366726.923685:0:14358:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789366726.923688:0:14358:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005557b111/0x8da3486b955f41fd lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366726.923695:0:14358:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9638b6ce3800 already unused, calling callback (ffffffffc16df520) 00010000:00010000:2.0:1789366726.923698:0:14358:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005557b111/0x8da3486b955f41fd lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366726.923706:0:14358:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005557b111/0x8da3486b955f41fd lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366726.923784:0:14358:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005557b111/0x8da3486b955f41fd lrc: 2/0,0 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366726.923794:0:14358:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789366726.923795:0:14358:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789366726.923797:0:14358:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789366726.923849:0:15056:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1789366726.923854:0:15056:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005557b111/0x8da3486b955f41fd lrc: 0/0,0 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366726.924349:0:14359:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789366726.925754:0:15056:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789366726.925764:0:15056:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a5d8bb44/0x8da3486b955f4204 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366726.925777:0:15056:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1f:0x0].0x0 since=302s v=(0 0) 00010000:00010000:1.0:1789366726.925782:0:15056:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789366726.925787:0:15056:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a5d8bb44/0x8da3486b955f4204 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366726.925800:0:15056:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a5d8bb44/0x8da3486b955f4204 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366726.925817:0:15056:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a5d8bb44/0x8da3486b955f4204 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366726.925824:0:15056:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a5d8bb44/0x8da3486b955f4204 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366726.925842:0:15056:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789366726.925853:0:14358:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789366726.925857:0:14358:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a5d8bb44/0x8da3486b955f4204 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366726.925864:0:14358:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9638b6ce3200 already unused, calling callback (ffffffffc16df520) 00010000:00010000:1.0:1789366726.925867:0:14358:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a5d8bb44/0x8da3486b955f4204 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366726.925876:0:14358:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a5d8bb44/0x8da3486b955f4204 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366726.925891:0:14358:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a5d8bb44/0x8da3486b955f4204 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366726.925900:0:14358:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a5d8bb44/0x8da3486b955f4204 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366726.925917:0:14358:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789366726.925925:0:14358:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789366726.925926:0:14358:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789366726.927519:0:15056:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789366726.927529:0:15056:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e4010258/0x8da3486b955f420b lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366726.927550:0:15056:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1e:0x0].0x0 since=302s v=(0 0) 00010000:00010000:1.0:1789366726.927555:0:15056:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789366726.927561:0:15056:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e4010258/0x8da3486b955f420b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366726.927573:0:15056:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e4010258/0x8da3486b955f420b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366726.927583:0:15056:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e4010258/0x8da3486b955f420b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366726.927592:0:15056:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e4010258/0x8da3486b955f420b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366726.927660:0:15056:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1789366726.928106:0:15056:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789366726.928112:0:15056:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d8dc1c1c/0x8da3486b955f4212 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366726.928121:0:15056:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1d:0x0].0x0 since=302s v=(0 0) 00010000:00010000:1.0:1789366726.928124:0:15056:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789366726.928128:0:15056:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d8dc1c1c/0x8da3486b955f4212 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366726.928142:0:15056:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d8dc1c1c/0x8da3486b955f4212 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366726.928149:0:15056:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d8dc1c1c/0x8da3486b955f4212 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366726.928156:0:15056:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d8dc1c1c/0x8da3486b955f4212 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366726.931433:0:14359:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1789366726.931448:0:14359:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e4010258/0x8da3486b955f420b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366726.931468:0:14359:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9638b6ce2200 already unused, calling callback (ffffffffc16df520) 00010000:00010000:3.0:1789366726.931473:0:14359:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e4010258/0x8da3486b955f420b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366726.931484:0:14359:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e4010258/0x8da3486b955f420b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366726.931507:0:14359:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e4010258/0x8da3486b955f420b lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366726.931515:0:14359:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e4010258/0x8da3486b955f420b lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366726.931912:0:14359:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789366726.931918:0:14359:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d8dc1c1c/0x8da3486b955f4212 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366726.931926:0:14359:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9638b6ce3400 already unused, calling callback (ffffffffc16df520) 00010000:00010000:3.0:1789366726.931930:0:14359:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d8dc1c1c/0x8da3486b955f4212 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366726.931938:0:14359:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d8dc1c1c/0x8da3486b955f4212 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366726.931950:0:14359:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d8dc1c1c/0x8da3486b955f4212 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366726.931964:0:14359:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789366726.931966:0:14359:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789366726.931968:0:14359:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789366726.933496:0:15056:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1789366726.933507:0:15056:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d8dc1c1c/0x8da3486b955f4212 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789366726.934206:0:15056:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789366726.934214:0:15056:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e99a2fd5/0x8da3486b955f4219 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366726.934228:0:15056:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1c:0x0].0x0 since=302s v=(0 0) 00010000:00010000:1.0:1789366726.934233:0:15056:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789366726.934239:0:15056:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e99a2fd5/0x8da3486b955f4219 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366726.934371:0:14358:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789366726.935699:0:15056:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e99a2fd5/0x8da3486b955f4219 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366726.935752:0:15056:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e99a2fd5/0x8da3486b955f4219 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366726.935760:0:15056:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e99a2fd5/0x8da3486b955f4219 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366726.935777:0:15056:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789366726.935789:0:14359:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789366726.935794:0:14359:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e99a2fd5/0x8da3486b955f4219 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366726.935801:0:14359:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9638b6ce2e00 already unused, calling callback (ffffffffc16df520) 00010000:00010000:1.0:1789366726.935806:0:14359:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e99a2fd5/0x8da3486b955f4219 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366726.935815:0:14359:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e99a2fd5/0x8da3486b955f4219 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366726.935832:0:14359:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e99a2fd5/0x8da3486b955f4219 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366726.935839:0:14359:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e99a2fd5/0x8da3486b955f4219 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366726.935858:0:14359:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789366726.935865:0:14359:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789366726.935866:0:14359:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789366726.936865:0:15056:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789366726.936873:0:15056:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a5d8bb44/0x8da3486b955f4220 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366726.936885:0:15056:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1b:0x0].0x0 since=302s v=(0 0) 00010000:00010000:1.0:1789366726.936889:0:15056:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789366726.936894:0:15056:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a5d8bb44/0x8da3486b955f4220 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366726.936905:0:15056:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a5d8bb44/0x8da3486b955f4220 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366726.936913:0:15056:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a5d8bb44/0x8da3486b955f4220 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366726.936920:0:15056:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a5d8bb44/0x8da3486b955f4220 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366726.936937:0:15056:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789366726.936947:0:14358:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789366726.936951:0:14358:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a5d8bb44/0x8da3486b955f4220 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366726.936959:0:14358:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9638b6ce3200 already unused, calling callback (ffffffffc16df520) 00010000:00010000:1.0:1789366726.936963:0:14358:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a5d8bb44/0x8da3486b955f4220 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366726.936981:0:14358:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a5d8bb44/0x8da3486b955f4220 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366726.936992:0:14358:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a5d8bb44/0x8da3486b955f4220 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366726.936999:0:14358:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a5d8bb44/0x8da3486b955f4220 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366726.937013:0:14358:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789366726.937014:0:14358:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789366726.937016:0:14358:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789366726.937423:0:15056:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789366726.937429:0:15056:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005557b111/0x8da3486b955f4227 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366726.937437:0:15056:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1a:0x0].0x0 since=302s v=(0 0) 00010000:00010000:1.0:1789366726.937440:0:15056:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789366726.937443:0:15056:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005557b111/0x8da3486b955f4227 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366726.937453:0:15056:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005557b111/0x8da3486b955f4227 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366726.937460:0:15056:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005557b111/0x8da3486b955f4227 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366726.937472:0:15056:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005557b111/0x8da3486b955f4227 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366726.937486:0:15056:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789366726.937494:0:14359:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789366726.937498:0:14359:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005557b111/0x8da3486b955f4227 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366726.937504:0:14359:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9638b6ce3800 already unused, calling callback (ffffffffc16df520) 00010000:00010000:1.0:1789366726.937507:0:14359:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005557b111/0x8da3486b955f4227 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366726.937515:0:14359:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005557b111/0x8da3486b955f4227 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366726.937526:0:14359:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005557b111/0x8da3486b955f4227 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366726.937532:0:14359:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005557b111/0x8da3486b955f4227 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366726.937558:0:14359:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789366726.937560:0:14359:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789366726.937561:0:14359:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789366726.938170:0:15056:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789366726.938185:0:15056:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003ac13bbc/0x8da3486b955f422e lrc: 3/0,1 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366726.938195:0:15056:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x19:0x0].0x0 since=302s v=(0 0) 00010000:00010000:1.0:1789366726.938198:0:15056:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789366726.938201:0:15056:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003ac13bbc/0x8da3486b955f422e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366726.938211:0:15056:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003ac13bbc/0x8da3486b955f422e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366726.938219:0:15056:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003ac13bbc/0x8da3486b955f422e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366726.938227:0:15056:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003ac13bbc/0x8da3486b955f422e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366726.938241:0:15056:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789366726.938250:0:14358:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789366726.938321:0:14358:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003ac13bbc/0x8da3486b955f422e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366726.938328:0:14358:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9638b6ce3600 already unused, calling callback (ffffffffc16df520) 00010000:00010000:1.0:1789366726.938332:0:14358:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003ac13bbc/0x8da3486b955f422e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366726.938339:0:14358:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003ac13bbc/0x8da3486b955f422e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366726.938357:0:14358:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003ac13bbc/0x8da3486b955f422e lrc: 1/0,0 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366726.938365:0:14358:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003ac13bbc/0x8da3486b955f422e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366726.938381:0:14358:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789366726.938383:0:14358:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789366726.938384:0:14358:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789366726.938793:0:15056:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789366726.938799:0:15056:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a35c8094/0x8da3486b955f4235 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366726.938807:0:15056:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x18:0x0].0x0 since=302s v=(0 0) 00010000:00010000:1.0:1789366726.938810:0:15056:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789366726.938814:0:15056:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a35c8094/0x8da3486b955f4235 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366726.938823:0:15056:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a35c8094/0x8da3486b955f4235 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366726.938831:0:15056:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a35c8094/0x8da3486b955f4235 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366726.938838:0:15056:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a35c8094/0x8da3486b955f4235 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366726.938863:0:15056:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789366726.938872:0:14359:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789366726.938876:0:14359:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a35c8094/0x8da3486b955f4235 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366726.938884:0:14359:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9638b6ce3000 already unused, calling callback (ffffffffc16df520) 00010000:00010000:1.0:1789366726.938887:0:14359:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a35c8094/0x8da3486b955f4235 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366726.938895:0:14359:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a35c8094/0x8da3486b955f4235 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366726.938906:0:14359:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a35c8094/0x8da3486b955f4235 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366726.938914:0:14359:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a35c8094/0x8da3486b955f4235 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366726.938927:0:14359:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789366726.938929:0:14359:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789366726.938930:0:14359:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789366726.939812:0:15056:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789366726.939819:0:15056:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000096f5b236/0x8da3486b955f423c lrc: 3/0,1 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366726.939830:0:15056:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17:0x0].0x0 since=302s v=(0 0) 00010000:00010000:1.0:1789366726.939841:0:15056:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789366726.939846:0:15056:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000096f5b236/0x8da3486b955f423c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366726.939856:0:15056:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000096f5b236/0x8da3486b955f423c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366726.939863:0:15056:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000096f5b236/0x8da3486b955f423c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366726.939869:0:15056:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000096f5b236/0x8da3486b955f423c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366726.939883:0:15056:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789366726.939892:0:14358:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789366726.939896:0:14358:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000096f5b236/0x8da3486b955f423c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366726.939902:0:14358:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9638b6ce2600 already unused, calling callback (ffffffffc16df520) 00010000:00010000:1.0:1789366726.939905:0:14358:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000096f5b236/0x8da3486b955f423c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366726.939912:0:14358:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000096f5b236/0x8da3486b955f423c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366726.939923:0:14358:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000096f5b236/0x8da3486b955f423c lrc: 1/0,0 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366726.939944:0:14358:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000096f5b236/0x8da3486b955f423c lrc: 0/0,0 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366726.939958:0:14358:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789366726.939961:0:14358:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789366726.939962:0:14358:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789366726.940408:0:15056:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789366726.940414:0:15056:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009a47f876/0x8da3486b955f4243 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366726.940423:0:15056:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x16:0x0].0x0 since=302s v=(0 0) 00010000:00010000:1.0:1789366726.940426:0:15056:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789366726.940430:0:15056:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009a47f876/0x8da3486b955f4243 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366726.940441:0:15056:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009a47f876/0x8da3486b955f4243 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366726.940448:0:15056:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009a47f876/0x8da3486b955f4243 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366726.940456:0:15056:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009a47f876/0x8da3486b955f4243 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366726.940471:0:15056:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789366726.940480:0:14359:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789366726.940490:0:14359:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009a47f876/0x8da3486b955f4243 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366726.940497:0:14359:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9638b6ce3c00 already unused, calling callback (ffffffffc16df520) 00010000:00010000:1.0:1789366726.940501:0:14359:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009a47f876/0x8da3486b955f4243 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366726.940508:0:14359:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009a47f876/0x8da3486b955f4243 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366726.940519:0:14359:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009a47f876/0x8da3486b955f4243 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366726.940527:0:14359:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009a47f876/0x8da3486b955f4243 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366726.940552:0:14359:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789366726.940554:0:14359:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789366726.940556:0:14359:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789366726.941007:0:15056:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789366726.941015:0:15056:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d8dc1c1c/0x8da3486b955f424a lrc: 3/0,1 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366726.941024:0:15056:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x15:0x0].0x0 since=302s v=(0 0) 00010000:00010000:1.0:1789366726.941027:0:15056:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789366726.941031:0:15056:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d8dc1c1c/0x8da3486b955f424a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366726.941052:0:15056:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d8dc1c1c/0x8da3486b955f424a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366726.941061:0:15056:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d8dc1c1c/0x8da3486b955f424a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366726.941069:0:15056:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d8dc1c1c/0x8da3486b955f424a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366726.941094:0:15056:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789366726.941114:0:14358:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789366726.941122:0:14358:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d8dc1c1c/0x8da3486b955f424a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366726.941144:0:14358:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9638b6ce3400 already unused, calling callback (ffffffffc16df520) 00010000:00010000:2.0:1789366726.941148:0:14358:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d8dc1c1c/0x8da3486b955f424a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366726.941157:0:14358:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d8dc1c1c/0x8da3486b955f424a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366726.941171:0:14358:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d8dc1c1c/0x8da3486b955f424a lrc: 1/0,0 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366726.941180:0:14358:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d8dc1c1c/0x8da3486b955f424a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366726.941198:0:14358:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789366726.941200:0:14358:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789366726.941203:0:14358:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789366726.941520:0:15056:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789366726.941526:0:15056:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000536c0f8/0x8da3486b955f4251 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366726.941533:0:15056:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=302s v=(0 0) 00010000:00010000:1.0:1789366726.941536:0:15056:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789366726.941553:0:15056:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000536c0f8/0x8da3486b955f4251 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366726.941563:0:15056:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000536c0f8/0x8da3486b955f4251 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366726.941570:0:15056:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000536c0f8/0x8da3486b955f4251 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366726.941587:0:15056:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000536c0f8/0x8da3486b955f4251 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366726.941603:0:15056:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789366726.941626:0:14359:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789366726.941633:0:14359:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000536c0f8/0x8da3486b955f4251 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366726.941640:0:14359:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9638c142cc00 already unused, calling callback (ffffffffc16df520) 00010000:00010000:2.0:1789366726.941643:0:14359:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000536c0f8/0x8da3486b955f4251 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366726.941651:0:14359:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000536c0f8/0x8da3486b955f4251 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366726.941681:0:14359:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000536c0f8/0x8da3486b955f4251 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366726.941688:0:14359:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000536c0f8/0x8da3486b955f4251 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366726.941710:0:14359:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789366726.941712:0:14359:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789366726.941715:0:14359:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789366726.942014:0:15056:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789366726.942021:0:15056:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ccea68a2/0x8da3486b955f4258 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366726.942029:0:15056:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x13:0x0].0x0 since=302s v=(0 0) 00010000:00010000:1.0:1789366726.942033:0:15056:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789366726.942037:0:15056:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ccea68a2/0x8da3486b955f4258 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366726.942047:0:15056:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ccea68a2/0x8da3486b955f4258 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366726.942055:0:15056:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ccea68a2/0x8da3486b955f4258 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366726.942062:0:15056:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ccea68a2/0x8da3486b955f4258 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366726.942089:0:15056:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789366726.942113:0:14358:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789366726.942119:0:14358:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ccea68a2/0x8da3486b955f4258 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366726.942128:0:14358:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9638c142c600 already unused, calling callback (ffffffffc16df520) 00010000:00010000:2.0:1789366726.942132:0:14358:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ccea68a2/0x8da3486b955f4258 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366726.942141:0:14358:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ccea68a2/0x8da3486b955f4258 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366726.942155:0:14358:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ccea68a2/0x8da3486b955f4258 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366726.942163:0:14358:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ccea68a2/0x8da3486b955f4258 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366726.942192:0:14358:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789366726.942195:0:14358:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789366726.942196:0:14358:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789366726.942486:0:15056:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789366726.942492:0:15056:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e9e75be4/0x8da3486b955f425f lrc: 3/0,1 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366726.942504:0:15056:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x12:0x0].0x0 since=302s v=(0 0) 00010000:00010000:1.0:1789366726.942507:0:15056:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789366726.942511:0:15056:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e9e75be4/0x8da3486b955f425f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366726.942519:0:15056:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e9e75be4/0x8da3486b955f425f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366726.942528:0:15056:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e9e75be4/0x8da3486b955f425f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366726.942535:0:15056:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e9e75be4/0x8da3486b955f425f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366726.943203:0:15056:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1789366726.943819:0:15056:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789366726.943826:0:15056:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000047a0e8f/0x8da3486b955f4266 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366726.943837:0:15056:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=302s v=(0 0) 00010000:00010000:1.0:1789366726.943841:0:15056:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789366726.943845:0:15056:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000047a0e8f/0x8da3486b955f4266 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366726.943855:0:15056:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000047a0e8f/0x8da3486b955f4266 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366726.943874:0:15056:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000047a0e8f/0x8da3486b955f4266 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366726.943881:0:15056:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000047a0e8f/0x8da3486b955f4266 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366726.943981:0:14359:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1789366726.943988:0:14359:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e9e75be4/0x8da3486b955f425f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366726.943997:0:14359:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9638c142d200 already unused, calling callback (ffffffffc16df520) 00010000:00010000:3.0:1789366726.944001:0:14359:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e9e75be4/0x8da3486b955f425f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366726.944011:0:14359:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e9e75be4/0x8da3486b955f425f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366726.944024:0:14359:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e9e75be4/0x8da3486b955f425f lrc: 1/0,0 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366726.944031:0:14359:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e9e75be4/0x8da3486b955f425f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366726.944048:0:14359:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789366726.944055:0:14359:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000047a0e8f/0x8da3486b955f4266 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366726.944060:0:14359:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9638c142ce00 already unused, calling callback (ffffffffc16df520) 00010000:00010000:3.0:1789366726.944071:0:14359:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000047a0e8f/0x8da3486b955f4266 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366726.944077:0:14359:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000047a0e8f/0x8da3486b955f4266 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366726.944087:0:14359:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000047a0e8f/0x8da3486b955f4266 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366726.944094:0:14359:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789366726.944096:0:14359:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789366726.944098:0:14359:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789366726.944164:0:15056:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1789366726.944170:0:15056:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000047a0e8f/0x8da3486b955f4266 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789366726.944750:0:15056:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789366726.944757:0:15056:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001d3fb2ca/0x8da3486b955f426d lrc: 3/0,1 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366726.944766:0:15056:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x10:0x0].0x0 since=302s v=(0 0) 00010000:00010000:1.0:1789366726.944769:0:15056:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789366726.944773:0:15056:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001d3fb2ca/0x8da3486b955f426d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366726.944784:0:15056:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001d3fb2ca/0x8da3486b955f426d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366726.944793:0:15056:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001d3fb2ca/0x8da3486b955f426d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366726.944811:0:15056:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001d3fb2ca/0x8da3486b955f426d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366726.944907:0:14358:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789366726.944912:0:14358:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001d3fb2ca/0x8da3486b955f426d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366726.944919:0:14358:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9638c142c800 already unused, calling callback (ffffffffc16df520) 00010000:00010000:3.0:1789366726.944923:0:14358:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001d3fb2ca/0x8da3486b955f426d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366726.944931:0:14358:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001d3fb2ca/0x8da3486b955f426d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366726.944942:0:14358:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001d3fb2ca/0x8da3486b955f426d lrc: 2/0,0 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366726.944952:0:14358:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789366726.944959:0:14358:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789366726.944962:0:14358:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789366726.944993:0:15056:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1789366726.944999:0:15056:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001d3fb2ca/0x8da3486b955f426d lrc: 0/0,0 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366726.945348:0:14359:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789366726.945567:0:15056:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789366726.945573:0:15056:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005665f749/0x8da3486b955f4274 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366726.945581:0:15056:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xf:0x0].0x0 since=302s v=(0 0) 00010000:00010000:1.0:1789366726.945585:0:15056:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789366726.945589:0:15056:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005665f749/0x8da3486b955f4274 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366726.945599:0:15056:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005665f749/0x8da3486b955f4274 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366726.945607:0:15056:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005665f749/0x8da3486b955f4274 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366726.945614:0:15056:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005665f749/0x8da3486b955f4274 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366726.945676:0:15056:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1789366726.946138:0:15056:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789366726.946143:0:15056:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c9481c92/0x8da3486b955f427b lrc: 3/0,1 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366726.946152:0:15056:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=302s v=(0 0) 00010000:00010000:1.0:1789366726.946156:0:15056:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789366726.946160:0:15056:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c9481c92/0x8da3486b955f427b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366726.946170:0:15056:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c9481c92/0x8da3486b955f427b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366726.946179:0:15056:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c9481c92/0x8da3486b955f427b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366726.946186:0:15056:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c9481c92/0x8da3486b955f427b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366726.946355:0:14358:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1789366726.946361:0:14358:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005665f749/0x8da3486b955f4274 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366726.946368:0:14358:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9638c142c000 already unused, calling callback (ffffffffc16df520) 00010000:00010000:3.0:1789366726.946371:0:14358:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005665f749/0x8da3486b955f4274 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366726.946379:0:14358:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005665f749/0x8da3486b955f4274 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366726.946391:0:14358:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005665f749/0x8da3486b955f4274 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366726.946399:0:14358:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005665f749/0x8da3486b955f4274 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366726.946420:0:14358:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789366726.946424:0:14358:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c9481c92/0x8da3486b955f427b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366726.946430:0:14358:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9638c142d400 already unused, calling callback (ffffffffc16df520) 00010000:00010000:3.0:1789366726.946433:0:14358:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c9481c92/0x8da3486b955f427b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366726.946453:0:14358:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c9481c92/0x8da3486b955f427b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366726.946463:0:14358:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c9481c92/0x8da3486b955f427b lrc: 2/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366726.946471:0:14358:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789366726.946473:0:14358:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789366726.946475:0:14358:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789366726.946531:0:15056:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1789366726.946536:0:15056:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c9481c92/0x8da3486b955f427b lrc: 0/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789366726.946991:0:15056:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789366726.946997:0:15056:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005b8e83c7/0x8da3486b955f4282 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366726.947011:0:15056:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=302s v=(0 0) 00010000:00010000:1.0:1789366726.947014:0:15056:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789366726.947018:0:15056:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005b8e83c7/0x8da3486b955f4282 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366726.947027:0:15056:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005b8e83c7/0x8da3486b955f4282 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366726.947034:0:15056:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005b8e83c7/0x8da3486b955f4282 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366726.947041:0:15056:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005b8e83c7/0x8da3486b955f4282 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366726.947157:0:14359:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789366726.947162:0:14359:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005b8e83c7/0x8da3486b955f4282 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366726.947170:0:14359:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9638c142de00 already unused, calling callback (ffffffffc16df520) 00010000:00010000:3.0:1789366726.947173:0:14359:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005b8e83c7/0x8da3486b955f4282 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366726.947181:0:14359:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005b8e83c7/0x8da3486b955f4282 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366726.947190:0:14359:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005b8e83c7/0x8da3486b955f4282 lrc: 2/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366726.947197:0:14359:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789366726.947199:0:14359:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789366726.947200:0:14359:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789366726.947660:0:15056:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1789366726.947666:0:15056:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005b8e83c7/0x8da3486b955f4282 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789366726.948131:0:15056:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789366726.948137:0:15056:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d1f1991f/0x8da3486b955f4289 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366726.948147:0:15056:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc:0x0].0x0 since=302s v=(0 0) 00010000:00010000:1.0:1789366726.948150:0:15056:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789366726.948154:0:15056:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d1f1991f/0x8da3486b955f4289 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366726.948173:0:15056:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d1f1991f/0x8da3486b955f4289 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366726.948180:0:15056:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d1f1991f/0x8da3486b955f4289 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366726.948187:0:15056:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d1f1991f/0x8da3486b955f4289 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366726.948353:0:14358:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789366726.948359:0:14358:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d1f1991f/0x8da3486b955f4289 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366726.948366:0:14358:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9638c142d800 already unused, calling callback (ffffffffc16df520) 00010000:00010000:3.0:1789366726.948369:0:14358:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d1f1991f/0x8da3486b955f4289 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366726.948378:0:14358:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d1f1991f/0x8da3486b955f4289 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366726.948435:0:14358:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d1f1991f/0x8da3486b955f4289 lrc: 2/0,0 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366726.948443:0:14358:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789366726.948444:0:14358:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789366726.948446:0:14358:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789366726.948685:0:15056:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1789366726.948691:0:15056:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d1f1991f/0x8da3486b955f4289 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789366726.949152:0:15056:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789366726.949158:0:15056:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cdeb998c/0x8da3486b955f4290 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366726.949165:0:15056:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=302s v=(0 0) 00010000:00010000:1.0:1789366726.949168:0:15056:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789366726.949171:0:15056:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cdeb998c/0x8da3486b955f4290 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366726.949179:0:15056:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cdeb998c/0x8da3486b955f4290 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366726.949192:0:15056:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cdeb998c/0x8da3486b955f4290 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366726.949196:0:15056:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000cdeb998c/0x8da3486b955f4290 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366726.949357:0:14359:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789366726.949361:0:14359:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000cdeb998c/0x8da3486b955f4290 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366726.949367:0:14359:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9638c142da00 already unused, calling callback (ffffffffc16df520) 00010000:00010000:3.0:1789366726.949369:0:14359:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000cdeb998c/0x8da3486b955f4290 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366726.949376:0:14359:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000cdeb998c/0x8da3486b955f4290 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366726.949391:0:14359:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000cdeb998c/0x8da3486b955f4290 lrc: 2/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366726.949397:0:14359:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789366726.949398:0:14359:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789366726.949400:0:14359:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789366726.949570:0:15056:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1789366726.949576:0:15056:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cdeb998c/0x8da3486b955f4290 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366726.949602:0:14358:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789366726.950019:0:15056:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789366726.950024:0:15056:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d233e9b3/0x8da3486b955f4297 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366726.950031:0:15056:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=302s v=(0 0) 00010000:00010000:1.0:1789366726.950034:0:15056:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789366726.950037:0:15056:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d233e9b3/0x8da3486b955f4297 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366726.950044:0:15056:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d233e9b3/0x8da3486b955f4297 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366726.950050:0:15056:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d233e9b3/0x8da3486b955f4297 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366726.950062:0:15056:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d233e9b3/0x8da3486b955f4297 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366726.950073:0:15056:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1789366726.950462:0:15056:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789366726.950466:0:15056:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001d864ace/0x8da3486b955f429e lrc: 3/0,1 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366726.950471:0:15056:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x9:0x0].0x0 since=302s v=(0 0) 00010000:00010000:1.0:1789366726.950473:0:15056:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789366726.950476:0:15056:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001d864ace/0x8da3486b955f429e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366726.950482:0:15056:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001d864ace/0x8da3486b955f429e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366726.950487:0:15056:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001d864ace/0x8da3486b955f429e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366726.950491:0:15056:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001d864ace/0x8da3486b955f429e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366726.950507:0:15056:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:1.0:1789366726.950905:0:15056:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789366726.950910:0:15056:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e1377ff5/0x8da3486b955f42a5 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366726.950923:0:15056:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=302s v=(0 0) 00010000:00010000:1.0:1789366726.950926:0:15056:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789366726.950930:0:14359:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1789366726.950931:0:15056:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e1377ff5/0x8da3486b955f42a5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366726.950939:0:14359:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d233e9b3/0x8da3486b955f4297 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366726.950945:0:15056:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e1377ff5/0x8da3486b955f42a5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366726.950957:0:14359:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9638c142c200 already unused, calling callback (ffffffffc16df520) 00010000:00010000:1.0:1789366726.950961:0:15056:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e1377ff5/0x8da3486b955f42a5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366726.950963:0:14359:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d233e9b3/0x8da3486b955f4297 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366726.950984:0:15056:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e1377ff5/0x8da3486b955f42a5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366726.950986:0:14359:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d233e9b3/0x8da3486b955f4297 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366726.951005:0:15056:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1789366726.951012:0:14359:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d233e9b3/0x8da3486b955f4297 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366726.951021:0:14359:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d233e9b3/0x8da3486b955f4297 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366726.951041:0:14359:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789366726.951045:0:14359:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001d864ace/0x8da3486b955f429e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366726.951052:0:14359:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9638c142d000 already unused, calling callback (ffffffffc16df520) 00010000:00010000:2.0:1789366726.951063:0:14359:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001d864ace/0x8da3486b955f429e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366726.951070:0:14359:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001d864ace/0x8da3486b955f429e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366726.951079:0:14359:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001d864ace/0x8da3486b955f429e lrc: 1/0,0 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366726.951086:0:14359:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001d864ace/0x8da3486b955f429e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366726.951098:0:14359:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789366726.951101:0:14359:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e1377ff5/0x8da3486b955f42a5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366726.951106:0:14359:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9638c142dc00 already unused, calling callback (ffffffffc16df520) 00010000:00010000:2.0:1789366726.951109:0:14359:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e1377ff5/0x8da3486b955f42a5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366726.951117:0:14359:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e1377ff5/0x8da3486b955f42a5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366726.951126:0:14359:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e1377ff5/0x8da3486b955f42a5 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366726.951132:0:14359:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e1377ff5/0x8da3486b955f42a5 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366726.951149:0:14359:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789366726.951150:0:14359:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789366726.951152:0:14359:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789366726.951567:0:15056:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789366726.951573:0:15056:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000986fbfed/0x8da3486b955f42ac lrc: 3/0,1 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366726.951581:0:15056:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=302s v=(0 0) 00010000:00010000:1.0:1789366726.951584:0:15056:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789366726.951588:0:15056:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000986fbfed/0x8da3486b955f42ac lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366726.951597:0:15056:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000986fbfed/0x8da3486b955f42ac lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366726.951616:0:15056:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000986fbfed/0x8da3486b955f42ac lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366726.951624:0:15056:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000986fbfed/0x8da3486b955f42ac lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366726.951642:0:15056:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789366726.951731:0:14359:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789366726.951735:0:14359:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000986fbfed/0x8da3486b955f42ac lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366726.951741:0:14359:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9638c142ca00 already unused, calling callback (ffffffffc16df520) 00010000:00010000:2.0:1789366726.951743:0:14359:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000986fbfed/0x8da3486b955f42ac lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366726.951749:0:14359:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000986fbfed/0x8da3486b955f42ac lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366726.951757:0:14359:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000986fbfed/0x8da3486b955f42ac lrc: 1/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366726.951762:0:14359:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000986fbfed/0x8da3486b955f42ac lrc: 0/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366726.951776:0:14359:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789366726.951778:0:14359:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789366726.951781:0:14359:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:1.0:1789366726.951842:0:15056:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x240000400:6 00000100:00100000:1.0:1789366726.951946:0:15056:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638b6d56680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:14394:x1876286758798208:12345-0@lo:5:osp-pre-0-0.0 Request processed in 44442us (44567us total) trans 0 rc 0/0 00000100:00100000:1.0:1789366726.951956:0:15056:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789366726.951990:0:14394:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9638b6d54a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14394:1876286758798208:0@lo:5:osp-pre-0-0.0 00000004:00080000:2.0:1789366726.952002:0:14394:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x240000400:0x21:0x0] from OST, last_created [0x240000400:0x21:0x0]last_used is [0x240000400:0x6:0x0] 00010000:00010000:0.0:1789366726.952037:0:14358:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789366726.952046:0:14394:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9638aef27800 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14394:1876286758798336:0@lo:5:osp-pre-0-0.0 00000100:00100000:2.0:1789366726.952073:0:14394:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789366726.952115:0:14394:0:(client.c:2716:ptlrpc_set_wait()) set ffff9638906c56c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789366726.952149:0:15055:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286758798336 00000100:00100000:1.0:1789366726.952155:0:15055:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286758798336 00000100:00100000:1.0:1789366726.952190:0:15055:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789366726.952196:0:15055:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638aef26a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:14394:x1876286758798336:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:1.0:1789366726.952225:0:15055:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x240000400 at 34 00000100:00100000:1.0:1789366726.954978:0:15055:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638aef26a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:14394:x1876286758798336:12345-0@lo:5:osp-pre-0-0.0 Request processed in 2776us (2899us total) trans 8589934593 rc 0/0 00000100:00100000:1.0:1789366726.954987:0:15055:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789366726.955027:0:14394:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9638aef27800 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14394:1876286758798336:0@lo:5:osp-pre-0-0.0 00000004:00080000:1.0:1789366726.955038:0:14394:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x240000400:0x21:0x0]-[0x240000400:0x41:0x0] 00000004:00080000:0.0:1789366726.955840:0:5837:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00010000:00010000:2.0:1789366727.865455:0:14359:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1789366728.056991:0:14406:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1789366728.057002:0:14406:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1789366728.060027:0:14406:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 1 00000040:00080000:1.0:1789366728.060136:0:14406:0:(llog_cat_server.c:902:llog_cat_cleanup()) cancel plain log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1789366728.060180:0:14406:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 1 count 1 00000001:02000400:1.0:1789366728.424045:0:15418:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg223-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:0.0:1789366728.890222:0:14358:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789366729.911876:0:14359:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1789366730.247794:0:6685:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:1.0:1789366730.247812:0:6685:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934593 is committed 00010000:00010000:0.0:1789366730.935937:0:14358:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789366731.964849:0:14359:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1789366732.216930:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789366732.216937:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1789366732.216941:0:36:0:(import.c:65:import_set_state_nolock()) ffff963882f31800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1789366732.216950:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 302 00000100:00080000:0.0:1789366732.216956:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:0.0:1789366732.216967:0:36:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff963882f31800 using connection 192.168.202.123@tcp/0@lo 00000100:00100000:0.0:1789366732.216999:0:36:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff963787499500 x1876286758798848/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1789366732.217044:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff963787498e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3285:1876286758798976:0@lo:400:kworker.0 00000100:00100000:3.0:1789366732.217046:0:3287:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff963787499c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:987e24be-cce8-4f54-8344-02fd27f3b2a2:3287:1876286758798592:0@lo:400:kworker.0 00000100:00100000:1.0:1789366732.217098:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff963787499180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3284:1876286758798720:0@lo:400:kworker.0 00000100:00100000:2.0:1789366732.217167:0:3286:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96388327d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3286:1876286758798464:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789366732.217925:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789366732.218003:0:3287:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789366732.218051:0:14372:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286758798976 00000100:00100000:3.0:1789366732.218058:0:14372:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286758798976 00000100:00100000:3.0:1789366732.218120:0:14372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1789366732.218129:0:14372:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96378749b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3285:x1876286758798976:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789366732.218177:0:14372:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96378749b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3285:x1876286758798976:12345-0@lo:400:kworker.0 Request processed in 49us (253us total) trans 0 rc 0/0 00000100:00100000:3.0:1789366732.218185:0:14372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:0.0:1789366732.218746:0:3285:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff963787498e00 x1876286758798976/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789366748 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789366732.218890:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff963787498e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3285:1876286758798976:0@lo:400:kworker.0 00000100:00100000:0.0:1789366732.218943:0:14365:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286758798592 00000100:00100000:0.0:1789366732.218948:0:14365:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286758798592 00000100:00100000:0.0:1789366732.219091:0:14365:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1789366732.219099:0:14365:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638bfe9b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:987e24be-cce8-4f54-8344-02fd27f3b2a2+16:3287:x1876286758798592:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789366732.219146:0:14365:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638bfe9b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:987e24be-cce8-4f54-8344-02fd27f3b2a2+16:3287:x1876286758798592:12345-0@lo:400:kworker.0 Request processed in 47us (1143us total) trans 0 rc 0/0 00000100:00100000:0.0:1789366732.219153:0:14365:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1789366732.219185:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff963787499500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3283:1876286758798848:0@lo:8:kworker.0 00000100:00100000:0.0:1789366732.219215:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789366732.219263:0:15056:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286758798848 00000100:00100000:0.0:1789366732.219267:0:15056:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286758798848 00000100:00100000:0.0:1789366732.219286:0:15056:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1789366732.219291:0:15056:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963787498e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3283:x1876286758798848:12345-0@lo:8:kworker.0 00010000:00020000:0.0:1789366732.219308:0:15056:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1789366732.220028:0:3287:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff963787499c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:987e24be-cce8-4f54-8344-02fd27f3b2a2:3287:1876286758798592:0@lo:400:kworker.0 00000100:00100000:1.0:1789366732.220853:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789366732.224778:0:15055:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:3.0:1789366732.225185:0:15055:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:1.0:1789366732.225673:0:15055:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286758798720 00000100:00100000:1.0:1789366732.225861:0:15055:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286758798720 00000100:00100000:1.0:1789366732.225917:0:15055:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:1.0:1789366732.225929:0:15055:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789366732.225939:0:15055:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96388327c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3284:x1876286758798720:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789366732.226753:0:15055:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96388327c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3284:x1876286758798720:12345-0@lo:400:kworker.0 Request processed in 813us (5898us total) trans 0 rc 0/0 00000100:00100000:1.0:1789366732.226762:0:15055:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:1.0:1789366732.227873:0:14366:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789366732.227914:0:3284:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934593 gen 2 00000100:00100000:1.0:1789366732.227934:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff963787499180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3284:1876286758798720:0@lo:400:kworker.0 00000100:00100000:2.0:1789366732.228069:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789366732.228575:0:15059:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286758798464 00000100:00100000:1.0:1789366732.228581:0:15059:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286758798464 00000100:00100000:2.0:1789366732.228933:0:3286:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96378749a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3286:1876286758799104:0@lo:400:kworker.0 00000100:00100000:2.0:1789366732.228974:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789366732.229295:0:15059:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789366732.229306:0:15059:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638aef27480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3286:x1876286758798464:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789366732.229339:0:15059:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789366732.229386:0:15059:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638aef27480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3286:x1876286758798464:12345-0@lo:13:osp-pre-0-0.0 Request processed in 82us (1317us total) trans 0 rc 0/0 00000100:00100000:1.0:1789366732.229393:0:15059:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789366732.229433:0:3286:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96388327d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3286:1876286758798464:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789366732.229920:0:14370:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286758799104 00000100:00100000:1.0:1789366732.229925:0:14370:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286758799104 00000100:00100000:1.0:1789366732.229963:0:14370:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1789366732.229970:0:14370:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638aef24a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3286:x1876286758799104:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789366732.230012:0:14370:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638aef24a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3286:x1876286758799104:12345-0@lo:400:kworker.0 Request processed in 42us (1037us total) trans 0 rc 0/0 00000100:00100000:1.0:1789366732.230020:0:14370:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:1.0:1789366732.230035:0:14366:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1789366732.230060:0:3286:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff96378749a300 x1876286758799104/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789366748 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789366732.230073:0:3286:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96378749a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3286:1876286758799104:0@lo:400:kworker.0 00000100:00100000:0.0:1789366732.253200:0:15056:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963787498e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3283:x1876286758798848:12345-0@lo:8:kworker.0 Request processed in 33897us (33973us total) trans 0 rc -19/-19 00000100:00100000:0.0:1789366732.253214:0:15056:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:0.0:1789366732.255130:0:3283:0:(import.c:65:import_set_state_nolock()) ffff963882f31800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1789366732.255141:0:3283:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1789366732.255146:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff963787499500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3283:1876286758798848:0@lo:8:kworker.0 00000020:01000004:0.0:1789366732.917072:0:15769:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:0.0:1789366732.917076:0:15769:0:(obd_mount.c:926:lmd_print()) device: lustre-ost2/ost2 00000080:01200004:0.0:1789366732.917193:0:15769:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff963888974000 00000020:01000004:0.0:1789366732.917209:0:15769:0:(tgt_mount.c:2506:osd_start()) Attempting to start lustre-OST0001, type=osd-zfs, lsifl=200002, mountfl=0 00000020:01000004:0.0:1789366732.917232:0:15769:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-zfs) 00000020:00000080:0.0:1789366732.917247:0:15769:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff96388952cd40) 00000020:00000080:0.0:1789366732.917282:0:15769:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type osd-zfs with refcount 2 00100000:10000000:0.0:1789366732.932147:0:15769:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:0.0:1789366732.932482:0:15769:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0001: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:0.0:1789366732.933409:0:15769:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:0.0:1789366732.933655:0:15769:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00100000:10000000:0.0:1789366732.933952:0:15769:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0001: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:0.0:1789366732.934475:0:15769:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled params under 512: rc = 0 00100000:10000000:0.0:1789366732.934583:0:15769:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled lustre-OST0001 under 512: rc = 0 00100000:10000000:0.0:1789366732.934676:0:15769:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled lustre-client under 512: rc = 0 00100000:10000000:0.0:1789366732.935152:0:15769:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x1020000 under 896: rc = 0 00100000:10000000:0.0:1789366732.935571:0:15769:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x20000-OST0001 under 896: rc = 0 00100000:10000000:0.0:1789366732.935924:0:15769:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x2020000-OST0001 under 896: rc = 0 00100000:10000000:0.0:1789366732.936215:0:15769:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x2020000 under 896: rc = 0 00100000:10000000:0.0:1789366732.936559:0:15769:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x1020000-OST0001 under 896: rc = 0 00100000:10000000:0.0:1789366732.936828:0:15769:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x20000 under 896: rc = 0 00000020:00000080:0.0:1789366732.937502:0:15769:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:0.0:1789366732.937515:0:15769:0:(osd_handler.c:1574:osd_obd_connect()) connect #0 00000020:00000080:0.0:1789366732.937524:0:15769:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x8da3486b955f42ba 00000020:01000004:0.0:1789366732.937533:0:15769:0:(tgt_mount.c:2591:server_fill_super()) Found service lustre-OST0001 on device lustre-ost2/ost2 00000020:01000004:0.0:1789366732.937557:0:15769:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.202.123@tcp:Set MGC reconnect 1 10000000:01000000:0.0:1789366732.937560:0:15769:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.202.123@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:0.0:1789366732.937565:0:15769:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-OST0001 00000020:01000004:0.0:1789366732.937586:0:15769:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost2/ost2 10000000:01000000:0.0:1789366732.937589:0:15769:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.123@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:0.0:1789366732.943785:0:15769:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.123@tcp ctxt 0 is initialized 00000020:01000004:0.0:1789366732.943816:0:15769:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.202.123@tcp, index=0001, flags=0x20002 00000020:01000004:0.0:1789366732.943822:0:15769:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1789366732.943823:0:15769:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1789366732.943824:0:15769:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789366732.943824:0:15769:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789366732.943825:0:15769:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789366732.943826:0:15769:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789366732.943827:0:15769:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1789366732.943828:0:15769:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789366732.943828:0:15769:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1789366732.943831:0:15769:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020002 00000020:01000004:0.0:1789366732.943832:0:15769:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1789366732.943833:0:15769:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1789366732.943834:0:15769:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789366732.943834:0:15769:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789366732.943835:0:15769:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789366732.943836:0:15769:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789366732.943836:0:15769:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1789366732.943837:0:15769:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789366732.943837:0:15769:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1789366732.943860:0:15769:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:0.0:1789366732.943876:0:15769:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff963787499500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:987e24be-cce8-4f54-8344-02fd27f3b2a2:15769:1876286758799232:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1789366732.943940:0:15769:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789366732.944034:0:15769:0:(client.c:2716:ptlrpc_set_wait()) set ffff9638bffac3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789366732.944155:0:14364:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286758799232 00000100:00100000:1.0:1789366732.944161:0:14364:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286758799232 00000100:00100000:1.0:1789366732.944224:0:14364:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1789366732.944234:0:14364:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638bfe99850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:987e24be-cce8-4f54-8344-02fd27f3b2a2+16:15769:x1876286758799232:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1789366732.944273:0:14364:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:1.0:1789366732.944278:0:14364:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0001 is running on 0@lo 20000000:01000000:1.0:1789366732.944281:0:14364:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:1.0:1789366732.950258:0:14364:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638bfe99850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:987e24be-cce8-4f54-8344-02fd27f3b2a2+16:15769:x1876286758799232:12345-0@lo:253:mount.lustre.0 Request processed in 6020us (6310us total) trans 0 rc 0/0 00000100:00100000:1.0:1789366732.950271:0:14364:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1789366732.950407:0:15769:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff963787499500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:987e24be-cce8-4f54-8344-02fd27f3b2a2:15769:1876286758799232:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1789366732.950420:0:15769:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:0.0:1789366732.950421:0:15769:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1789366732.950423:0:15769:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1789366732.950424:0:15769:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789366732.950424:0:15769:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789366732.950425:0:15769:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789366732.950426:0:15769:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789366732.950427:0:15769:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1789366732.950428:0:15769:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789366732.950429:0:15769:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1789366732.950446:0:15769:0:(tgt_mount.c:101:server_register_mount()) register mount ffff963888974000 from lustre-OST0001 10000000:01000000:0.0:1789366732.950466:0:15769:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:0.0:1789366732.950468:0:15769:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:0.0:1789366732.950494:0:15769:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff963882f5b380 local copy 00010000:00010000:0.0:1789366732.950503:0:15769:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.123@tcp lock: ffff9638832d2600/0x8da3486b955f4067 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x8da3486b955f406e expref: -99 pid: 14352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789366732.950676:0:15769:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff963787499500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:987e24be-cce8-4f54-8344-02fd27f3b2a2:15769:1876286758799360:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789366732.950703:0:15769:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789366732.950801:0:15769:0:(client.c:2716:ptlrpc_set_wait()) set ffff9638bffac780 going to sleep for 11 seconds 00000100:00100000:1.0:1789366732.950861:0:14363:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286758799360 00000100:00100000:1.0:1789366732.950868:0:14363:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286758799360 00000100:00100000:1.0:1789366732.950921:0:14363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1789366732.950928:0:14363:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638bfe99c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:987e24be-cce8-4f54-8344-02fd27f3b2a2+16:15769:x1876286758799360:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789366732.951122:0:14363:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638bfe99c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:987e24be-cce8-4f54-8344-02fd27f3b2a2+16:15769:x1876286758799360:12345-0@lo:501:mount.lustre.0 Request processed in 193us (417us total) trans 0 rc -2/-2 00000100:00100000:1.0:1789366732.951132:0:14363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1789366732.951178:0:15769:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff963787499500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:987e24be-cce8-4f54-8344-02fd27f3b2a2:15769:1876286758799360:0@lo:501:mount.lustre.0 10000000:01000000:2.0:1789366732.951187:0:15769:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.202.123@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:2.0:1789366732.951300:0:15769:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.202.123@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:2.0:1789366732.951305:0:15769:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.123@tcp lock: ffff9638832d2600/0x8da3486b955f4067 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x8da3486b955f406e expref: -99 pid: 14352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366732.951312:0:15769:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.123@tcp lock: ffff9638832d2600/0x8da3486b955f4067 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x8da3486b955f406e expref: -99 pid: 14352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789366732.951326:0:15769:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff963888974000 10000000:01000000:2.0:1789366732.951329:0:15769:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1789366732.951332:0:15769:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:2.0:1789366732.951334:0:15769:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1789366732.951336:0:15769:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:2.0:1789366732.951338:0:15769:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:2.0:1789366732.951364:0:15769:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.123@tcp lock: ffff9638902c8200/0x8da3486b955f42c1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366732.951369:0:15769:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.123@tcp lock: ffff9638902c8200/0x8da3486b955f42c1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366732.951381:0:15769:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.123@tcp lock: ffff9638902c8200/0x8da3486b955f42c1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789366732.951389:0:15769:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9638aef26680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:987e24be-cce8-4f54-8344-02fd27f3b2a2:15769:1876286758799488:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1789366732.951409:0:15769:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789366732.951640:0:15769:0:(client.c:2716:ptlrpc_set_wait()) set ffff963891fac180 going to sleep for 11 seconds 00000100:00100000:0.0:1789366732.951649:0:14365:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286758799488 00000100:00100000:0.0:1789366732.951654:0:14365:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286758799488 00000100:00100000:0.0:1789366732.951675:0:14365:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1789366732.951682:0:14365:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638bfe98050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:987e24be-cce8-4f54-8344-02fd27f3b2a2+16:15769:x1876286758799488:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789366732.951694:0:14365:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789366732.951706:0:14365:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9638b720d600/0x8da3486b955f42c8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x8da3486b955f42c1 expref: -99 pid: 14365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366732.951754:0:14365:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9638b720d600/0x8da3486b955f42c8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8da3486b955f42c1 expref: 17 pid: 14365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366732.951764:0:14365:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9638b720d600/0x8da3486b955f42c8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8da3486b955f42c1 expref: 17 pid: 14365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366732.951773:0:14365:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9638b720d600, rc 0) 00000100:00100000:0.0:1789366732.951806:0:14365:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638bfe98050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:987e24be-cce8-4f54-8344-02fd27f3b2a2+17:15769:x1876286758799488:12345-0@lo:101:mount.lustre.0 Request processed in 125us (395us total) trans 0 rc 0/0 00000100:00100000:0.0:1789366732.951812:0:14365:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1789366732.951965:0:15769:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9638aef26680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:987e24be-cce8-4f54-8344-02fd27f3b2a2:15769:1876286758799488:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789366732.951977:0:15769:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.123@tcp lock: ffff9638902c8200/0x8da3486b955f42c1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x8da3486b955f42c8 expref: -99 pid: 15769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366732.951985:0:15769:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.123@tcp lock: ffff9638902c8200/0x8da3486b955f42c1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x8da3486b955f42c8 expref: -99 pid: 15769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1789366732.952529:0:15769:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:2.0:1789366732.953155:0:15769:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1789366732.953341:0:15769:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:2.0:1789366732.953449:0:15769:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:2.0:1789366732.953479:0:15769:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:2.0:1789366732.953539:0:15769:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:2.0:1789366732.953573:0:15769:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:2.0:1789366732.953606:0:15769:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:2.0:1789366732.953664:0:15769:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:2.0:1789366732.953671:0:15769:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:2.0:1789366732.953769:0:15769:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9638aef26680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:987e24be-cce8-4f54-8344-02fd27f3b2a2:15769:1876286758799616:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789366732.953809:0:15769:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789366732.953843:0:15769:0:(client.c:2716:ptlrpc_set_wait()) set ffff963891facb40 going to sleep for 11 seconds 00000100:00100000:0.0:1789366732.953864:0:14365:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286758799616 00000100:00100000:0.0:1789366732.953871:0:14365:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286758799616 00000100:00100000:0.0:1789366732.953908:0:14365:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1789366732.953917:0:14365:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638bfe9b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:987e24be-cce8-4f54-8344-02fd27f3b2a2+17:15769:x1876286758799616:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789366732.954214:0:14365:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638bfe9b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:987e24be-cce8-4f54-8344-02fd27f3b2a2+17:15769:x1876286758799616:12345-0@lo:501:mount.lustre.0 Request processed in 298us (403us total) trans 0 rc 0/0 00000100:00100000:0.0:1789366732.954222:0:14365:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1789366732.954290:0:15769:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9638aef26680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:987e24be-cce8-4f54-8344-02fd27f3b2a2:15769:1876286758799616:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789366732.954324:0:15769:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9638aef26680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:987e24be-cce8-4f54-8344-02fd27f3b2a2:15769:1876286758799744:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1789366732.954420:0:15769:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789366732.954476:0:15769:0:(client.c:2716:ptlrpc_set_wait()) set ffff963891facb40 going to sleep for 11 seconds 00000100:00100000:3.0:1789366732.954520:0:14364:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286758799744 00000100:00100000:3.0:1789366732.954524:0:14364:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286758799744 00000100:00100000:3.0:1789366732.954549:0:14364:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1789366732.954556:0:14364:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638bfe9bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:987e24be-cce8-4f54-8344-02fd27f3b2a2+17:15769:x1876286758799744:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1789366732.954890:0:14364:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638bfe9bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:987e24be-cce8-4f54-8344-02fd27f3b2a2+17:15769:x1876286758799744:12345-0@lo:503:mount.lustre.0 Request processed in 334us (469us total) trans 0 rc 0/0 00000100:00100000:3.0:1789366732.954895:0:14364:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1789366732.954946:0:15769:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9638aef26680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:987e24be-cce8-4f54-8344-02fd27f3b2a2:15769:1876286758799744:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1789366732.955660:0:15769:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1789366732.955701:0:15769:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9638aef26680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:987e24be-cce8-4f54-8344-02fd27f3b2a2:15769:1876286758799872:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789366732.955758:0:15769:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789366732.955833:0:15769:0:(client.c:2716:ptlrpc_set_wait()) set ffff963891facb40 going to sleep for 11 seconds 00000100:00100000:1.0:1789366732.955866:0:14363:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286758799872 00000100:00100000:1.0:1789366732.955872:0:14363:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286758799872 00000100:00100000:1.0:1789366732.955900:0:14363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1789366732.955908:0:14363:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638bfe9a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:987e24be-cce8-4f54-8344-02fd27f3b2a2+17:15769:x1876286758799872:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789366732.956115:0:14363:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638bfe9a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:987e24be-cce8-4f54-8344-02fd27f3b2a2+17:15769:x1876286758799872:12345-0@lo:502:mount.lustre.0 Request processed in 208us (356us total) trans 0 rc 0/0 00000100:00100000:1.0:1789366732.956120:0:14363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1789366732.956170:0:15769:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9638aef26680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:987e24be-cce8-4f54-8344-02fd27f3b2a2:15769:1876286758799872:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1789366732.956402:0:15769:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:2.0:1789366732.956437:0:15769:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:2.0:1789366732.956453:0:15769:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:2.0:1789366732.956480:0:15769:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:2.0:1789366732.956514:0:15769:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:2.0:1789366732.956531:0:15769:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:2.0:1789366732.956555:0:15769:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:2.0:1789366732.956588:0:15769:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:2.0:1789366732.956630:0:15769:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 120 off9752 00000100:00100000:2.0:1789366732.956648:0:15769:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9638aef26680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:987e24be-cce8-4f54-8344-02fd27f3b2a2:15769:1876286758800000:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789366732.956673:0:15769:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789366732.956747:0:15769:0:(client.c:2716:ptlrpc_set_wait()) set ffff963891facb40 going to sleep for 11 seconds 00000100:00100000:3.0:1789366732.956779:0:14364:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286758800000 00000100:00100000:3.0:1789366732.956782:0:14364:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286758800000 00000100:00100000:3.0:1789366732.956803:0:14364:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1789366732.956811:0:14364:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638bfe98850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:987e24be-cce8-4f54-8344-02fd27f3b2a2+17:15769:x1876286758800000:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789366732.956953:0:14364:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638bfe98850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:987e24be-cce8-4f54-8344-02fd27f3b2a2+17:15769:x1876286758800000:12345-0@lo:502:mount.lustre.0 Request processed in 143us (279us total) trans 0 rc 0/0 00000100:00100000:3.0:1789366732.956958:0:14364:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1789366732.956996:0:15769:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9638aef26680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:987e24be-cce8-4f54-8344-02fd27f3b2a2:15769:1876286758800000:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1789366732.957083:0:15769:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9976 00000040:00080000:2.0:1789366732.957090:0:15769:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 10 count 11 00000020:01000000:2.0:1789366732.958105:0:15770:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1789366732.958112:0:15770:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-ost2/ost2 00000020:00000080:2.0:1789366732.958129:0:15770:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789366732.958131:0:15770:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-OST0001 add ost 00000020:00000080:2.0:1789366732.958135:0:15770:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1789366732.958146:0:15770:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff9638986a19c0) 00000020:00000080:2.0:1789366732.958163:0:15770:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type obdfilter with refcount 2 00000020:00000080:2.0:1789366732.958167:0:15770:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1789366732.958301:0:15770:0:(tgt_mount.c:153:server_get_mount()) get mount ffff963888974000 from lustre-OST0001, refs=2 00080000:01000000:2.0:1789366732.958308:0:15770:0:(osd_handler.c:1574:osd_obd_connect()) connect #1 00000020:00000080:2.0:1789366732.958314:0:15770:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x8da3486b955f42d6 00010000:00010000:2.0:1789366732.961288:0:15770:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-3 is initialized 00000001:00000004:2.0:1789366732.961672:0:15770:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 4294967310 00080000:10000000:2.0:1789366732.963498:0:15770:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0xb:0x0] (8/8/4) registered 00000020:00000080:0.0:1789366732.964606:0:15770:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:0.0:1789366732.964615:0:15770:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789366732.964620:0:15770:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789366732.964623:0:15770:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-OST0001 add ost 00000020:01000000:0.0:1789366732.964626:0:15770:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789366732.964630:0:15770:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789366732.964631:0:15770:0:(obd_config.c:1563:class_process_config()) marker 21 (0x1) lustre sys.timeout 00000020:00000080:0.0:1789366732.964634:0:15770:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1789366732.964635:0:15770:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1789366732.964637:0:15770:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789366732.964639:0:15770:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789366732.964640:0:15770:0:(obd_config.c:1563:class_process_config()) marker 21 (0x2) lustre sys.timeout 00000020:01000000:0.0:1789366732.964642:0:15770:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789366732.964645:0:15770:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789366732.964646:0:15770:0:(obd_config.c:1563:class_process_config()) marker 25 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1789366732.964649:0:15770:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:0.0:1789366732.964693:0:15770:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789366732.964695:0:15770:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789366732.964696:0:15770:0:(obd_config.c:1563:class_process_config()) marker 25 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1789366732.964698:0:15770:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 11 count 11 00000020:01000000:2.0:1789366732.964782:0:15769:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-10 (rc=0) 10000000:01000000:2.0:1789366732.964815:0:15769:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.123@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:2.0:1789366732.964848:0:15769:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.123@tcp lock: ffff9638902c8200/0x8da3486b955f42c1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x8da3486b955f42c8 expref: -99 pid: 15769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366732.964865:0:15769:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.123@tcp lock: ffff9638902c8200/0x8da3486b955f42c1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x8da3486b955f42c8 expref: -99 pid: 15769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789366732.964874:0:15769:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff963888974000 from 1 10000000:01000000:2.0:1789366732.964877:0:15769:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1789366732.964913:0:15769:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.123@tcp lock: ffff9638902c9e00/0x8da3486b955f42dd lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366732.964931:0:15769:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.123@tcp lock: ffff9638902c9e00/0x8da3486b955f42dd lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366732.964942:0:15769:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.123@tcp lock: ffff9638902c9e00/0x8da3486b955f42dd lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789366732.964967:0:15769:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9638aef26680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:987e24be-cce8-4f54-8344-02fd27f3b2a2:15769:1876286758800128:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1789366732.965043:0:15769:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789366732.965092:0:15769:0:(client.c:2716:ptlrpc_set_wait()) set ffff963891facc00 going to sleep for 11 seconds 00000100:00100000:0.0:1789366732.966647:0:14363:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286758800128 00000100:00100000:0.0:1789366732.966657:0:14363:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286758800128 00000100:00100000:0.0:1789366732.966740:0:14363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1789366732.966751:0:14363:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638bfe98450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:987e24be-cce8-4f54-8344-02fd27f3b2a2+17:15769:x1876286758800128:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789366732.966767:0:14363:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789366732.966781:0:14363:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9638b720ca00/0x8da3486b955f42e4 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x8da3486b955f42dd expref: -99 pid: 14363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366732.966821:0:14363:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9638b720ca00/0x8da3486b955f42e4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8da3486b955f42dd expref: 18 pid: 14363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366732.966833:0:14363:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9638b720ca00/0x8da3486b955f42e4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8da3486b955f42dd expref: 18 pid: 14363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366732.966843:0:14363:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9638b720ca00, rc 0) 00000100:00100000:0.0:1789366732.966897:0:14363:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638bfe98450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:987e24be-cce8-4f54-8344-02fd27f3b2a2+18:15769:x1876286758800128:12345-0@lo:101:mount.lustre.0 Request processed in 148us (1855us total) trans 0 rc 0/0 00000100:00100000:0.0:1789366732.966904:0:14363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1789366732.967058:0:15769:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9638aef26680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:987e24be-cce8-4f54-8344-02fd27f3b2a2:15769:1876286758800128:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789366732.967076:0:15769:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.123@tcp lock: ffff9638902c9e00/0x8da3486b955f42dd lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x8da3486b955f42e4 expref: -99 pid: 15769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366732.967087:0:15769:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.123@tcp lock: ffff9638902c9e00/0x8da3486b955f42dd lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x8da3486b955f42e4 expref: -99 pid: 15769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1789366732.967616:0:15769:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:1.0:1789366732.968416:0:15769:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789366732.969252:0:15769:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:1.0:1789366732.969310:0:15769:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:1.0:1789366732.969417:0:15769:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:1.0:1789366732.969432:0:15769:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:1.0:1789366732.969523:0:15769:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96388327d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:987e24be-cce8-4f54-8344-02fd27f3b2a2:15769:1876286758800256:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789366732.969582:0:15769:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789366732.969680:0:15769:0:(client.c:2716:ptlrpc_set_wait()) set ffff9638bd3923c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789366732.969823:0:14364:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286758800256 00000100:00100000:0.0:1789366732.969830:0:14364:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286758800256 00000100:00100000:0.0:1789366732.969907:0:14364:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1789366732.969919:0:14364:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638bfe9a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:987e24be-cce8-4f54-8344-02fd27f3b2a2+18:15769:x1876286758800256:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789366732.970154:0:14364:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638bfe9a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:987e24be-cce8-4f54-8344-02fd27f3b2a2+18:15769:x1876286758800256:12345-0@lo:501:mount.lustre.0 Request processed in 237us (571us total) trans 0 rc 0/0 00000100:00100000:0.0:1789366732.970163:0:14364:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1789366732.970519:0:15769:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96388327d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:987e24be-cce8-4f54-8344-02fd27f3b2a2:15769:1876286758800256:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789366732.970548:0:15769:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff963787498380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:987e24be-cce8-4f54-8344-02fd27f3b2a2:15769:1876286758800384:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1789366732.970587:0:15769:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789366732.970618:0:15769:0:(client.c:2716:ptlrpc_set_wait()) set ffff9638bffac0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789366732.970620:0:14365:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286758800384 00000100:00100000:2.0:1789366732.970626:0:14365:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286758800384 00000100:00100000:2.0:1789366732.970656:0:14365:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1789366732.970665:0:14365:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638bfe98c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:987e24be-cce8-4f54-8344-02fd27f3b2a2+18:15769:x1876286758800384:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1789366732.971039:0:14365:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638bfe98c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:987e24be-cce8-4f54-8344-02fd27f3b2a2+18:15769:x1876286758800384:12345-0@lo:503:mount.lustre.0 Request processed in 374us (450us total) trans 0 rc 0/0 00000100:00100000:2.0:1789366732.971047:0:14365:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1789366732.971066:0:15769:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff963787498380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:987e24be-cce8-4f54-8344-02fd27f3b2a2:15769:1876286758800384:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1789366732.971861:0:15769:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1789366732.971917:0:15769:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff963787498380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:987e24be-cce8-4f54-8344-02fd27f3b2a2:15769:1876286758800512:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789366732.971963:0:15769:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789366732.972093:0:15769:0:(client.c:2716:ptlrpc_set_wait()) set ffff9638bffac0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789366732.972125:0:14364:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286758800512 00000100:00100000:3.0:1789366732.972130:0:14364:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286758800512 00000100:00100000:3.0:1789366732.972198:0:14364:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1789366732.972207:0:14364:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638bfe99450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:987e24be-cce8-4f54-8344-02fd27f3b2a2+18:15769:x1876286758800512:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789366732.972391:0:14364:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638bfe99450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:987e24be-cce8-4f54-8344-02fd27f3b2a2+18:15769:x1876286758800512:12345-0@lo:502:mount.lustre.0 Request processed in 184us (426us total) trans 0 rc 0/0 00000100:00100000:3.0:1789366732.972399:0:14364:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1789366732.972463:0:15769:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff963787498380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:987e24be-cce8-4f54-8344-02fd27f3b2a2:15769:1876286758800512:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1789366732.972680:0:15769:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:0.0:1789366732.972791:0:15769:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:0.0:1789366732.972863:0:15769:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:0.0:1789366732.972905:0:15769:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:0.0:1789366732.972943:0:15769:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:0.0:1789366732.973017:0:15769:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:0.0:1789366732.973063:0:15769:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:0.0:1789366732.973102:0:15769:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000100:00100000:0.0:1789366732.973128:0:15769:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff963787498380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:987e24be-cce8-4f54-8344-02fd27f3b2a2:15769:1876286758800640:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789366732.973167:0:15769:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789366732.973204:0:15769:0:(client.c:2716:ptlrpc_set_wait()) set ffff9638bffac0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789366732.973252:0:14365:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286758800640 00000100:00100000:2.0:1789366732.973256:0:14365:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286758800640 00000100:00100000:2.0:1789366732.973293:0:14365:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1789366732.973300:0:14365:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638bf499c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:987e24be-cce8-4f54-8344-02fd27f3b2a2+18:15769:x1876286758800640:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789366732.973427:0:14365:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638bf499c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:987e24be-cce8-4f54-8344-02fd27f3b2a2+18:15769:x1876286758800640:12345-0@lo:502:mount.lustre.0 Request processed in 128us (260us total) trans 0 rc 0/0 00000100:00100000:2.0:1789366732.973434:0:14365:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1789366732.973508:0:15769:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff963787498380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:987e24be-cce8-4f54-8344-02fd27f3b2a2:15769:1876286758800640:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1789366732.973576:0:15769:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:0.0:1789366732.973585:0:15769:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 9 count 10 00000020:01000000:1.0:1789366732.974408:0:15774:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789366732.974418:0:15774:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789366732.974421:0:15774:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1789366732.974437:0:15774:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff963888974000 00000020:00000080:1.0:1789366732.974440:0:15774:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1789366732.974448:0:15774:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789366732.974451:0:15774:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789366732.974452:0:15774:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:1.0:1789366732.974454:0:15774:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789366732.974457:0:15774:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789366732.974458:0:15774:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1789366732.974461:0:15774:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff963888974000 00000020:00000080:1.0:1789366732.974463:0:15774:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1789366732.974558:0:15774:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789366732.974562:0:15774:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789366732.974564:0:15774:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:1.0:1789366732.974566:0:15774:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789366732.974568:0:15774:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789366732.974570:0:15774:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1789366732.974573:0:15774:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff963888974000 00000020:00000080:1.0:1789366732.974575:0:15774:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1789366732.977701:0:15774:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789366732.977712:0:15774:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789366732.977714:0:15774:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:1.0:1789366732.977748:0:15774:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 10 count 10 00000020:01000000:3.0:1789366732.977933:0:15769:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:3.0:1789366732.977965:0:15769:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.123@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1789366732.977992:0:15769:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.123@tcp lock: ffff9638902c9e00/0x8da3486b955f42dd lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x8da3486b955f42e4 expref: -99 pid: 15769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366732.978004:0:15769:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.123@tcp lock: ffff9638902c9e00/0x8da3486b955f42dd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x8da3486b955f42e4 expref: -99 pid: 15769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789366732.978057:0:15769:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1789366732.978060:0:15769:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff963888974000 10000000:01000000:3.0:1789366732.978063:0:15769:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff963888974000 10000000:01000000:3.0:1789366732.978067:0:15769:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1789366732.978073:0:15769:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff963888974000 from 1 10000000:01000000:3.0:1789366732.978076:0:15769:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1789366732.978111:0:15769:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.123@tcp lock: ffff9638832d2a00/0x8da3486b955f42eb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366732.978123:0:15769:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.123@tcp lock: ffff9638832d2a00/0x8da3486b955f42eb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366732.978132:0:15769:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.123@tcp lock: ffff9638832d2a00/0x8da3486b955f42eb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789366732.978151:0:15769:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9638b6d55c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:987e24be-cce8-4f54-8344-02fd27f3b2a2:15769:1876286758800768:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1789366732.978218:0:15769:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789366732.978253:0:14365:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286758800768 00000100:00100000:3.0:1789366732.978260:0:15769:0:(client.c:2716:ptlrpc_set_wait()) set ffff9638bffac3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789366732.978260:0:14365:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286758800768 00000100:00100000:1.0:1789366732.978303:0:14365:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1789366732.978314:0:14365:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638bf49bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:987e24be-cce8-4f54-8344-02fd27f3b2a2+18:15769:x1876286758800768:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789366732.978327:0:14365:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789366732.978340:0:14365:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9638c142c000/0x8da3486b955f42f2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x8da3486b955f42eb expref: -99 pid: 14365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366732.978363:0:14365:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9638c142c000/0x8da3486b955f42f2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8da3486b955f42eb expref: 19 pid: 14365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366732.978387:0:14365:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9638c142c000/0x8da3486b955f42f2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8da3486b955f42eb expref: 19 pid: 14365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366732.978396:0:14365:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9638c142c000, rc 0) 00000100:00100000:1.0:1789366732.978446:0:14365:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638bf49bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:987e24be-cce8-4f54-8344-02fd27f3b2a2+19:15769:x1876286758800768:12345-0@lo:101:mount.lustre.0 Request processed in 134us (227us total) trans 0 rc 0/0 00000100:00100000:1.0:1789366732.978453:0:14365:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1789366732.978497:0:15769:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9638b6d55c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:987e24be-cce8-4f54-8344-02fd27f3b2a2:15769:1876286758800768:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789366732.978513:0:15769:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.123@tcp lock: ffff9638832d2a00/0x8da3486b955f42eb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x8da3486b955f42f2 expref: -99 pid: 15769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366732.978524:0:15769:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.123@tcp lock: ffff9638832d2a00/0x8da3486b955f42eb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x8da3486b955f42f2 expref: -99 pid: 15769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1789366732.979308:0:15769:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000040:00080000:3.0:1789366732.979689:0:15769:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789366732.980076:0:15769:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:3.0:1789366732.980154:0:15769:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:3.0:1789366732.980227:0:15769:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:3.0:1789366732.980323:0:15769:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:3.0:1789366732.980395:0:15769:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:3.0:1789366732.980473:0:15769:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:3.0:1789366732.980662:0:15769:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:3.0:1789366732.980713:0:15769:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:3.0:1789366732.981033:0:15769:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:3.0:1789366732.981084:0:15769:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:3.0:1789366732.981142:0:15769:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:3.0:1789366732.981207:0:15769:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:3.0:1789366732.981261:0:15769:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:3.0:1789366732.981738:0:15769:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:3.0:1789366732.981813:0:15769:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:3.0:1789366732.981865:0:15769:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:3.0:1789366732.981913:0:15769:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:3.0:1789366732.982187:0:15769:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:3.0:1789366732.982227:0:15769:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:3.0:1789366732.983434:0:15769:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:3.0:1789366732.983544:0:15769:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:3.0:1789366732.983609:0:15769:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:3.0:1789366732.983650:0:15769:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:3.0:1789366732.983693:0:15769:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:3.0:1789366732.983754:0:15769:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 128 off12440 00000040:00080000:3.0:1789366732.983792:0:15769:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12664 00000040:00080000:3.0:1789366732.983849:0:15769:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12888 00000040:00080000:3.0:1789366732.983895:0:15769:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off12968 00000040:00080000:3.0:1789366732.983940:0:15769:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13192 00000040:00080000:3.0:1789366732.983985:0:15769:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].30, 224 off13416 00000040:00080000:3.0:1789366732.984004:0:15769:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].31, 88 off13504 00000040:00080000:3.0:1789366732.984036:0:15769:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].32, 128 off13632 00000040:00080000:3.0:1789366732.984065:0:15769:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].33, 144 off13776 00000040:00080000:3.0:1789366732.984134:0:15769:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].34, 128 off13904 00000040:00080000:3.0:1789366732.984171:0:15769:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].35, 224 off14128 00000040:00080000:3.0:1789366732.984218:0:15769:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].36, 224 off14352 00000040:00080000:3.0:1789366732.984251:0:15769:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].37, 80 off14432 00000040:00080000:3.0:1789366732.984374:0:15769:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].38, 224 off14656 00000040:00080000:3.0:1789366732.984380:0:15769:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 38 count 39 00000100:00100000:3.0:1789366732.984458:0:15769:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9638b6d55c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:987e24be-cce8-4f54-8344-02fd27f3b2a2:15769:1876286758800896:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789366732.984535:0:15769:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789366732.984579:0:15769:0:(client.c:2716:ptlrpc_set_wait()) set ffff9638bffac3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789366732.985046:0:14364:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286758800896 00000100:00100000:0.0:1789366732.985054:0:14364:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286758800896 00000100:00100000:0.0:1789366732.985112:0:14364:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1789366732.985124:0:14364:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96388a049050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:987e24be-cce8-4f54-8344-02fd27f3b2a2+19:15769:x1876286758800896:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789366732.985396:0:14364:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96388a049050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:987e24be-cce8-4f54-8344-02fd27f3b2a2+19:15769:x1876286758800896:12345-0@lo:501:mount.lustre.0 Request processed in 274us (859us total) trans 0 rc 0/0 00000100:00100000:0.0:1789366732.985406:0:14364:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1789366732.985427:0:15769:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9638b6d55c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:987e24be-cce8-4f54-8344-02fd27f3b2a2:15769:1876286758800896:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789366732.985471:0:15769:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9638b6d55c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:987e24be-cce8-4f54-8344-02fd27f3b2a2:15769:1876286758801024:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1789366732.985533:0:15769:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789366732.985561:0:14365:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286758801024 00000100:00100000:3.0:1789366732.985567:0:15769:0:(client.c:2716:ptlrpc_set_wait()) set ffff9638bffac3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789366732.985568:0:14365:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286758801024 00000100:00100000:1.0:1789366732.985599:0:14365:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1789366732.985608:0:14365:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96388a04a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:987e24be-cce8-4f54-8344-02fd27f3b2a2+19:15769:x1876286758801024:12345-0@lo:503:mount.lustre.0 00010000:00010000:3.0:1789366732.985801:0:14358:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789366732.986112:0:14365:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96388a04a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:987e24be-cce8-4f54-8344-02fd27f3b2a2+19:15769:x1876286758801024:12345-0@lo:503:mount.lustre.0 Request processed in 505us (577us total) trans 0 rc 0/0 00000100:00100000:1.0:1789366732.986120:0:14365:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1789366732.986148:0:15769:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9638b6d55c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:987e24be-cce8-4f54-8344-02fd27f3b2a2:15769:1876286758801024:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1789366732.986745:0:15769:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1789366732.986825:0:15769:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9638b6d55c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:987e24be-cce8-4f54-8344-02fd27f3b2a2:15769:1876286758801152:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789366732.986872:0:15769:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789366732.986899:0:15769:0:(client.c:2716:ptlrpc_set_wait()) set ffff963891b103c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789366732.988979:0:14364:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286758801152 00000100:00100000:0.0:1789366732.989001:0:14364:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286758801152 00000100:00100000:0.0:1789366732.989048:0:14364:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1789366732.989058:0:14364:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96388a048050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:987e24be-cce8-4f54-8344-02fd27f3b2a2+19:15769:x1876286758801152:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789366732.989433:0:14364:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96388a048050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:987e24be-cce8-4f54-8344-02fd27f3b2a2+19:15769:x1876286758801152:12345-0@lo:502:mount.lustre.0 Request processed in 376us (2560us total) trans 0 rc 0/0 00000100:00100000:0.0:1789366732.989442:0:14364:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1789366732.989472:0:15769:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9638b6d55c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:987e24be-cce8-4f54-8344-02fd27f3b2a2:15769:1876286758801152:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1789366732.989861:0:15769:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:2.0:1789366732.989919:0:15769:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:2.0:1789366732.989959:0:15769:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:2.0:1789366732.990017:0:15769:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:2.0:1789366732.990073:0:15769:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:2.0:1789366732.990144:0:15769:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:2.0:1789366732.990200:0:15769:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:2.0:1789366732.990247:0:15769:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:2.0:1789366732.990299:0:15769:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:2.0:1789366732.990373:0:15769:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:2.0:1789366732.990419:0:15769:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:2.0:1789366732.990505:0:15769:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:2.0:1789366732.990553:0:15769:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:2.0:1789366732.990591:0:15769:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:2.0:1789366732.990637:0:15769:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:2.0:1789366732.990674:0:15769:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:2.0:1789366732.990743:0:15769:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:2.0:1789366732.990809:0:15769:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:2.0:1789366732.990854:0:15769:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:2.0:1789366732.990892:0:15769:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:2.0:1789366732.990945:0:15769:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:2.0:1789366732.990984:0:15769:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:2.0:1789366732.991026:0:15769:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:2.0:1789366732.991095:0:15769:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:2.0:1789366732.991137:0:15769:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 128 off12440 00000040:00080000:2.0:1789366732.991218:0:15769:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12664 00000040:00080000:2.0:1789366732.991299:0:15769:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12888 00000040:00080000:2.0:1789366732.991346:0:15769:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off12968 00000040:00080000:2.0:1789366732.991391:0:15769:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13192 00000040:00080000:2.0:1789366732.991463:0:15769:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13416 00000040:00080000:2.0:1789366732.991531:0:15769:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13504 00000040:00080000:2.0:1789366732.991572:0:15769:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13632 00000040:00080000:2.0:1789366732.991619:0:15769:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13776 00000040:00080000:2.0:1789366732.991677:0:15769:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13904 00000040:00080000:2.0:1789366732.991760:0:15769:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14128 00000040:00080000:2.0:1789366732.991851:0:15769:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14352 00000040:00080000:2.0:1789366732.991902:0:15769:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14432 00000040:00080000:2.0:1789366732.991946:0:15769:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14656 00000040:00080000:2.0:1789366732.992030:0:15769:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14880 00000040:00080000:2.0:1789366732.992098:0:15769:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 120 off15000 00000100:00100000:2.0:1789366732.992153:0:15769:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9638aef25c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:987e24be-cce8-4f54-8344-02fd27f3b2a2:15769:1876286758801280:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789366732.992226:0:15769:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789366732.992266:0:15769:0:(client.c:2716:ptlrpc_set_wait()) set ffff9638bf08b9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789366732.992386:0:14365:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286758801280 00000100:00100000:1.0:1789366732.992394:0:14365:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286758801280 00000100:00100000:1.0:1789366732.992450:0:14365:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1789366732.992461:0:14365:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96388a04b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:987e24be-cce8-4f54-8344-02fd27f3b2a2+19:15769:x1876286758801280:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789366732.992735:0:14365:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96388a04b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:987e24be-cce8-4f54-8344-02fd27f3b2a2+19:15769:x1876286758801280:12345-0@lo:502:mount.lustre.0 Request processed in 247us (480us total) trans 0 rc 0/0 00000100:00100000:1.0:1789366732.992745:0:14365:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1789366732.992765:0:15769:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9638aef25c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:987e24be-cce8-4f54-8344-02fd27f3b2a2:15769:1876286758801280:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1789366732.992878:0:15769:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 224 off15224 00000040:00080000:2.0:1789366732.992890:0:15769:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 41 count 42 00000020:01000004:2.0:1789366732.993787:0:15779:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:2.0:1789366732.993812:0:15779:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff963786a699c0) 00000020:00000080:2.0:1789366732.993836:0:15779:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type lwp with refcount 2 00000020:01000004:2.0:1789366732.993926:0:15779:0:(tgt_mount.c:153:server_get_mount()) get mount ffff963888974000 from lustre-OST0001, refs=3 00000020:01000004:2.0:1789366732.993931:0:15779:0:(tgt_mount.c:187:server_put_mount()) put mount ffff963888974000 from lustre-OST0001, refs=3 00000020:01000004:2.0:1789366732.993934:0:15779:0:(obd_mount.c:710:lustre_put_lsi()) put ffff963888974000 3 00010000:00080000:2.0:1789366732.993968:0:15779:0:(ldlm_lib.c:102:import_set_conn()) imp ffff96378515c800@lustre-MDT0000-lwp-OST0001: add connection 192.168.202.123@tcp at head 00010000:00010000:2.0:1789366732.995601:0:15779:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-5 is initialized 00000020:00000080:2.0:1789366732.995815:0:15779:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:2.0:1789366732.995849:0:15779:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1789366732.995859:0:15779:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0x8da3486b955f4300 00000100:00080000:2.0:1789366732.995870:0:15779:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1789366732.995880:0:15779:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff96378515c800 using connection 192.168.202.123@tcp/0@lo 00000100:00100000:2.0:1789366732.995916:0:15779:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9638aef25c00 x1876286758801408/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1789366732.995942:0:15779:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1789366732.995978:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9638aef25c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3283:1876286758801408:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1789366732.996112:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789366732.996200:0:14371:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286758801408 00000040:00080000:2.0:1789366732.996208:0:15779:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 42 count 42 00000100:00100000:0.0:1789366732.996208:0:14371:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286758801408 00000100:00100000:0.0:1789366732.996245:0:14371:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1789366732.996254:0:14371:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963787498380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3283:x1876286758801408:12345-0@lo:38:llog_process_th.0 00010000:00080000:0.0:1789366732.996277:0:14371:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 308 last 0 00000020:00000080:0.0:1789366732.996318:0:14371:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0x8da3486b955f4307 00000004:00100000:0.0:1789366732.996332:0:14371:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1789366732.996367:0:14371:0:(import.c:65:import_set_state_nolock()) ffff9638a7542800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789366732.996431:0:14371:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963787498380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3283:x1876286758801408:12345-0@lo:38:llog_process_th.0 Request processed in 177us (321us total) trans 0 rc 0/0 00000100:00100000:0.0:1789366732.996441:0:14371:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:2.0:1789366732.996460:0:3283:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9638aef25c00 x1876286758801408/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789366742 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789366732.996468:0:3283:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1789366732.996475:0:3283:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 2 00000100:00080000:2.0:1789366732.996481:0:3283:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:2.0:1789366732.996497:0:3283:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1789366732.996499:0:3283:0:(import.c:65:import_set_state_nolock()) ffff96378515c800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1789366732.996513:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9638aef25c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3283:1876286758801408:0@lo:38:llog_process_th.0 00000020:01000000:2.0:1789366732.996788:0:15769:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:2.0:1789366732.996817:0:15769:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.123@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1789366732.996830:0:15769:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.123@tcp lock: ffff9638832d2a00/0x8da3486b955f42eb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x8da3486b955f42f2 expref: -99 pid: 15769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366732.996841:0:15769:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.123@tcp lock: ffff9638832d2a00/0x8da3486b955f42eb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x8da3486b955f42f2 expref: -99 pid: 15769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1789366732.996887:0:15769:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1789366732.996890:0:15769:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1789366732.996891:0:15769:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789366732.996892:0:15769:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789366732.996894:0:15769:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789366732.996895:0:15769:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789366732.996897:0:15769:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1789366732.996899:0:15769:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789366732.996900:0:15769:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1789366732.996904:0:15769:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020002 00000020:01000004:2.0:1789366732.996907:0:15769:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1789366732.996908:0:15769:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1789366732.996909:0:15769:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789366732.996910:0:15769:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789366732.996911:0:15769:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789366732.996912:0:15769:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789366732.996914:0:15769:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1789366732.996915:0:15769:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789366732.996916:0:15769:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1789366732.996931:0:15769:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:2.0:1789366732.996943:0:15769:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9638aef25c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:987e24be-cce8-4f54-8344-02fd27f3b2a2:15769:1876286758801536:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1789366732.996981:0:15769:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789366732.997003:0:15769:0:(client.c:2716:ptlrpc_set_wait()) set ffff9638bf08bd80 going to sleep for 11 seconds 00000100:00080000:1.0:1789366732.997901:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789366732.997907:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1789366732.997910:0:36:0:(import.c:65:import_set_state_nolock()) ffff963882f31800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1789366732.997916:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 307 00000100:00080000:1.0:1789366732.997928:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:1.0:1789366732.997937:0:36:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff963882f31800 using connection 192.168.202.123@tcp/0@lo 00000100:00100000:1.0:1789366732.997957:0:36:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff96388327e680 x1876286758801792/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1789366732.997974:0:3287:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96388327df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3287:1876286758801664:0@lo:400:kworker.0 00000100:00100000:3.0:1789366732.998021:0:3287:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789366732.998029:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96388327e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3283:1876286758801792:0@lo:8:kworker.0 00000100:00100000:1.0:1789366732.998066:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789366732.998080:0:15055:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286758801664 00000100:00100000:3.0:1789366732.998087:0:15055:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286758801664 00000100:00100000:1.0:1789366732.998122:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96388327f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3284:1876286758801920:0@lo:400:kworker.0 00000100:00100000:3.0:1789366732.998129:0:15055:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286758801792 00000100:00100000:3.0:1789366732.998134:0:15055:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286758801792 00000100:00100000:0.0:1789366732.998138:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96388327ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3285:1876286758802048:0@lo:400:kworker.0 00000100:00100000:3.0:1789366732.998152:0:15055:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789366732.998159:0:15055:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638b6d55180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3287:x1876286758801664:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789366732.998179:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789366732.998211:0:15055:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638b6d55180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3287:x1876286758801664:12345-0@lo:400:kworker.0 Request processed in 51us (189us total) trans 0 rc 0/0 00000100:00100000:3.0:1789366732.998219:0:15055:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789366732.998228:0:15056:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1789366732.998230:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789366732.998239:0:15056:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96388327e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3283:x1876286758801792:12345-0@lo:8:kworker.0 00000100:00100000:3.0:1789366732.998264:0:3287:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96388327df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3287:1876286758801664:0@lo:400:kworker.0 00000100:00100000:0.0:1789366732.998314:0:15056:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96388327e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3283:x1876286758801792:12345-0@lo:8:kworker.0 Request processed in 75us (247us total) trans 0 rc -11/-11 00000100:00100000:0.0:1789366732.998322:0:15056:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1789366732.998349:0:14372:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286758802048 00000100:00100000:1.0:1789366732.998352:0:3283:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00100000:0.0:1789366732.998355:0:14372:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286758802048 00000100:00080000:1.0:1789366732.998357:0:3283:0:(import.c:65:import_set_state_nolock()) ffff963882f31800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1789366732.998362:0:3283:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-11) 00000100:00100000:1.0:1789366732.998368:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96388327e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3283:1876286758801792:0@lo:8:kworker.0 00000100:00100000:0.0:1789366732.998402:0:14372:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286758801920 00000100:00100000:0.0:1789366732.998406:0:14372:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286758801920 00000100:00100000:1.0:1789366732.998413:0:14370:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1789366732.998425:0:14370:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96378749b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3285:x1876286758802048:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789366732.998430:0:14372:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:0.0:1789366732.998439:0:14372:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:1.0:1789366732.998472:0:14370:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96378749b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3285:x1876286758802048:12345-0@lo:400:kworker.0 Request processed in 51us (293us total) trans 0 rc 0/0 00000100:00100000:1.0:1789366732.998480:0:14370:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:0.0:1789366732.998508:0:3285:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96388327ed80 x1876286758802048/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789366748 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789366732.998511:0:14370:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1789366732.998523:0:14370:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96388327c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3284:x1876286758801920:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789366732.998525:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96388327ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3285:1876286758802048:0@lo:400:kworker.0 00000100:00100000:0.0:1789366732.998556:0:14364:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286758801536 00000100:00100000:0.0:1789366732.998561:0:14364:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286758801536 00000100:00100000:0.0:1789366732.998596:0:14364:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1789366732.998607:0:14364:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96388a048c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:987e24be-cce8-4f54-8344-02fd27f3b2a2+19:15769:x1876286758801536:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1789366732.998630:0:14364:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 00000100:00100000:1.0:1789366732.998632:0:14370:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96388327c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3284:x1876286758801920:12345-0@lo:400:kworker.0 Request processed in 111us (405us total) trans 0 rc 0/0 00000100:00100000:1.0:1789366732.998640:0:14370:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 20000000:01000000:0.0:1789366732.998645:0:14364:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00010000:00080000:1.0:1789366732.998673:0:3284:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96388327f480 x1876286758801920/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789366748 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789366732.998685:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96388327f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3284:1876286758801920:0@lo:400:kworker.0 20000000:01000000:2.0:1789366733.031457:0:14364:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1789366733.031581:0:14364:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:1.0:1789366733.031644:0:14386:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1789366733.031650:0:14386:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1789366733.031671:0:14386:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9638c142d200/0x8da3486b955f430e lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366733.031690:0:14386:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9638b6ce2400/0x8da3486b955f41e8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8da3486b955f41e1 expref: 19 pid: 14363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366733.031698:0:14386:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9638c142d200/0x8da3486b955f430e lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366733.031803:0:14386:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9638b6ce2400/0x8da3486b955f41e8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x8da3486b955f41e1 expref: 19 pid: 14363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366733.031819:0:14386:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9638b6ce2400/0x8da3486b955f41e8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x8da3486b955f41e1 expref: 19 pid: 14363 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789366733.031834:0:14386:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96388327f480 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14386:1876286758802176:0@lo:104: 00000100:00100000:1.0:1789366733.031897:0:14386:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789366733.032183:0:14386:0:(client.c:2716:ptlrpc_set_wait()) set ffff9638bf1ddf00 going to sleep for 11 seconds 00000100:00100000:2.0:1789366733.032285:0:14353:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286758802176 00000100:00100000:2.0:1789366733.032293:0:14353:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286758802176 00000100:00100000:2.0:1789366733.032571:0:14353:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1789366733.032582:0:14353:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96388327e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:987e24be-cce8-4f54-8344-02fd27f3b2a2+3:14386:x1876286758802176:12345-0@lo:104: 00010000:00010000:2.0:1789366733.032595:0:14353:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.123@tcp lock: ffff9638902c8c00/0x8da3486b955f41e1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x8da3486b955f41e8 expref: -99 pid: 14367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366733.032655:0:14353:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1789366733.032663:0:14353:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96388327e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:987e24be-cce8-4f54-8344-02fd27f3b2a2+3:14386:x1876286758802176:12345-0@lo:104: Request processed in 83us (767us total) trans 0 rc 0/0 00010000:00010000:3.0:1789366733.032670:0:14359:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:2.0:1789366733.032671:0:14353:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00010000:3.0:1789366733.032681:0:14359:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.123@tcp lock: ffff9638902c8c00/0x8da3486b955f41e1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x8da3486b955f41e8 expref: -99 pid: 14367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366733.032703:0:14359:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9638902c8c00 already unused, calling callback (ffffffffc1cc7c20) 10000000:00010000:3.0:1789366733.032708:0:14359:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.123@tcp lock: ffff9638902c8c00/0x8da3486b955f41e1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x8da3486b955f41e8 expref: -99 pid: 14367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366733.032747:0:14359:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.123@tcp lock: ffff9638902c8c00/0x8da3486b955f41e1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x8da3486b955f41e8 expref: -99 pid: 14367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789366733.032753:0:14386:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96388327f480 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14386:1876286758802176:0@lo:104: 10000000:00010000:3.0:1789366733.032757:0:14359:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.123@tcp lock: ffff9638902c8c00/0x8da3486b955f41e1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x8da3486b955f41e8 expref: -99 pid: 14367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789366733.032765:0:14359:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1789366733.032774:0:14386:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9638c142d200/0x8da3486b955f430e lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366733.032799:0:14359:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.123@tcp lock: ffff9638902c8c00/0x8da3486b955f41e1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8da3486b955f41e8 expref: -99 pid: 14367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366733.032806:0:14359:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789366733.032835:0:14359:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.123@tcp lock: ffff9638902c8c00/0x8da3486b955f41e1 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8da3486b955f41e8 expref: -99 pid: 14367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366733.032842:0:14359:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.123@tcp lock: ffff9638902c8c00/0x8da3486b955f41e1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8da3486b955f41e8 expref: -99 pid: 14367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366733.032860:0:14359:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789366733.032862:0:14359:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789366733.032866:0:14359:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789366733.032866:0:3286:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9638b6d55c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:987e24be-cce8-4f54-8344-02fd27f3b2a2:3286:1876286758802304:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789366733.032898:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789366733.032965:0:14355:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286758802304 00000100:00100000:3.0:1789366733.032970:0:14355:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286758802304 00010000:00010000:3.0:1789366733.032988:0:14355:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9638b6ce2400/0x8da3486b955f41e8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8da3486b955f41e1 expref: 20 pid: 14363 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789366733.033008:0:14355:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1789366733.033020:0:14355:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96388327f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:987e24be-cce8-4f54-8344-02fd27f3b2a2+20:3286:x1876286758802304:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789366733.033030:0:14355:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789366733.033036:0:14355:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9638b6ce2400/0x8da3486b955f41e8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8da3486b955f41e1 expref: 20 pid: 14363 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366733.033046:0:14355:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9638b6ce2400/0x8da3486b955f41e8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x8da3486b955f41e1 expref: 20 pid: 14363 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366733.033058:0:14355:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9638b6ce2400/0x8da3486b955f41e8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x8da3486b955f41e1 expref: 20 pid: 14363 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366733.033070:0:14355:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9638c142d200/0x8da3486b955f430e lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366733.033077:0:14355:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9638c142d200/0x8da3486b955f430e lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1789366733.033088:0:14355:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001438865s 00010000:00010000:3.0:1789366733.033093:0:14355:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9638c142d200/0x8da3486b955f430e lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366733.033100:0:14355:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9638c142d200/0x8da3486b955f430e lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366733.033107:0:14355:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9638c142d200/0x8da3486b955f430e lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366733.033114:0:14355:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9638c142d200/0x8da3486b955f430e lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366733.033121:0:14355:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9638c142d200 already unused, calling callback (ffffffffc16df520) 00010000:00010000:3.0:1789366733.033131:0:14355:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9638c142d200/0x8da3486b955f430e lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366733.033139:0:14355:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9638c142d200/0x8da3486b955f430e lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366733.033153:0:14355:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9638c142d200/0x8da3486b955f430e lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366733.033161:0:14355:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789366733.033191:0:14355:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96388327f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:987e24be-cce8-4f54-8344-02fd27f3b2a2+19:3286:x1876286758802304:12345-0@lo:103:ldlm_bl.0 Request processed in 171us (293us total) trans 0 rc 0/0 00000100:00100000:3.0:1789366733.033198:0:14355:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789366733.033548:0:3286:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9638b6d55c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:987e24be-cce8-4f54-8344-02fd27f3b2a2:3286:1876286758802304:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789366733.033574:0:14386:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9638c142d200/0x8da3486b955f430e lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366733.033595:0:14386:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9638c142d200/0x8da3486b955f430e lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366733.033602:0:14386:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9638c142d200/0x8da3486b955f430e lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789366733.040701:0:14364:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96388a048c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:987e24be-cce8-4f54-8344-02fd27f3b2a2+18:15769:x1876286758801536:12345-0@lo:253:mount.lustre.0 Request processed in 42087us (43710us total) trans 0 rc 0/0 00000100:00100000:2.0:1789366733.040748:0:14364:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1789366733.040838:0:15769:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9638aef25c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:987e24be-cce8-4f54-8344-02fd27f3b2a2:15769:1876286758801536:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1789366733.040855:0:15769:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:3.0:1789366733.040859:0:15769:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1789366733.040860:0:15769:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1789366733.040861:0:15769:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789366733.040862:0:15769:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789366733.040864:0:15769:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789366733.040865:0:15769:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789366733.040866:0:15769:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1789366733.040868:0:15769:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789366733.040869:0:15769:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1789366733.040885:0:15769:0:(tgt_mount.c:2698:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:3.0:1789366733.045015:0:15769:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:3.0:1789366733.045146:0:15769:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:3.0:1789366733.045548:0:15769:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:3.0:1789366733.045774:0:15769:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:3.0:1789366733.045904:0:15769:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:3.0:1789366733.046077:0:15769:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:3.0:1789366733.046866:0:15769:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934592 00002000:00080000:2.0:1789366733.091803:0:15769:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:2.0:1789366733.091813:0:15769:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:2.0:1789366733.091845:0:15769:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1789366733.091913:0:15769:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.123@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1789366733.091927:0:15769:0:(tgt_mount.c:2464:server_fill_super_common()) Server sb, dev=49 00000080:00000004:2.0:1789366733.091955:0:15769:0:(super25.c:182:lustre_fill_super()) lustre-ost2/ost2: Mount complete 00010000:00010000:3.0:1789366734.011078:0:14358:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1789366734.584867:0:14367:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1789366734.584936:0:14367:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff963888959000 from 8 10000000:01000000:2.0:1789366734.584941:0:14367:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1789366734.584986:0:14367:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.123@tcp lock: ffff9638902c9200/0x8da3486b955f4315 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366734.585048:0:14367:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.123@tcp lock: ffff9638902c9200/0x8da3486b955f4315 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366734.585062:0:14367:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.123@tcp lock: ffff9638902c9200/0x8da3486b955f4315 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789366734.585106:0:14367:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9638aef25500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:987e24be-cce8-4f54-8344-02fd27f3b2a2:14367:1876286758802432:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789366734.585175:0:14367:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789366734.585242:0:14367:0:(client.c:2716:ptlrpc_set_wait()) set ffff9638bf0cb780 going to sleep for 11 seconds 00000100:00100000:3.0:1789366734.585368:0:14365:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286758802432 00000100:00100000:3.0:1789366734.585377:0:14365:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286758802432 00000100:00100000:3.0:1789366734.585436:0:14365:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1789366734.585445:0:14365:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96388a048850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:987e24be-cce8-4f54-8344-02fd27f3b2a2+18:14367:x1876286758802432:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789366734.585459:0:14365:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789366734.585481:0:14365:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9638832d3000/0x8da3486b955f431c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x8da3486b955f4315 expref: -99 pid: 14365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366734.585506:0:14365:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9638832d3000/0x8da3486b955f431c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8da3486b955f4315 expref: 19 pid: 14365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366734.585517:0:14365:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9638832d3000/0x8da3486b955f431c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8da3486b955f4315 expref: 19 pid: 14365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366734.585525:0:14365:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9638832d3000, rc 0) 00000100:00100000:3.0:1789366734.585576:0:14365:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96388a048850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:987e24be-cce8-4f54-8344-02fd27f3b2a2+19:14367:x1876286758802432:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 131us (402us total) trans 0 rc 0/0 00000100:00100000:3.0:1789366734.585596:0:14365:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1789366734.585647:0:14367:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9638aef25500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:987e24be-cce8-4f54-8344-02fd27f3b2a2:14367:1876286758802432:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789366734.585661:0:14367:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.123@tcp lock: ffff9638902c9200/0x8da3486b955f4315 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8da3486b955f431c expref: -99 pid: 14367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366734.585670:0:14367:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.123@tcp lock: ffff9638902c9200/0x8da3486b955f4315 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x8da3486b955f431c expref: -99 pid: 14367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789366734.585740:0:14367:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9638b6d54a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:987e24be-cce8-4f54-8344-02fd27f3b2a2:14367:1876286758802560:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1789366734.585772:0:14367:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789366734.585802:0:14367:0:(client.c:2716:ptlrpc_set_wait()) set ffff9638988543c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789366734.585827:0:14364:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286758802560 00000100:00100000:3.0:1789366734.585831:0:14364:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286758802560 00000100:00100000:3.0:1789366734.585862:0:14364:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1789366734.585871:0:14364:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96388a049450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:987e24be-cce8-4f54-8344-02fd27f3b2a2+19:14367:x1876286758802560:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:3.0:1789366734.585885:0:14364:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1789366734.585901:0:14364:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1789366734.585905:0:14364:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 8 00000100:00100000:3.0:1789366734.585980:0:14364:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96388a049450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:987e24be-cce8-4f54-8344-02fd27f3b2a2+19:14367:x1876286758802560:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 110us (206us total) trans 0 rc 0/0 00000100:00100000:3.0:1789366734.585988:0:14364:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1789366734.586024:0:14367:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9638b6d54a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:987e24be-cce8-4f54-8344-02fd27f3b2a2:14367:1876286758802560:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1789366734.586079:0:14367:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.123@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1789366734.586086:0:14367:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.123@tcp lock: ffff9638902c9200/0x8da3486b955f4315 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8da3486b955f431c expref: -99 pid: 14367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366734.586095:0:14367:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.123@tcp lock: ffff9638902c9200/0x8da3486b955f4315 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8da3486b955f431c expref: -99 pid: 14367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366735.033006:0:14359:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789366736.055788:0:14358:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1789366736.709507:0:16123:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg223-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:0.0:1789366737.088140:0:14359:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789366737.336960:0:3286:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789366737.336983:0:3286:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96388327f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3286:1876286758802688:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789366737.337051:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789366737.337129:0:15059:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286758802688 00000100:00100000:1.0:1789366737.337136:0:15059:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286758802688 00000100:00100000:1.0:1789366737.337198:0:15059:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789366737.337207:0:15059:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96388327c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3286:x1876286758802688:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789366737.337242:0:15059:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789366737.337300:0:15059:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96388327c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3286:x1876286758802688:12345-0@lo:13:osp-pre-0-0.0 Request processed in 94us (248us total) trans 0 rc 0/0 00000100:00100000:1.0:1789366737.337307:0:15059:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:1.0:1789366737.337326:0:14366:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789366737.337359:0:3286:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96388327f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3286:1876286758802688:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1789366738.103826:0:14358:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789366738.135825:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:3.0:1789366738.135878:0:14365:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751477632 00000100:00100000:3.0:1789366738.135886:0:14365:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751477632 00000100:00100000:3.0:1789366738.135921:0:14365:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 71 00000100:00100000:3.0:1789366738.135928:0:14365:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963784a98c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0+-99:2353:x1876286751477632:12345-192.168.202.23@tcp:250:mount.lustre.0 00010000:00080000:3.0:1789366738.135954:0:14365:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from 54a43f6e-a685-4942-96ef-6a0a40cf520e@192.168.202.23@tcp t0 exp 0000000000000000 cur 313 last 0 00000020:00000080:3.0:1789366738.135987:0:14365:0:(genops.c:1385:class_connect()) connect: client 54a43f6e-a685-4942-96ef-6a0a40cf520e, cookie 0x8da3486b955f4323 00000100:00080000:3.0:1789366738.136085:0:14365:0:(import.c:65:import_set_state_nolock()) ffff9638af2cc000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789366738.136140:0:14365:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963784a98c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:54a43f6e-a685-4942-96ef-6a0a40cf520e+5:2353:x1876286751477632:12345-192.168.202.23@tcp:250:mount.lustre.0 Request processed in 212us (326us total) trans 0 rc 0/0 00000100:00100000:3.0:1789366738.136146:0:14365:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 71 00000100:00100000:0.0:1789366738.140172:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:2.0:1789366738.140389:0:14363:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751477760 00000100:00100000:2.0:1789366738.140400:0:14363:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751477760 00000100:00100000:2.0:1789366738.140482:0:14363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 72 00000100:00100000:2.0:1789366738.140493:0:14363:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638aefdd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:54a43f6e-a685-4942-96ef-6a0a40cf520e+5:13733:x1876286751477760:12345-192.168.202.23@tcp:101:mount.lustre.0 00010000:00010000:2.0:1789366738.140510:0:14363:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789366738.140538:0:14363:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9638902c9a00/0x8da3486b955f432a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0xda917a494d06c34e expref: -99 pid: 14363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366738.140568:0:14363:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9638902c9a00/0x8da3486b955f432a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.202.23@tcp remote: 0xda917a494d06c34e expref: 6 pid: 14363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366738.140581:0:14363:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9638902c9a00/0x8da3486b955f432a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.202.23@tcp remote: 0xda917a494d06c34e expref: 6 pid: 14363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366738.140592:0:14363:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9638902c9a00, rc 0) 00000100:00100000:2.0:1789366738.140681:0:14363:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638aefdd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:54a43f6e-a685-4942-96ef-6a0a40cf520e+6:13733:x1876286751477760:12345-192.168.202.23@tcp:101:mount.lustre.0 Request processed in 190us (519us total) trans 0 rc 0/0 00000100:00100000:2.0:1789366738.140689:0:14363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 72 00000100:00100000:0.0:1789366738.143134:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:2.0:1789366738.143225:0:14364:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751477888 00000100:00100000:2.0:1789366738.143233:0:14364:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751477888 00000100:00100000:2.0:1789366738.143272:0:14364:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 73 00000100:00100000:2.0:1789366738.143279:0:14364:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638aefde050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:54a43f6e-a685-4942-96ef-6a0a40cf520e+6:13733:x1876286751477888:12345-192.168.202.23@tcp:501:mount.lustre.0 00000100:00100000:2.0:1789366738.144054:0:14364:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638aefde050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:54a43f6e-a685-4942-96ef-6a0a40cf520e+6:13733:x1876286751477888:12345-192.168.202.23@tcp:501:mount.lustre.0 Request processed in 772us (923us total) trans 0 rc -2/-2 00000100:00100000:2.0:1789366738.144071:0:14364:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 73 00000100:00100000:0.0:1789366738.145610:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:2.0:1789366738.145661:0:14363:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751478016 00000100:00100000:2.0:1789366738.145670:0:14363:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751478016 00000100:00100000:2.0:1789366738.145749:0:14363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 74 00000100:00100000:2.0:1789366738.145758:0:14363:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638aefdcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:54a43f6e-a685-4942-96ef-6a0a40cf520e+6:13733:x1876286751478016:12345-192.168.202.23@tcp:101:mount.lustre.0 00010000:00010000:2.0:1789366738.145771:0:14363:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789366738.145784:0:14363:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9638902c8c00/0x8da3486b955f4331 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0xda917a494d06c355 expref: -99 pid: 14363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366738.145805:0:14363:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9638902c8c00/0x8da3486b955f4331 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.202.23@tcp remote: 0xda917a494d06c355 expref: 7 pid: 14363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366738.145817:0:14363:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9638902c8c00/0x8da3486b955f4331 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.202.23@tcp remote: 0xda917a494d06c355 expref: 7 pid: 14363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366738.145829:0:14363:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9638902c8c00, rc 0) 00000100:00100000:3.0:1789366738.145912:0:14363:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638aefdcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:54a43f6e-a685-4942-96ef-6a0a40cf520e+7:13733:x1876286751478016:12345-192.168.202.23@tcp:101:mount.lustre.0 Request processed in 152us (305us total) trans 0 rc 0/0 00000100:00100000:3.0:1789366738.145920:0:14363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 74 00000100:00100000:0.0:1789366738.148286:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:2.0:1789366738.148603:0:14364:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751478144 00000100:00100000:2.0:1789366738.148611:0:14364:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751478144 00000100:00100000:2.0:1789366738.148662:0:14364:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 75 00000100:00100000:2.0:1789366738.148672:0:14364:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638aefdf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:54a43f6e-a685-4942-96ef-6a0a40cf520e+7:13733:x1876286751478144:12345-192.168.202.23@tcp:501:mount.lustre.0 00000100:00100000:3.0:1789366738.149007:0:14364:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638aefdf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:54a43f6e-a685-4942-96ef-6a0a40cf520e+8:13733:x1876286751478144:12345-192.168.202.23@tcp:501:mount.lustre.0 Request processed in 336us (728us total) trans 0 rc 0/0 00000100:00100000:3.0:1789366738.149016:0:14364:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 75 00000100:00100000:0.0:1789366738.151137:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:3.0:1789366738.151188:0:14363:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751478272 00000100:00100000:3.0:1789366738.151196:0:14363:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751478272 00000100:00100000:3.0:1789366738.151237:0:14363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 76 00000100:00100000:3.0:1789366738.151244:0:14363:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963785842450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:54a43f6e-a685-4942-96ef-6a0a40cf520e+8:13733:x1876286751478272:12345-192.168.202.23@tcp:503:mount.lustre.0 00000100:00100000:3.0:1789366738.151701:0:14363:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963785842450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:54a43f6e-a685-4942-96ef-6a0a40cf520e+8:13733:x1876286751478272:12345-192.168.202.23@tcp:503:mount.lustre.0 Request processed in 454us (569us total) trans 0 rc 0/0 00000100:00100000:3.0:1789366738.151709:0:14363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 76 00000100:00100000:0.0:1789366738.155009:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:3.0:1789366738.155089:0:14364:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751478400 00000100:00100000:3.0:1789366738.155098:0:14364:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751478400 00000100:00100000:3.0:1789366738.155155:0:14364:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 77 00000100:00100000:3.0:1789366738.155165:0:14364:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963785840850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:54a43f6e-a685-4942-96ef-6a0a40cf520e+8:13751:x1876286751478400:12345-192.168.202.23@tcp:502:llog_process_th.0 00000100:00100000:3.0:1789366738.155544:0:14364:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963785840850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:54a43f6e-a685-4942-96ef-6a0a40cf520e+8:13751:x1876286751478400:12345-192.168.202.23@tcp:502:llog_process_th.0 Request processed in 380us (543us total) trans 0 rc 0/0 00000100:00100000:3.0:1789366738.155552:0:14364:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 77 00000100:00100000:0.0:1789366738.164428:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:3.0:1789366738.164541:0:14363:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751478528 00000100:00100000:3.0:1789366738.164553:0:14363:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751478528 00000100:00100000:3.0:1789366738.164621:0:14363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 78 00000100:00100000:3.0:1789366738.164642:0:14363:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963785841850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:54a43f6e-a685-4942-96ef-6a0a40cf520e+8:13751:x1876286751478528:12345-192.168.202.23@tcp:502:llog_process_th.0 00000100:00100000:3.0:1789366738.164996:0:14363:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963785841850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:54a43f6e-a685-4942-96ef-6a0a40cf520e+8:13751:x1876286751478528:12345-192.168.202.23@tcp:502:llog_process_th.0 Request processed in 357us (581us total) trans 0 rc 0/0 00000100:00100000:3.0:1789366738.165005:0:14363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 78 00000100:00100000:0.0:1789366738.175468:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:3.0:1789366738.175601:0:14364:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751478656 00000100:00100000:3.0:1789366738.175612:0:14364:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751478656 00000100:00100000:3.0:1789366738.175677:0:14364:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 79 00000100:00100000:3.0:1789366738.175688:0:14364:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963785842050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:54a43f6e-a685-4942-96ef-6a0a40cf520e+8:13733:x1876286751478656:12345-192.168.202.23@tcp:101:mount.lustre.0 00010000:00010000:3.0:1789366738.175704:0:14364:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789366738.175761:0:14364:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9638832d2800/0x8da3486b955f4338 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xda917a494d06c37f expref: -99 pid: 14364 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366738.175791:0:14364:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9638832d2800/0x8da3486b955f4338 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.202.23@tcp remote: 0xda917a494d06c37f expref: 9 pid: 14364 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366738.175802:0:14364:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9638832d2800/0x8da3486b955f4338 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.202.23@tcp remote: 0xda917a494d06c37f expref: 9 pid: 14364 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366738.175810:0:14364:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9638832d2800, rc 0) 00000100:00100000:3.0:1789366738.175857:0:14364:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963785842050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:54a43f6e-a685-4942-96ef-6a0a40cf520e+9:13733:x1876286751478656:12345-192.168.202.23@tcp:101:mount.lustre.0 Request processed in 172us (401us total) trans 0 rc 0/0 00000100:00100000:3.0:1789366738.175864:0:14364:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 79 00000100:00100000:0.0:1789366738.181489:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:3.0:1789366738.182034:0:14363:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751478784 00000100:00100000:3.0:1789366738.182046:0:14363:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751478784 00000100:00100000:3.0:1789366738.182117:0:14363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 80 00000100:00100000:3.0:1789366738.182127:0:14363:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963785841050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:54a43f6e-a685-4942-96ef-6a0a40cf520e+9:13733:x1876286751478784:12345-192.168.202.23@tcp:256:mount.lustre.0 20000000:01000000:3.0:1789366738.182153:0:14363:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:3.0:1789366738.182169:0:14363:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:3.0:1789366738.182172:0:14363:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:3.0:1789366738.182175:0:14363:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:3.0:1789366738.182177:0:14363:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 8 00000100:00100000:3.0:1789366738.195556:0:14363:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963785841050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:54a43f6e-a685-4942-96ef-6a0a40cf520e+9:13733:x1876286751478784:12345-192.168.202.23@tcp:256:mount.lustre.0 Request processed in 13420us (14067us total) trans 0 rc 0/0 00000100:00100000:3.0:1789366738.195572:0:14363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 80 00000100:00100000:0.0:1789366738.199944:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:3.0:1789366738.200467:0:14364:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751478912 00000100:00100000:3.0:1789366738.200479:0:14364:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751478912 00000100:00100000:3.0:1789366738.200537:0:14364:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 81 00000100:00100000:3.0:1789366738.200548:0:14364:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963785843850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:54a43f6e-a685-4942-96ef-6a0a40cf520e+9:13733:x1876286751478912:12345-192.168.202.23@tcp:101:mount.lustre.0 00010000:00010000:3.0:1789366738.200564:0:14364:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789366738.200580:0:14364:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9638832d3600/0x8da3486b955f433f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xda917a494d06c386 expref: -99 pid: 14364 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366738.200608:0:14364:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9638832d3600/0x8da3486b955f433f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.202.23@tcp remote: 0xda917a494d06c386 expref: 10 pid: 14364 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366738.200620:0:14364:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9638832d3600/0x8da3486b955f433f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.202.23@tcp remote: 0xda917a494d06c386 expref: 10 pid: 14364 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366738.200628:0:14364:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9638832d3600, rc 0) 00000100:00100000:3.0:1789366738.200689:0:14364:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963785843850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:54a43f6e-a685-4942-96ef-6a0a40cf520e+10:13733:x1876286751478912:12345-192.168.202.23@tcp:101:mount.lustre.0 Request processed in 143us (755us total) trans 0 rc 0/0 00000100:00100000:3.0:1789366738.200697:0:14364:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 81 00000100:00100000:0.0:1789366738.205282:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:3.0:1789366738.205483:0:14363:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751479040 00000100:00100000:3.0:1789366738.205493:0:14363:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751479040 00000100:00100000:3.0:1789366738.205590:0:14363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 82 00000100:00100000:3.0:1789366738.205600:0:14363:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963785843050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:54a43f6e-a685-4942-96ef-6a0a40cf520e+10:13733:x1876286751479040:12345-192.168.202.23@tcp:501:mount.lustre.0 00000100:00100000:3.0:1789366738.206005:0:14363:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963785843050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:54a43f6e-a685-4942-96ef-6a0a40cf520e+10:13733:x1876286751479040:12345-192.168.202.23@tcp:501:mount.lustre.0 Request processed in 405us (732us total) trans 0 rc 0/0 00000100:00100000:3.0:1789366738.206014:0:14363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 82 00000100:00100000:1.0:1789366738.209604:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:0.0:1789366738.209749:0:14365:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751479168 00000100:00100000:0.0:1789366738.209760:0:14365:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751479168 00000100:00100000:0.0:1789366738.209872:0:14365:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 83 00000100:00100000:0.0:1789366738.209883:0:14365:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963785841450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:54a43f6e-a685-4942-96ef-6a0a40cf520e+10:13733:x1876286751479168:12345-192.168.202.23@tcp:503:mount.lustre.0 00000100:00100000:0.0:1789366738.210189:0:14365:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963785841450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:54a43f6e-a685-4942-96ef-6a0a40cf520e+10:13733:x1876286751479168:12345-192.168.202.23@tcp:503:mount.lustre.0 Request processed in 308us (595us total) trans 0 rc 0/0 00000100:00100000:0.0:1789366738.210195:0:14365:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 83 00000100:00100000:1.0:1789366738.219360:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:3.0:1789366738.219863:0:14363:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751479296 00000100:00100000:3.0:1789366738.219874:0:14363:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751479296 00000100:00100000:3.0:1789366738.219941:0:14363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 84 00000100:00100000:3.0:1789366738.219953:0:14363:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963785840450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:54a43f6e-a685-4942-96ef-6a0a40cf520e+10:13755:x1876286751479296:12345-192.168.202.23@tcp:502:llog_process_th.0 00000100:00100000:3.0:1789366738.220309:0:14363:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963785840450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:54a43f6e-a685-4942-96ef-6a0a40cf520e+10:13755:x1876286751479296:12345-192.168.202.23@tcp:502:llog_process_th.0 Request processed in 357us (956us total) trans 0 rc 0/0 00000100:00100000:3.0:1789366738.220321:0:14363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 84 00000100:00100000:2.0:1789366738.222159:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:0.0:1789366738.222323:0:14365:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751479424 00000100:00100000:0.0:1789366738.222332:0:14365:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751479424 00000100:00100000:0.0:1789366738.222424:0:14365:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 85 00000100:00100000:0.0:1789366738.222434:0:14365:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963785842c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:54a43f6e-a685-4942-96ef-6a0a40cf520e+10:13755:x1876286751479424:12345-192.168.202.23@tcp:502:llog_process_th.0 00000100:00100000:0.0:1789366738.222689:0:14365:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963785842c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:54a43f6e-a685-4942-96ef-6a0a40cf520e+10:13755:x1876286751479424:12345-192.168.202.23@tcp:502:llog_process_th.0 Request processed in 255us (536us total) trans 0 rc 0/0 00000100:00100000:0.0:1789366738.222697:0:14365:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 85 00000100:00100000:1.0:1789366738.228864:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:2.0:1789366738.229180:0:14370:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751479552 00000100:00100000:2.0:1789366738.229190:0:14370:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751479552 00000100:00100000:2.0:1789366738.229236:0:14370:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 4 00000100:00100000:2.0:1789366738.229244:0:14370:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96388327f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2353:x1876286751479552:12345-192.168.202.23@tcp:38:mount.lustre.0 00010000:00080000:2.0:1789366738.229269:0:14370:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from 5e91e95c-c49d-475c-a425-33e1a73fefb4@192.168.202.23@tcp t0 exp 0000000000000000 cur 313 last 0 00000020:00000080:2.0:1789366738.229333:0:14370:0:(genops.c:1385:class_connect()) connect: client 5e91e95c-c49d-475c-a425-33e1a73fefb4, cookie 0x8da3486b955f4346 00000004:00100000:2.0:1789366738.229365:0:14370:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000001:00000004:2.0:1789366738.229371:0:14370:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000100:00100000:2.0:1789366738.236935:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:3.0:1789366738.237051:0:14363:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751479936 00000100:00100000:3.0:1789366738.237062:0:14363:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751479936 00000100:00100000:3.0:1789366738.237119:0:14363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 86 00000100:00100000:3.0:1789366738.237129:0:14363:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963785843c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:54a43f6e-a685-4942-96ef-6a0a40cf520e+10:2354:x1876286751479936:12345-192.168.202.23@tcp:400:kworker.0 00000100:00100000:3.0:1789366738.237202:0:14363:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963785843c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:54a43f6e-a685-4942-96ef-6a0a40cf520e+10:2354:x1876286751479936:12345-192.168.202.23@tcp:400:kworker.0 Request processed in 75us (277us total) trans 0 rc 0/0 00000100:00100000:3.0:1789366738.237209:0:14363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 86 00000100:00080000:1.0:1789366738.266096:0:14370:0:(import.c:65:import_set_state_nolock()) ffff963882e35800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789366738.266179:0:14370:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96388327f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5e91e95c-c49d-475c-a425-33e1a73fefb4+6:2353:x1876286751479552:12345-192.168.202.23@tcp:38:mount.lustre.0 Request processed in 36932us (37321us total) trans 0 rc 0/0 00000100:00100000:1.0:1789366738.266190:0:14370:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 4 00000100:00100000:2.0:1789366738.268330:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:0.0:1789366738.268392:0:14372:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751479808 00000100:00100000:0.0:1789366738.268400:0:14372:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751479808 00000100:00080000:1.0:1789366738.268458:0:14366:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789366738.268643:0:14372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 5 00000100:00100000:0.0:1789366738.268659:0:14372:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638aef24380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5e91e95c-c49d-475c-a425-33e1a73fefb4+6:13733:x1876286751479808:12345-192.168.202.23@tcp:41:mount.lustre.0 00000004:00000024:0.0:1789366738.268702:0:14372:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:1.0:1789366738.268892:0:14372:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638aef24380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5e91e95c-c49d-475c-a425-33e1a73fefb4+6:13733:x1876286751479808:12345-192.168.202.23@tcp:41:mount.lustre.0 Request processed in 240us (567us total) trans 0 rc 0/0 00000100:00100000:1.0:1789366738.268898:0:14372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 5 00000100:00100000:0.0:1789366738.269390:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:2.0:1789366738.269466:0:14371:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751479680 00000100:00100000:2.0:1789366738.269471:0:14371:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751479680 00000100:00100000:2.0:1789366738.269509:0:14371:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 6 00000100:00100000:2.0:1789366738.269517:0:14371:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96378749aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5e91e95c-c49d-475c-a425-33e1a73fefb4+6:0:x1876286751479680:12345-192.168.202.23@tcp:41:mount.lustre.0 00000004:00000024:2.0:1789366738.269532:0:14371:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:2.0:1789366738.269573:0:14371:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96378749aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5e91e95c-c49d-475c-a425-33e1a73fefb4+6:0:x1876286751479680:12345-192.168.202.23@tcp:41:mount.lustre.0 Request processed in 56us (184us total) trans 0 rc 0/0 00000100:00100000:2.0:1789366738.269580:0:14371:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 6 00000100:00100000:2.0:1789366738.270411:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:3.0:1789366738.270500:0:15782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751480064 00000100:00100000:3.0:1789366738.270506:0:15782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751480064 00000100:00100000:3.0:1789366738.270560:0:15782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 7 00000100:00100000:3.0:1789366738.270567:0:15782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638aef25f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5e91e95c-c49d-475c-a425-33e1a73fefb4+6:13733:x1876286751480064:12345-192.168.202.23@tcp:40:mount.lustre.0 00000100:00100000:3.0:1789366738.270622:0:15782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638aef25f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5e91e95c-c49d-475c-a425-33e1a73fefb4+6:13733:x1876286751480064:12345-192.168.202.23@tcp:40:mount.lustre.0 Request processed in 57us (215us total) trans 0 rc 0/0 00000100:00100000:3.0:1789366738.270628:0:15782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 7 00000100:00100000:0.0:1789366738.271903:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:3.0:1789366738.272053:0:14373:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751480448 00000100:00100000:3.0:1789366738.272059:0:14373:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751480448 00000100:00100000:3.0:1789366738.272095:0:14373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 0 00000100:00100000:3.0:1789366738.272103:0:14373:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963787499500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5e91e95c-c49d-475c-a425-33e1a73fefb4+6:13733:x1876286751480448:12345-192.168.202.23@tcp:33:mount.lustre.0 00000100:00100000:1.0:1789366738.272634:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:1.0:1789366738.272660:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:0.0:1789366738.272751:0:15057:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751480192 00000100:00100000:0.0:1789366738.272757:0:15057:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751480192 00000100:00100000:1.0:1789366738.272815:0:15057:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751480320 00000100:00100000:1.0:1789366738.272818:0:15057:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751480320 00000100:00100000:1.0:1789366738.272829:0:15057:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 6 00000100:00100000:1.0:1789366738.272833:0:15057:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96388327d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2353:x1876286751480192:12345-192.168.202.23@tcp:8:mount.lustre.0 00010000:00080000:1.0:1789366738.272852:0:15057:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 5e91e95c-c49d-475c-a425-33e1a73fefb4@192.168.202.23@tcp t0 exp 0000000000000000 cur 313 last 0 00000100:00100000:3.0:1789366738.272875:0:15055:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 7 00000020:00000080:1.0:1789366738.272881:0:15057:0:(genops.c:1385:class_connect()) connect: client 5e91e95c-c49d-475c-a425-33e1a73fefb4, cookie 0x8da3486b955f434d 00000100:00100000:3.0:1789366738.272883:0:15055:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96388327ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2353:x1876286751480320:12345-192.168.202.23@tcp:8:mount.lustre.0 00002000:00100000:1.0:1789366738.272892:0:15057:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 5e91e95c-c49d-475c-a425-33e1a73fefb4/ffff963882e37800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a06 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1789366738.272901:0:15057:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00010000:00080000:3.0:1789366738.272904:0:15055:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 5e91e95c-c49d-475c-a425-33e1a73fefb4@192.168.202.23@tcp t0 exp 0000000000000000 cur 313 last 0 00000020:00000080:3.0:1789366738.272933:0:15055:0:(genops.c:1385:class_connect()) connect: client 5e91e95c-c49d-475c-a425-33e1a73fefb4, cookie 0x8da3486b955f4354 00002000:00100000:3.0:1789366738.272941:0:15055:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 5e91e95c-c49d-475c-a425-33e1a73fefb4/ffff9638af2c8800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a06 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1789366738.273079:0:15055:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:1.0:1789366738.273212:0:15057:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1789366738.273243:0:15057:0:(import.c:65:import_set_state_nolock()) ffff963882e30000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789366738.273299:0:15057:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96388327d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5e91e95c-c49d-475c-a425-33e1a73fefb4+6:2353:x1876286751480192:12345-192.168.202.23@tcp:8:mount.lustre.0 Request processed in 464us (665us total) trans 0 rc 0/0 00000100:00100000:1.0:1789366738.273305:0:15057:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 6 00002000:00080000:3.0:1789366738.273379:0:15055:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1789366738.273395:0:15055:0:(import.c:65:import_set_state_nolock()) ffff9638af2c9800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789366738.273422:0:15055:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96388327ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5e91e95c-c49d-475c-a425-33e1a73fefb4+6:2353:x1876286751480320:12345-192.168.202.23@tcp:8:mount.lustre.0 Request processed in 539us (760us total) trans 0 rc 0/0 00000100:00100000:3.0:1789366738.273429:0:15055:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 7 00000004:00080000:2.0:1789366738.275053:0:14373:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 2893us 00000004:00200000:2.0:1789366738.285336:0:14373:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000100:00100000:2.0:1789366738.285467:0:14373:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963787499500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5e91e95c-c49d-475c-a425-33e1a73fefb4+6:13733:x1876286751480448:12345-192.168.202.23@tcp:33:mount.lustre.0 Request processed in 13359us (13561us total) trans 0 rc 0/0 00000100:00100000:2.0:1789366738.285483:0:14373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 0 00000040:00080000:1.0:1789366738.296323:0:14406:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00080000:2.0:1789366738.360882:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789366738.360889:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1789366738.360893:0:37:0:(import.c:65:import_set_state_nolock()) ffff963882f31800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1789366738.360909:0:37:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff963882f31800 using connection 192.168.202.123@tcp/0@lo 00000100:00100000:2.0:1789366738.360933:0:37:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9638aef26680 x1876286758803072/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1789366738.361117:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9638aef25500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:987e24be-cce8-4f54-8344-02fd27f3b2a2:3284:1876286758802816:0@lo:400:kworker.0 00000100:00100000:2.0:1789366738.361183:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789366738.361227:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9638aef27100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3284:1876286758803456:0@lo:400:kworker.0 00000100:00100000:2.0:1789366738.361249:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789366738.361271:0:3284:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789366738.361276:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9638aef25c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3284:1876286758802944:0@lo:400:kworker.0 00000100:00100000:2.0:1789366738.361301:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789366738.361332:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9638aef26680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3283:1876286758803072:0@lo:8:kworker.0 00000100:00100000:2.0:1789366738.361358:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789366738.361391:0:3286:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9638aef27800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3286:1876286758803200:0@lo:400:kworker.0 00000100:00100000:2.0:1789366738.361414:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789366738.361446:0:3286:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789366738.361453:0:3286:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9638aef26d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3286:1876286758803328:0@lo:400:kworker.0 00000100:00100000:2.0:1789366738.361480:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789366738.361513:0:14370:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286758803456 00000100:00100000:2.0:1789366738.361521:0:14370:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286758803456 00000100:00100000:2.0:1789366738.361571:0:14370:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286758803200 00000100:00100000:2.0:1789366738.361573:0:14370:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286758803200 00000100:00100000:2.0:1789366738.361583:0:14370:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286758803328 00000100:00100000:2.0:1789366738.361584:0:14370:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286758803328 00000100:00100000:2.0:1789366738.361596:0:14370:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1789366738.361604:0:14370:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638aef26300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3284:x1876286758803456:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789366738.361654:0:14370:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638aef26300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3284:x1876286758803456:12345-0@lo:400:kworker.0 Request processed in 50us (402us total) trans 0 rc 0/0 00000100:00100000:2.0:1789366738.361661:0:14370:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1789366738.361684:0:14370:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1789366738.361690:0:14370:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638b7038000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3286:x1876286758803200:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789366738.361854:0:14365:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286758802816 00000100:00100000:1.0:1789366738.361859:0:14365:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286758802816 00000100:00100000:1.0:1789366738.361887:0:14365:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1789366738.361895:0:14365:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638987e7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:987e24be-cce8-4f54-8344-02fd27f3b2a2+19:3284:x1876286758802816:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789366738.362348:0:15056:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286758802944 00000100:00100000:0.0:1789366738.362354:0:15056:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286758802944 00000100:00100000:0.0:1789366738.362382:0:15056:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286758803072 00000100:00100000:0.0:1789366738.362385:0:15056:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286758803072 00000100:00100000:0.0:1789366738.362400:0:15056:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1789366738.362407:0:15056:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638b703b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3284:x1876286758802944:12345-0@lo:400:kworker.0 00000100:00080000:3.0:1789366738.362908:0:14366:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789366738.362924:0:14371:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1789366738.362933:0:14371:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638b7039f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3286:x1876286758803328:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789366738.365119:0:14365:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638987e7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:987e24be-cce8-4f54-8344-02fd27f3b2a2+19:3284:x1876286758802816:12345-0@lo:400:kworker.0 Request processed in 3216us (3926us total) trans 0 rc 0/0 00000100:00100000:1.0:1789366738.365147:0:14365:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1789366738.365276:0:15055:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1789366738.365281:0:15055:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638b7038e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3283:x1876286758803072:12345-0@lo:8:kworker.0 00010000:00080000:1.0:1789366738.365308:0:15055:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 313 last 0 00000020:00000080:1.0:1789366738.365336:0:15055:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x8da3486b955f435b 00002000:00100000:1.0:1789366738.365351:0:15055:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff963882e33000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a06 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:1.0:1789366738.365355:0:15055:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:1.0:1789366738.365358:0:15055:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:1.0:1789366738.365634:0:15055:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1789366738.365656:0:15055:0:(import.c:65:import_set_state_nolock()) ffff963882e33800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789366738.365698:0:15055:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638b7038e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3283:x1876286758803072:12345-0@lo:8:kworker.0 Request processed in 415us (4340us total) trans 0 rc 0/0 00000100:00100000:1.0:1789366738.365703:0:15055:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00080000:1.0:1789366738.366076:0:3286:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9638aef27800 x1876286758803200/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789366754 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789366738.366091:0:3286:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9638aef27800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3286:1876286758803200:0@lo:400:kworker.0 00000100:00100000:1.0:1789366738.369132:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9638aef25500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:987e24be-cce8-4f54-8344-02fd27f3b2a2:3284:1876286758802816:0@lo:400:kworker.0 00010000:00080000:1.0:1789366738.369169:0:3284:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9638aef27100 x1876286758803456/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789366754 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789366738.369182:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9638aef27100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3284:1876286758803456:0@lo:400:kworker.0 00000100:00100000:2.0:1789366738.372188:0:14370:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638b7038000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3286:x1876286758803200:12345-0@lo:400:kworker.0 Request processed in 10487us (10762us total) trans 0 rc 0/0 00000100:00100000:2.0:1789366738.372203:0:14370:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00080000:2.0:1789366738.372270:0:3283:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9638aef26680 x1876286758803072/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1789366763 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1789366738.372299:0:3283:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 2 00000100:00080000:2.0:1789366738.372308:0:3283:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1789366738.372314:0:3283:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:2.0:1789366738.372317:0:3283:0:(import.c:65:import_set_state_nolock()) ffff963882f31800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1789366738.372333:0:3283:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1789366738.372340:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9638aef26680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3283:1876286758803072:0@lo:8:kworker.0 00000004:00080000:2.0:1789366738.372366:0:14395:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:2.0:1789366738.372681:0:14395:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 313836962039ns, next at 0ns, rc = 0 00000004:00080000:2.0:1789366738.374015:0:14396:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x280000400:0x5:0x0] 00000100:00100000:2.0:1789366738.374053:0:14396:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9638b7038a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14396:1876286758803712:0@lo:5:osp-pre-1-0.0 00000100:00100000:2.0:1789366738.374076:0:3284:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789366738.374938:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9638b703ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3284:1876286758803584:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789366738.375670:0:14396:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789366738.375702:0:14396:0:(client.c:2716:ptlrpc_set_wait()) set ffff963885b676c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789366738.375886:0:15055:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286758803712 00000100:00100000:2.0:1789366738.375893:0:15055:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286758803712 00000100:00100000:2.0:1789366738.375944:0:15055:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1789366738.375953:0:15055:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638b7039c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:14396:x1876286758803712:12345-0@lo:5:osp-pre-1-0.0 00000100:00100000:0.0:1789366738.376186:0:15056:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638b703b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3284:x1876286758802944:12345-0@lo:400:kworker.0 Request processed in 13778us (14882us total) trans 0 rc 0/0 00000100:00100000:0.0:1789366738.376197:0:15056:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:3.0:1789366738.376808:0:14366:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789366738.376965:0:14371:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638b7039f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3286:x1876286758803328:12345-0@lo:400:kworker.0 Request processed in 14032us (15482us total) trans 0 rc 0/0 00000100:00100000:3.0:1789366738.376982:0:14371:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00080000:3.0:1789366738.377026:0:3286:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9638aef26d80 x1876286758803328/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789366754 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789366738.377162:0:3286:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9638aef26d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3286:1876286758803328:0@lo:400:kworker.0 00000100:00100000:2.0:1789366738.377539:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789366738.377590:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9638aef25c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3284:1876286758802944:0@lo:400:kworker.0 00000100:00100000:2.0:1789366738.377617:0:15059:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286758803584 00000100:00100000:2.0:1789366738.377622:0:15059:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286758803584 00000100:00100000:2.0:1789366738.377655:0:15059:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1789366738.377664:0:15059:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638b7039180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3284:x1876286758803584:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789366738.377684:0:15059:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44367872 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789366738.377755:0:15059:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638b7039180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3284:x1876286758803584:12345-0@lo:13:osp-pre-1-0.0 Request processed in 93us (216us total) trans 0 rc 0/0 00000100:00100000:2.0:1789366738.377762:0:15059:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:2.0:1789366738.377786:0:3284:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9638b703ad80 x1876286758803584/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789366754 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789366738.378162:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9638b703ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3284:1876286758803584:0@lo:13:osp-pre-1-0.0 00002000:00080000:3.0:1789366738.385704:0:15055:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x280000400 00002000:00080000:3.0:1789366738.385737:0:15055:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -28 00002000:02000040:3.0:1789366738.385743:0:15055:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000400:6 to 0x280000400:33) 00002000:00010000:3.0:1789366738.398115:0:15055:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789366738.398128:0:15055:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dcf5bb2b/0x8da3486b955f4362 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366738.398145:0:15055:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x21:0x0].0x0 since=313s v=(0 0) 00010000:00010000:3.0:1789366738.398149:0:15055:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789366738.398156:0:15055:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000dcf5bb2b/0x8da3486b955f4362 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366738.398187:0:15055:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000dcf5bb2b/0x8da3486b955f4362 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366738.398198:0:15055:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dcf5bb2b/0x8da3486b955f4362 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366738.398205:0:15055:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000dcf5bb2b/0x8da3486b955f4362 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366738.398231:0:15055:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789366738.398822:0:14359:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789366738.398832:0:14359:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000dcf5bb2b/0x8da3486b955f4362 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366738.398854:0:14359:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9638832d3e00 already unused, calling callback (ffffffffc16df520) 00010000:00010000:1.0:1789366738.398860:0:14359:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000dcf5bb2b/0x8da3486b955f4362 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366738.398870:0:14359:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000dcf5bb2b/0x8da3486b955f4362 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366738.398893:0:14359:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000dcf5bb2b/0x8da3486b955f4362 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366738.398900:0:14359:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000dcf5bb2b/0x8da3486b955f4362 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366738.398921:0:14359:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789366738.398923:0:14359:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789366738.398925:0:14359:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789366738.399103:0:15055:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789366738.399109:0:15055:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000beadee0/0x8da3486b955f4369 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366738.399119:0:15055:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x20:0x0].0x0 since=313s v=(0 0) 00010000:00010000:3.0:1789366738.399123:0:15055:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789366738.399127:0:15055:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000beadee0/0x8da3486b955f4369 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366738.399138:0:15055:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000beadee0/0x8da3486b955f4369 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366738.399146:0:15055:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000beadee0/0x8da3486b955f4369 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366738.399153:0:15055:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000beadee0/0x8da3486b955f4369 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366738.399179:0:15055:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789366738.400194:0:14358:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789366738.400203:0:14358:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000beadee0/0x8da3486b955f4369 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366738.400213:0:14358:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9638832d2e00 already unused, calling callback (ffffffffc16df520) 00010000:00010000:1.0:1789366738.400217:0:14358:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000beadee0/0x8da3486b955f4369 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366738.400226:0:14358:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000beadee0/0x8da3486b955f4369 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366738.400249:0:14358:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000beadee0/0x8da3486b955f4369 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366738.400256:0:14358:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000beadee0/0x8da3486b955f4369 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366738.400277:0:14358:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789366738.400279:0:14358:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789366738.400280:0:14358:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1789366738.401301:0:7617:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 5e91e95c-c49d-475c-a425-33e1a73fefb4 00002000:00010000:3.0:1789366738.401864:0:15055:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789366738.401873:0:15055:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000004f4d78f/0x8da3486b955f4370 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366738.401888:0:15055:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1f:0x0].0x0 since=313s v=(0 0) 00010000:00010000:3.0:1789366738.401893:0:15055:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789366738.401898:0:15055:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000004f4d78f/0x8da3486b955f4370 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366738.401927:0:15055:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000004f4d78f/0x8da3486b955f4370 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366738.401937:0:15055:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000004f4d78f/0x8da3486b955f4370 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366738.401945:0:15055:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000004f4d78f/0x8da3486b955f4370 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366738.402022:0:15055:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789366738.402840:0:14359:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789366738.402848:0:14359:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000004f4d78f/0x8da3486b955f4370 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366738.402859:0:14359:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9638832d3c00 already unused, calling callback (ffffffffc16df520) 00010000:00010000:1.0:1789366738.402864:0:14359:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000004f4d78f/0x8da3486b955f4370 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366738.402873:0:14359:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000004f4d78f/0x8da3486b955f4370 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366738.402890:0:14359:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000004f4d78f/0x8da3486b955f4370 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366738.402897:0:14359:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000004f4d78f/0x8da3486b955f4370 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366738.402923:0:14359:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789366738.402925:0:14359:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789366738.402926:0:14359:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789366738.405226:0:15055:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789366738.405237:0:15055:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009dd57752/0x8da3486b955f4377 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366738.405251:0:15055:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1e:0x0].0x0 since=313s v=(0 0) 00010000:00010000:3.0:1789366738.405256:0:15055:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789366738.405262:0:15055:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009dd57752/0x8da3486b955f4377 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366738.405277:0:15055:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009dd57752/0x8da3486b955f4377 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366738.405287:0:15055:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009dd57752/0x8da3486b955f4377 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366738.405295:0:15055:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009dd57752/0x8da3486b955f4377 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366738.405698:0:15055:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789366738.405766:0:14358:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789366738.405775:0:14358:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009dd57752/0x8da3486b955f4377 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366738.405783:0:14358:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9638832d3a00 already unused, calling callback (ffffffffc16df520) 00010000:00010000:1.0:1789366738.405789:0:14358:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009dd57752/0x8da3486b955f4377 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366738.405799:0:14358:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009dd57752/0x8da3486b955f4377 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366738.405818:0:14358:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009dd57752/0x8da3486b955f4377 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366738.405825:0:14358:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009dd57752/0x8da3486b955f4377 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366738.405843:0:14358:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789366738.405845:0:14358:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789366738.405846:0:14358:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789366738.406187:0:15055:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789366738.406194:0:15055:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002c8f2eab/0x8da3486b955f437e lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366738.406204:0:15055:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1d:0x0].0x0 since=313s v=(0 0) 00010000:00010000:3.0:1789366738.406207:0:15055:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789366738.406211:0:15055:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002c8f2eab/0x8da3486b955f437e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366738.406222:0:15055:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002c8f2eab/0x8da3486b955f437e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366738.406230:0:15055:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002c8f2eab/0x8da3486b955f437e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366738.406237:0:15055:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002c8f2eab/0x8da3486b955f437e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366738.406255:0:15055:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789366738.406306:0:14359:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789366738.406313:0:14359:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002c8f2eab/0x8da3486b955f437e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366738.406321:0:14359:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9638832d2200 already unused, calling callback (ffffffffc16df520) 00010000:00010000:0.0:1789366738.406325:0:14359:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002c8f2eab/0x8da3486b955f437e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366738.406334:0:14359:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002c8f2eab/0x8da3486b955f437e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366738.406348:0:14359:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002c8f2eab/0x8da3486b955f437e lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366738.406356:0:14359:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002c8f2eab/0x8da3486b955f437e lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366738.406372:0:14359:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789366738.406374:0:14359:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789366738.406376:0:14359:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789366738.406815:0:15055:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789366738.406820:0:15055:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001a0647dc/0x8da3486b955f4385 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366738.406827:0:15055:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1c:0x0].0x0 since=313s v=(0 0) 00010000:00010000:3.0:1789366738.406846:0:15055:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789366738.406851:0:15055:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001a0647dc/0x8da3486b955f4385 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366738.406861:0:15055:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001a0647dc/0x8da3486b955f4385 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366738.406869:0:15055:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001a0647dc/0x8da3486b955f4385 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366738.406876:0:15055:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001a0647dc/0x8da3486b955f4385 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366738.407059:0:15055:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1789366738.407667:0:15055:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789366738.407674:0:15055:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a514e8eb/0x8da3486b955f438c lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366738.407685:0:15055:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1b:0x0].0x0 since=313s v=(0 0) 00010000:00010000:3.0:1789366738.407688:0:15055:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789366738.407692:0:15055:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a514e8eb/0x8da3486b955f438c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366738.407703:0:15055:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a514e8eb/0x8da3486b955f438c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366738.407711:0:15055:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a514e8eb/0x8da3486b955f438c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366738.407760:0:15055:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a514e8eb/0x8da3486b955f438c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366738.408030:0:15055:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1789366738.408032:0:14358:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789366738.408125:0:14359:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789366738.408282:0:14358:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001a0647dc/0x8da3486b955f4385 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366738.408304:0:14358:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9638832d2400 already unused, calling callback (ffffffffc16df520) 00010000:00010000:1.0:1789366738.408309:0:14358:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001a0647dc/0x8da3486b955f4385 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366738.408318:0:14358:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001a0647dc/0x8da3486b955f4385 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366738.408332:0:14358:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001a0647dc/0x8da3486b955f4385 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366738.408339:0:14358:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001a0647dc/0x8da3486b955f4385 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366738.408360:0:14358:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789366738.408362:0:14358:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789366738.408364:0:14358:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789366738.408819:0:15055:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789366738.408825:0:15055:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ee6d5de4/0x8da3486b955f4393 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366738.408981:0:15055:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1a:0x0].0x0 since=313s v=(0 0) 00010000:00010000:3.0:1789366738.408987:0:15055:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789366738.408992:0:15055:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ee6d5de4/0x8da3486b955f4393 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366738.409005:0:15055:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ee6d5de4/0x8da3486b955f4393 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366738.409014:0:15055:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ee6d5de4/0x8da3486b955f4393 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366738.409021:0:15055:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ee6d5de4/0x8da3486b955f4393 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366738.409035:0:15055:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789366738.409333:0:14358:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789366738.409340:0:14358:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ee6d5de4/0x8da3486b955f4393 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366738.409347:0:14358:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9638b6ce2400 already unused, calling callback (ffffffffc16df520) 00010000:00010000:2.0:1789366738.409351:0:14358:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ee6d5de4/0x8da3486b955f4393 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366738.409360:0:14358:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ee6d5de4/0x8da3486b955f4393 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366738.409374:0:14358:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ee6d5de4/0x8da3486b955f4393 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366738.409388:0:14358:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ee6d5de4/0x8da3486b955f4393 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366738.409406:0:14358:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789366738.409408:0:14358:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789366738.409411:0:14358:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789366738.409642:0:15055:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789366738.409650:0:15055:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d8dc1c1c/0x8da3486b955f439a lrc: 3/0,1 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366738.409665:0:15055:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x19:0x0].0x0 since=313s v=(0 0) 00010000:00010000:3.0:1789366738.409668:0:15055:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789366738.409673:0:15055:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d8dc1c1c/0x8da3486b955f439a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366738.409684:0:15055:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d8dc1c1c/0x8da3486b955f439a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366738.409693:0:15055:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d8dc1c1c/0x8da3486b955f439a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366738.409700:0:15055:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d8dc1c1c/0x8da3486b955f439a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366738.409738:0:15055:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789366738.409772:0:14358:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789366738.409778:0:14358:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d8dc1c1c/0x8da3486b955f439a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366738.409786:0:14358:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9638b6ce3400 already unused, calling callback (ffffffffc16df520) 00010000:00010000:2.0:1789366738.409790:0:14358:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d8dc1c1c/0x8da3486b955f439a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366738.409798:0:14358:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d8dc1c1c/0x8da3486b955f439a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366738.409811:0:14358:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d8dc1c1c/0x8da3486b955f439a lrc: 1/0,0 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366738.409819:0:14358:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d8dc1c1c/0x8da3486b955f439a lrc: 0/0,0 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366738.409835:0:14358:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789366738.409837:0:14358:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789366738.409839:0:14358:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789366738.410787:0:15055:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789366738.410795:0:15055:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009a47f876/0x8da3486b955f43a1 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366738.410806:0:15055:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18:0x0].0x0 since=313s v=(0 0) 00010000:00010000:3.0:1789366738.410810:0:15055:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789366738.410816:0:15055:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009a47f876/0x8da3486b955f43a1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366738.410828:0:15055:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009a47f876/0x8da3486b955f43a1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366738.410910:0:15055:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009a47f876/0x8da3486b955f43a1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366738.410918:0:15055:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009a47f876/0x8da3486b955f43a1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366738.410941:0:15055:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789366738.410989:0:16242:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789366738.410997:0:16242:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009a47f876/0x8da3486b955f43a1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366738.411017:0:16242:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9638b6ce3c00 already unused, calling callback (ffffffffc16df520) 00010000:00010000:0.0:1789366738.411022:0:16242:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009a47f876/0x8da3486b955f43a1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366738.411032:0:16242:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009a47f876/0x8da3486b955f43a1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366738.411057:0:16242:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009a47f876/0x8da3486b955f43a1 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366738.411065:0:16242:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009a47f876/0x8da3486b955f43a1 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366738.411089:0:14359:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a514e8eb/0x8da3486b955f438c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366738.411096:0:14359:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9638832d3800 already unused, calling callback (ffffffffc16df520) 00010000:00010000:0.0:1789366738.411100:0:14359:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a514e8eb/0x8da3486b955f438c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366738.411108:0:14359:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a514e8eb/0x8da3486b955f438c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366738.411117:0:14359:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a514e8eb/0x8da3486b955f438c lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366738.411136:0:14359:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a514e8eb/0x8da3486b955f438c lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366738.411153:0:14359:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789366738.411156:0:14359:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789366738.411157:0:14359:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789366738.411163:0:16242:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789366738.411165:0:16242:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789366738.411168:0:16242:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789366738.411304:0:14358:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789366738.411467:0:15055:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789366738.411475:0:15055:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000096f5b236/0x8da3486b955f43a8 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366738.411602:0:15055:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17:0x0].0x0 since=313s v=(0 0) 00010000:00010000:3.0:1789366738.411606:0:15055:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789366738.411612:0:15055:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000096f5b236/0x8da3486b955f43a8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366738.411625:0:15055:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000096f5b236/0x8da3486b955f43a8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366738.411634:0:15055:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000096f5b236/0x8da3486b955f43a8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366738.411643:0:15055:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000096f5b236/0x8da3486b955f43a8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366738.411678:0:15055:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789366738.411849:0:14359:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789366738.411856:0:14359:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000096f5b236/0x8da3486b955f43a8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366738.411864:0:14359:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9638b6ce2600 already unused, calling callback (ffffffffc16df520) 00010000:00010000:1.0:1789366738.411868:0:14359:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000096f5b236/0x8da3486b955f43a8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366738.411888:0:14359:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000096f5b236/0x8da3486b955f43a8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366738.411899:0:14359:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000096f5b236/0x8da3486b955f43a8 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366738.411907:0:14359:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000096f5b236/0x8da3486b955f43a8 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366738.411923:0:14359:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789366738.411924:0:14359:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789366738.411926:0:14359:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789366738.412261:0:15055:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789366738.412267:0:15055:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a35c8094/0x8da3486b955f43af lrc: 3/0,1 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366738.412275:0:15055:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x16:0x0].0x0 since=313s v=(0 0) 00010000:00010000:3.0:1789366738.412278:0:15055:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789366738.412282:0:15055:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a35c8094/0x8da3486b955f43af lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366738.412291:0:15055:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a35c8094/0x8da3486b955f43af lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366738.412297:0:15055:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a35c8094/0x8da3486b955f43af lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366738.412304:0:15055:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a35c8094/0x8da3486b955f43af lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366738.412394:0:15055:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789366738.412412:0:16242:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789366738.412417:0:16242:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a35c8094/0x8da3486b955f43af lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366738.412425:0:16242:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9638b6ce3000 already unused, calling callback (ffffffffc16df520) 00010000:00010000:1.0:1789366738.412428:0:16242:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a35c8094/0x8da3486b955f43af lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366738.412445:0:16242:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a35c8094/0x8da3486b955f43af lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366738.412458:0:16242:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a35c8094/0x8da3486b955f43af lrc: 1/0,0 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366738.412477:0:16242:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a35c8094/0x8da3486b955f43af lrc: 0/0,0 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366738.412492:0:16242:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789366738.412494:0:16242:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789366738.412495:0:16242:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789366738.413072:0:15055:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789366738.413079:0:15055:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003ac13bbc/0x8da3486b955f43b6 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366738.413088:0:15055:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x15:0x0].0x0 since=313s v=(0 0) 00010000:00010000:3.0:1789366738.413097:0:15055:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789366738.413102:0:15055:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003ac13bbc/0x8da3486b955f43b6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366738.413111:0:15055:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003ac13bbc/0x8da3486b955f43b6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366738.413119:0:15055:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003ac13bbc/0x8da3486b955f43b6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366738.413125:0:15055:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003ac13bbc/0x8da3486b955f43b6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366738.413141:0:15055:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789366738.413150:0:14358:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789366738.413155:0:14358:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003ac13bbc/0x8da3486b955f43b6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366738.413162:0:14358:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9638b6ce3600 already unused, calling callback (ffffffffc16df520) 00010000:00010000:3.0:1789366738.413166:0:14358:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003ac13bbc/0x8da3486b955f43b6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366738.413174:0:14358:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003ac13bbc/0x8da3486b955f43b6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366738.413185:0:14358:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003ac13bbc/0x8da3486b955f43b6 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366738.413204:0:14358:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003ac13bbc/0x8da3486b955f43b6 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366738.413223:0:14358:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789366738.413226:0:14358:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789366738.413229:0:14358:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789366738.413955:0:15055:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789366738.413963:0:15055:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005557b111/0x8da3486b955f43bd lrc: 3/0,1 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366738.413973:0:15055:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x14:0x0].0x0 since=313s v=(0 0) 00010000:00010000:3.0:1789366738.413977:0:15055:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789366738.413982:0:15055:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005557b111/0x8da3486b955f43bd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366738.413992:0:15055:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005557b111/0x8da3486b955f43bd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366738.414001:0:15055:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005557b111/0x8da3486b955f43bd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366738.414008:0:15055:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005557b111/0x8da3486b955f43bd lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366738.414032:0:15055:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789366738.414100:0:14359:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789366738.414108:0:14359:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005557b111/0x8da3486b955f43bd lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366738.414117:0:14359:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9638b6ce3800 already unused, calling callback (ffffffffc16df520) 00010000:00010000:1.0:1789366738.414121:0:14359:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005557b111/0x8da3486b955f43bd lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366738.414129:0:14359:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005557b111/0x8da3486b955f43bd lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366738.414144:0:14359:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005557b111/0x8da3486b955f43bd lrc: 1/0,0 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366738.414152:0:14359:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005557b111/0x8da3486b955f43bd lrc: 0/0,0 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366738.414181:0:14359:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789366738.414184:0:14359:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789366738.414186:0:14359:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789366738.414669:0:15055:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789366738.414682:0:15055:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a5d8bb44/0x8da3486b955f43c4 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366738.414691:0:15055:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x13:0x0].0x0 since=313s v=(0 0) 00010000:00010000:3.0:1789366738.414694:0:15055:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789366738.414700:0:15055:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a5d8bb44/0x8da3486b955f43c4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366738.414711:0:15055:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a5d8bb44/0x8da3486b955f43c4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366738.414742:0:15055:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a5d8bb44/0x8da3486b955f43c4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366738.414750:0:15055:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a5d8bb44/0x8da3486b955f43c4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366738.414764:0:15055:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789366738.414841:0:16242:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789366738.414848:0:16242:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a5d8bb44/0x8da3486b955f43c4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366738.414856:0:16242:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9638b6ce3200 already unused, calling callback (ffffffffc16df520) 00010000:00010000:2.0:1789366738.414861:0:16242:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a5d8bb44/0x8da3486b955f43c4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366738.414869:0:16242:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a5d8bb44/0x8da3486b955f43c4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366738.414881:0:16242:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a5d8bb44/0x8da3486b955f43c4 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366738.414888:0:16242:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a5d8bb44/0x8da3486b955f43c4 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366738.414904:0:16242:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789366738.414906:0:16242:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789366738.414909:0:16242:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789366738.415165:0:15055:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789366738.415170:0:15055:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e99a2fd5/0x8da3486b955f43cb lrc: 3/0,1 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366738.415178:0:15055:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x12:0x0].0x0 since=313s v=(0 0) 00010000:00010000:3.0:1789366738.415181:0:15055:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789366738.415186:0:15055:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e99a2fd5/0x8da3486b955f43cb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366738.415195:0:15055:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e99a2fd5/0x8da3486b955f43cb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366738.415208:0:15055:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e99a2fd5/0x8da3486b955f43cb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366738.415216:0:15055:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e99a2fd5/0x8da3486b955f43cb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366738.415235:0:15055:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789366738.415401:0:14358:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789366738.415407:0:14358:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e99a2fd5/0x8da3486b955f43cb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366738.415415:0:14358:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9638b6ce2e00 already unused, calling callback (ffffffffc16df520) 00010000:00010000:2.0:1789366738.415419:0:14358:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e99a2fd5/0x8da3486b955f43cb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366738.415450:0:14358:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e99a2fd5/0x8da3486b955f43cb lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366738.415463:0:14358:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e99a2fd5/0x8da3486b955f43cb lrc: 1/0,0 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366738.415471:0:14358:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e99a2fd5/0x8da3486b955f43cb lrc: 0/0,0 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366738.415486:0:14358:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789366738.415488:0:14358:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789366738.415490:0:14358:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789366738.416138:0:15055:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789366738.416144:0:15055:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e4010258/0x8da3486b955f43d2 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366738.416153:0:15055:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x11:0x0].0x0 since=313s v=(0 0) 00010000:00010000:3.0:1789366738.416156:0:15055:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789366738.416160:0:15055:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e4010258/0x8da3486b955f43d2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366738.416171:0:15055:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e4010258/0x8da3486b955f43d2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366738.416179:0:15055:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e4010258/0x8da3486b955f43d2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366738.416187:0:15055:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e4010258/0x8da3486b955f43d2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366738.416252:0:15055:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789366738.416477:0:14359:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789366738.416492:0:14359:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e4010258/0x8da3486b955f43d2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366738.416501:0:14359:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9638b6ce2200 already unused, calling callback (ffffffffc16df520) 00010000:00010000:0.0:1789366738.416511:0:14359:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e4010258/0x8da3486b955f43d2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366738.416520:0:14359:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e4010258/0x8da3486b955f43d2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366738.416533:0:14359:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e4010258/0x8da3486b955f43d2 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366738.416541:0:14359:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e4010258/0x8da3486b955f43d2 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00100000:1.0:1789366738.416556:0:5837:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 5e91e95c-c49d-475c-a425-33e1a73fefb4 00010000:00010000:0.0:1789366738.416569:0:14359:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789366738.416572:0:14359:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1789366738.416573:0:5837:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00010000:00010000:0.0:1789366738.416574:0:14359:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789366738.417165:0:15055:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789366738.417171:0:15055:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003ac13bbc/0x8da3486b955f43d9 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366738.417180:0:15055:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x10:0x0].0x0 since=313s v=(0 0) 00010000:00010000:3.0:1789366738.417183:0:15055:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789366738.417188:0:15055:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003ac13bbc/0x8da3486b955f43d9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366738.417197:0:15055:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003ac13bbc/0x8da3486b955f43d9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366738.417205:0:15055:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003ac13bbc/0x8da3486b955f43d9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366738.417212:0:15055:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003ac13bbc/0x8da3486b955f43d9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366738.417228:0:15055:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789366738.417251:0:16242:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789366738.417258:0:16242:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003ac13bbc/0x8da3486b955f43d9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366738.417266:0:16242:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9638b6ce3600 already unused, calling callback (ffffffffc16df520) 00010000:00010000:2.0:1789366738.417270:0:16242:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003ac13bbc/0x8da3486b955f43d9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366738.417279:0:16242:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003ac13bbc/0x8da3486b955f43d9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366738.417293:0:16242:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003ac13bbc/0x8da3486b955f43d9 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366738.417314:0:16242:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003ac13bbc/0x8da3486b955f43d9 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366738.417327:0:16242:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789366738.417329:0:16242:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789366738.417330:0:16242:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789366738.417932:0:15055:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789366738.417938:0:15055:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d8dc1c1c/0x8da3486b955f43e0 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366738.417947:0:15055:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xf:0x0].0x0 since=313s v=(0 0) 00010000:00010000:3.0:1789366738.417955:0:15055:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789366738.417959:0:15055:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d8dc1c1c/0x8da3486b955f43e0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366738.417969:0:15055:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d8dc1c1c/0x8da3486b955f43e0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366738.417976:0:15055:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d8dc1c1c/0x8da3486b955f43e0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366738.417983:0:15055:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d8dc1c1c/0x8da3486b955f43e0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366738.417998:0:15055:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789366738.418023:0:14358:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789366738.418030:0:14358:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d8dc1c1c/0x8da3486b955f43e0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366738.418050:0:14358:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9638b6ce3400 already unused, calling callback (ffffffffc16df520) 00010000:00010000:2.0:1789366738.418055:0:14358:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d8dc1c1c/0x8da3486b955f43e0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366738.418064:0:14358:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d8dc1c1c/0x8da3486b955f43e0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366738.418076:0:14358:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d8dc1c1c/0x8da3486b955f43e0 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366738.418085:0:14358:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d8dc1c1c/0x8da3486b955f43e0 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366738.418103:0:14358:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789366738.418105:0:14358:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789366738.418107:0:14358:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789366738.418389:0:15055:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789366738.418394:0:15055:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ee6d5de4/0x8da3486b955f43e7 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366738.418402:0:15055:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xe:0x0].0x0 since=313s v=(0 0) 00010000:00010000:3.0:1789366738.418405:0:15055:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789366738.418410:0:15055:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ee6d5de4/0x8da3486b955f43e7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366738.418418:0:15055:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ee6d5de4/0x8da3486b955f43e7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366738.418426:0:15055:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ee6d5de4/0x8da3486b955f43e7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366738.418448:0:15055:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ee6d5de4/0x8da3486b955f43e7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366738.418504:0:15055:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1789366738.418935:0:15055:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789366738.418941:0:15055:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001f76138e/0x8da3486b955f43ee lrc: 3/0,1 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366738.418949:0:15055:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xd:0x0].0x0 since=313s v=(0 0) 00010000:00010000:3.0:1789366738.418953:0:15055:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789366738.418957:0:15055:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001f76138e/0x8da3486b955f43ee lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366738.418965:0:15055:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001f76138e/0x8da3486b955f43ee lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366738.418973:0:15055:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001f76138e/0x8da3486b955f43ee lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366738.418980:0:15055:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001f76138e/0x8da3486b955f43ee lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366738.419200:0:14359:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1789366738.419207:0:14359:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ee6d5de4/0x8da3486b955f43e7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366738.419214:0:14359:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9638b6ce2400 already unused, calling callback (ffffffffc16df520) 00010000:00010000:0.0:1789366738.419218:0:14359:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ee6d5de4/0x8da3486b955f43e7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366738.419226:0:14359:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ee6d5de4/0x8da3486b955f43e7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366738.419238:0:14359:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ee6d5de4/0x8da3486b955f43e7 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366738.419246:0:14359:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ee6d5de4/0x8da3486b955f43e7 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366738.419261:0:14359:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789366738.419265:0:14359:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001f76138e/0x8da3486b955f43ee lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366738.419271:0:14359:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96388148e200 already unused, calling callback (ffffffffc16df520) 00010000:00010000:0.0:1789366738.419280:0:14359:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001f76138e/0x8da3486b955f43ee lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366738.419288:0:14359:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001f76138e/0x8da3486b955f43ee lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366738.419298:0:14359:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001f76138e/0x8da3486b955f43ee lrc: 2/0,0 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366738.419306:0:14359:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789366738.419307:0:14359:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789366738.419309:0:14359:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789366738.419400:0:15055:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1789366738.419406:0:15055:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001f76138e/0x8da3486b955f43ee lrc: 0/0,0 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366738.419423:0:16242:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789366738.420052:0:15055:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789366738.420059:0:15055:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005753861b/0x8da3486b955f43f5 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366738.420068:0:15055:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc:0x0].0x0 since=313s v=(0 0) 00010000:00010000:3.0:1789366738.420071:0:15055:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789366738.420075:0:15055:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005753861b/0x8da3486b955f43f5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366738.420085:0:15055:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005753861b/0x8da3486b955f43f5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366738.420091:0:15055:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005753861b/0x8da3486b955f43f5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366738.420099:0:15055:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005753861b/0x8da3486b955f43f5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366738.420118:0:15055:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789366738.420140:0:14358:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789366738.420147:0:14358:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005753861b/0x8da3486b955f43f5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366738.420156:0:14358:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96388148f600 already unused, calling callback (ffffffffc16df520) 00010000:00010000:2.0:1789366738.420160:0:14358:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005753861b/0x8da3486b955f43f5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366738.420180:0:14358:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005753861b/0x8da3486b955f43f5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366738.420194:0:14358:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005753861b/0x8da3486b955f43f5 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366738.420203:0:14358:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005753861b/0x8da3486b955f43f5 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366738.420220:0:14358:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789366738.420222:0:14358:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789366738.420225:0:14358:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789366738.420660:0:15055:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789366738.420666:0:15055:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000419790f2/0x8da3486b955f43fc lrc: 3/0,1 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366738.420674:0:15055:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xb:0x0].0x0 since=313s v=(0 0) 00010000:00010000:3.0:1789366738.420677:0:15055:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789366738.420686:0:15055:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000419790f2/0x8da3486b955f43fc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366738.420696:0:15055:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000419790f2/0x8da3486b955f43fc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366738.420704:0:15055:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000419790f2/0x8da3486b955f43fc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366738.420710:0:15055:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000419790f2/0x8da3486b955f43fc lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789366738.421164:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00010000:00010000:2.0:1789366738.421228:0:15055:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789366738.421248:0:14359:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789366738.421255:0:14359:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000419790f2/0x8da3486b955f43fc lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366738.421263:0:14359:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96388148fe00 already unused, calling callback (ffffffffc16df520) 00010000:00010000:0.0:1789366738.421268:0:14359:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000419790f2/0x8da3486b955f43fc lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366738.421278:0:14359:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000419790f2/0x8da3486b955f43fc lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366738.421291:0:14359:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000419790f2/0x8da3486b955f43fc lrc: 1/0,0 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366738.421299:0:14359:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000419790f2/0x8da3486b955f43fc lrc: 0/0,0 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366738.421399:0:14359:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789366738.421402:0:14359:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789366738.421404:0:14359:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789366738.421761:0:15782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751480576 00000100:00100000:1.0:1789366738.421773:0:15782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751480576 00000100:00100000:1.0:1789366738.421942:0:14372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 8 00000100:00100000:3.0:1789366738.422051:0:14372:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638b6d54a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5e91e95c-c49d-475c-a425-33e1a73fefb4+5:13776:x1876286751480576:12345-192.168.202.23@tcp:101:mkdir.0 00010000:00010000:3.0:1789366738.422070:0:14372:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789366738.422142:0:14372:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96388148f400/0x8da3486b955f4403 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xda917a494d06c3b0 expref: -99 pid: 14372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366738.422205:0:14372:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96388148e400/0x8da3486b955f440a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14372 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366738.422218:0:14372:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96388148e400/0x8da3486b955f440a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14372 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366738.422231:0:14372:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96388148e400/0x8da3486b955f440a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14372 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789366738.422262:0:14372:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1789366738.422274:0:14372:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1789366738.422397:0:14372:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff96388148e400/0x8da3486b955f440a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14372 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366738.422424:0:14372:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96388148f400/0x8da3486b955f4403 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.23@tcp remote: 0xda917a494d06c3b0 expref: 7 pid: 14372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366738.422454:0:14372:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96388148e400/0x8da3486b955f440a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.23@tcp remote: 0xda917a494d06c3b0 expref: 6 pid: 14372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366738.422463:0:14372:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff96389a30f300) 00010000:00010000:3.0:1789366738.422466:0:14372:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789366738.422469:0:14372:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96388148e400, rc 0) 00002000:00010000:2.0:1789366738.422511:0:15055:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789366738.422518:0:15055:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d2521def/0x8da3486b955f4411 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366738.422530:0:15055:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa:0x0].0x0 since=313s v=(0 0) 00010000:00010000:2.0:1789366738.422534:0:15055:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789366738.422545:0:15055:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d2521def/0x8da3486b955f4411 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366738.422624:0:15055:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d2521def/0x8da3486b955f4411 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789366738.422636:0:14372:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638b6d54a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5e91e95c-c49d-475c-a425-33e1a73fefb4+6:13776:x1876286751480576:12345-192.168.202.23@tcp:101:mkdir.0 Request processed in 613us (1472us total) trans 0 rc 0/0 00010000:00010000:2.0:1789366738.422636:0:15055:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d2521def/0x8da3486b955f4411 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789366738.422652:0:14372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 8 00010000:00010000:2.0:1789366738.422652:0:15055:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d2521def/0x8da3486b955f4411 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366738.422844:0:15055:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1789366738.423264:0:15055:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789366738.423270:0:15055:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000049d7092d/0x8da3486b955f4418 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366738.423279:0:15055:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x9:0x0].0x0 since=313s v=(0 0) 00010000:00010000:2.0:1789366738.423282:0:15055:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789366738.423287:0:15055:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000049d7092d/0x8da3486b955f4418 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366738.423296:0:15055:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000049d7092d/0x8da3486b955f4418 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366738.423303:0:15055:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000049d7092d/0x8da3486b955f4418 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366738.423320:0:15055:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000049d7092d/0x8da3486b955f4418 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366738.423340:0:15055:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1789366738.423360:0:14358:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1789366738.423368:0:14358:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d2521def/0x8da3486b955f4411 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366738.423376:0:14358:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9638902c8600 already unused, calling callback (ffffffffc16df520) 00010000:00010000:3.0:1789366738.423381:0:14358:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d2521def/0x8da3486b955f4411 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366738.423390:0:14358:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d2521def/0x8da3486b955f4411 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366738.423404:0:14358:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d2521def/0x8da3486b955f4411 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366738.423418:0:14358:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d2521def/0x8da3486b955f4411 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366738.423445:0:14358:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789366738.423450:0:14358:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000049d7092d/0x8da3486b955f4418 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366738.423456:0:14358:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9638902c9c00 already unused, calling callback (ffffffffc16df520) 00010000:00010000:3.0:1789366738.423460:0:14358:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000049d7092d/0x8da3486b955f4418 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366738.423468:0:14358:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000049d7092d/0x8da3486b955f4418 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366738.423479:0:14358:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000049d7092d/0x8da3486b955f4418 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366738.423497:0:14358:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000049d7092d/0x8da3486b955f4418 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366738.423515:0:14358:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789366738.423517:0:14358:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789366738.423520:0:14358:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789366738.423742:0:15055:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789366738.423749:0:15055:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005b46d4e5/0x8da3486b955f441f lrc: 3/0,1 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366738.423758:0:15055:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x8:0x0].0x0 since=313s v=(0 0) 00010000:00010000:2.0:1789366738.423761:0:15055:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789366738.423765:0:15055:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005b46d4e5/0x8da3486b955f441f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366738.423774:0:15055:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005b46d4e5/0x8da3486b955f441f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366738.423781:0:15055:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005b46d4e5/0x8da3486b955f441f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366738.423789:0:15055:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005b46d4e5/0x8da3486b955f441f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366738.423805:0:15055:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789366738.423823:0:14359:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789366738.423831:0:14359:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005b46d4e5/0x8da3486b955f441f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366738.423953:0:14359:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9638902c8000 already unused, calling callback (ffffffffc16df520) 00010000:00010000:0.0:1789366738.423957:0:14359:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005b46d4e5/0x8da3486b955f441f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366738.423965:0:14359:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005b46d4e5/0x8da3486b955f441f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366738.423979:0:14359:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005b46d4e5/0x8da3486b955f441f lrc: 1/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366738.423997:0:14359:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005b46d4e5/0x8da3486b955f441f lrc: 0/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366738.424011:0:14359:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789366738.424013:0:14359:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789366738.424015:0:14359:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789366738.424173:0:15055:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789366738.424179:0:15055:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000057441913/0x8da3486b955f4426 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366738.424192:0:15055:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x7:0x0].0x0 since=313s v=(0 0) 00010000:00010000:2.0:1789366738.424195:0:15055:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789366738.424199:0:15055:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000057441913/0x8da3486b955f4426 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366738.424208:0:15055:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000057441913/0x8da3486b955f4426 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366738.424216:0:15055:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000057441913/0x8da3486b955f4426 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366738.424222:0:15055:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000057441913/0x8da3486b955f4426 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366738.424239:0:15055:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789366738.424395:0:14358:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789366738.424401:0:14358:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000057441913/0x8da3486b955f4426 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366738.424416:0:14358:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9638902c8e00 already unused, calling callback (ffffffffc16df520) 00010000:00010000:3.0:1789366738.424419:0:14358:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000057441913/0x8da3486b955f4426 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366738.424428:0:14358:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000057441913/0x8da3486b955f4426 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366738.424452:0:14358:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000057441913/0x8da3486b955f4426 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366738.424459:0:14358:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000057441913/0x8da3486b955f4426 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366738.424474:0:14358:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789366738.424475:0:14358:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789366738.424477:0:14358:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789366738.424631:0:15055:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789366738.424636:0:15055:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000059097f2a/0x8da3486b955f442d lrc: 3/0,1 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366738.424644:0:15055:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=313s v=(0 0) 00010000:00010000:2.0:1789366738.424647:0:15055:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789366738.424651:0:15055:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000059097f2a/0x8da3486b955f442d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366738.424660:0:15055:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000059097f2a/0x8da3486b955f442d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366738.424679:0:15055:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000059097f2a/0x8da3486b955f442d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366738.424687:0:15055:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000059097f2a/0x8da3486b955f442d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366738.424708:0:15055:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00080000:2.0:1789366738.424897:0:15055:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x280000400:5 00000100:00100000:2.0:1789366738.424977:0:15055:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638b7039c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:14396:x1876286758803712:12345-0@lo:5:osp-pre-1-0.0 Request processed in 49023us (49305us total) trans 0 rc 0/0 00000100:00100000:2.0:1789366738.424986:0:15055:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1789366738.425060:0:14396:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9638b7038a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14396:1876286758803712:0@lo:5:osp-pre-1-0.0 00010000:00010000:1.0:1789366738.425060:0:16242:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789366738.425066:0:16242:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000059097f2a/0x8da3486b955f442d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366738.425075:0:16242:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9638902c9400 already unused, calling callback (ffffffffc16df520) 00000004:00080000:3.0:1789366738.425079:0:14396:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x280000400:0x21:0x0] from OST, last_created [0x280000400:0x21:0x0]last_used is [0x280000400:0x5:0x0] 00010000:00010000:1.0:1789366738.425079:0:16242:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000059097f2a/0x8da3486b955f442d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366738.425095:0:16242:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000059097f2a/0x8da3486b955f442d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366738.425108:0:16242:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000059097f2a/0x8da3486b955f442d lrc: 1/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366738.425115:0:16242:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000059097f2a/0x8da3486b955f442d lrc: 0/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366738.425130:0:16242:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789366738.425133:0:14396:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9638b6d56d80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14396:1876286758803840:0@lo:5:osp-pre-1-0.0 00010000:00010000:1.0:1789366738.425133:0:16242:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789366738.425136:0:16242:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789366738.425172:0:14396:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789366738.425265:0:14396:0:(client.c:2716:ptlrpc_set_wait()) set ffff9638aef8c480 going to sleep for 11 seconds 00000100:00100000:1.0:1789366738.425425:0:15698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286758803840 00000100:00100000:1.0:1789366738.425431:0:15698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286758803840 00010000:00010000:0.0:1789366738.425482:0:14359:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789366738.425523:0:15056:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1789366738.425533:0:15056:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638b6d55f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:14396:x1876286758803840:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:2.0:1789366738.425629:0:15056:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x280000400 at 34 00000100:00100000:2.0:1789366738.432546:0:14396:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9638b6d56d80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14396:1876286758803840:0@lo:5:osp-pre-1-0.0 00000004:00080000:2.0:1789366738.432576:0:14396:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x280000400:0x21:0x0]-[0x280000400:0x41:0x0] 00000100:00100000:3.0:1789366738.432681:0:15056:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638b6d55f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:14396:x1876286758803840:12345-0@lo:5:osp-pre-1-0.0 Request processed in 7148us (7506us total) trans 8589934593 rc 0/0 00000100:00100000:3.0:1789366738.432693:0:15056:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00010000:3.0:1789366739.128036:0:14358:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789366740.026667:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:2.0:1789366740.027018:0:15059:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751480704 00000100:00100000:2.0:1789366740.027028:0:15059:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751480704 00000100:00100000:2.0:1789366740.027163:0:15059:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 4 00000100:00100000:2.0:1789366740.027175:0:15059:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96388327df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:5e91e95c-c49d-475c-a425-33e1a73fefb4+6:13829:x1876286751480704:12345-192.168.202.23@tcp:13:lfs.0 00002000:00000024:2.0:1789366740.027214:0:15059:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789366740.027300:0:15059:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96388327df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:5e91e95c-c49d-475c-a425-33e1a73fefb4+6:13829:x1876286751480704:12345-192.168.202.23@tcp:13:lfs.0 Request processed in 127us (644us total) trans 0 rc 0/0 00000100:00100000:2.0:1789366740.027308:0:15059:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 4 00000100:00080000:3.0:1789366740.027903:0:14366:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789366740.029943:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:2.0:1789366740.030237:0:15059:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751480832 00000100:00100000:2.0:1789366740.030246:0:15059:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751480832 00000100:00100000:2.0:1789366740.030432:0:15059:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 5 00000100:00100000:2.0:1789366740.030445:0:15059:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96378749a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:5e91e95c-c49d-475c-a425-33e1a73fefb4+5:13829:x1876286751480832:12345-192.168.202.23@tcp:13:lfs.0 00002000:00000024:2.0:1789366740.030484:0:15059:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789366740.030569:0:15059:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96378749a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:5e91e95c-c49d-475c-a425-33e1a73fefb4+5:13829:x1876286751480832:12345-192.168.202.23@tcp:13:lfs.0 Request processed in 127us (633us total) trans 0 rc 0/0 00000100:00100000:2.0:1789366740.030576:0:15059:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 5 00000100:00080000:3.0:1789366740.031888:0:14366:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789366740.140460:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:3.0:1789366740.140596:0:14364:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751480960 00000100:00100000:3.0:1789366740.140606:0:14364:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751480960 00000100:00100000:3.0:1789366740.140692:0:14364:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 88 00000100:00100000:3.0:1789366740.140703:0:14364:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638987e6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:54a43f6e-a685-4942-96ef-6a0a40cf520e+10:13864:x1876286751480960:12345-192.168.202.23@tcp:101:mount.lustre.0 00010000:00010000:3.0:1789366740.140748:0:14364:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789366740.140766:0:14364:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff96388148f400/0x8da3486b955f4434 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0xda917a494d06c3b7 expref: -99 pid: 14364 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366740.140795:0:14364:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff96388148f400/0x8da3486b955f4434 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.202.23@tcp remote: 0xda917a494d06c3b7 expref: 11 pid: 14364 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366740.140806:0:14364:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff96388148f400/0x8da3486b955f4434 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.202.23@tcp remote: 0xda917a494d06c3b7 expref: 11 pid: 14364 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366740.140816:0:14364:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96388148f400, rc 0) 00000100:00100000:3.0:1789366740.140882:0:14364:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638987e6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:54a43f6e-a685-4942-96ef-6a0a40cf520e+11:13864:x1876286751480960:12345-192.168.202.23@tcp:101:mount.lustre.0 Request processed in 181us (429us total) trans 0 rc 0/0 00000100:00100000:3.0:1789366740.140889:0:14364:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 88 00000100:00100000:0.0:1789366740.147477:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:1.0:1789366740.147600:0:14365:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751481088 00000100:00100000:1.0:1789366740.147623:0:14365:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751481088 00000100:00100000:1.0:1789366740.147711:0:14365:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 89 00000100:00100000:1.0:1789366740.147761:0:14365:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638987e6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:54a43f6e-a685-4942-96ef-6a0a40cf520e+11:13864:x1876286751481088:12345-192.168.202.23@tcp:501:mount.lustre.0 00000100:00100000:1.0:1789366740.148062:0:14365:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638987e6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:54a43f6e-a685-4942-96ef-6a0a40cf520e+11:13864:x1876286751481088:12345-192.168.202.23@tcp:501:mount.lustre.0 Request processed in 341us (593us total) trans 0 rc 0/0 00000100:00100000:1.0:1789366740.148070:0:14365:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 89 00000100:00100000:1.0:1789366740.149478:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:3.0:1789366740.149542:0:14364:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751481216 00000100:00100000:3.0:1789366740.149549:0:14364:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751481216 00000100:00100000:3.0:1789366740.149786:0:14364:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 90 00000100:00100000:3.0:1789366740.149795:0:14364:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638987e6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:54a43f6e-a685-4942-96ef-6a0a40cf520e+11:13864:x1876286751481216:12345-192.168.202.23@tcp:503:mount.lustre.0 00000100:00100000:3.0:1789366740.150001:0:14364:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638987e6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:54a43f6e-a685-4942-96ef-6a0a40cf520e+11:13864:x1876286751481216:12345-192.168.202.23@tcp:503:mount.lustre.0 Request processed in 207us (526us total) trans 0 rc 0/0 00000100:00100000:3.0:1789366740.150010:0:14364:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 90 00010000:00010000:1.0:1789366740.152012:0:16242:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789366740.152470:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:1.0:1789366740.152644:0:14365:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751481344 00000100:00100000:1.0:1789366740.152652:0:14365:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751481344 00000100:00100000:1.0:1789366740.152753:0:14365:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 91 00000100:00100000:1.0:1789366740.152764:0:14365:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638987e5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:54a43f6e-a685-4942-96ef-6a0a40cf520e+11:13868:x1876286751481344:12345-192.168.202.23@tcp:502:llog_process_th.0 00000100:00100000:1.0:1789366740.153020:0:14365:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638987e5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:54a43f6e-a685-4942-96ef-6a0a40cf520e+11:13868:x1876286751481344:12345-192.168.202.23@tcp:502:llog_process_th.0 Request processed in 256us (553us total) trans 0 rc 0/0 00000100:00100000:1.0:1789366740.153028:0:14365:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 91 00000100:00100000:1.0:1789366740.159985:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:3.0:1789366740.160097:0:14364:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751481472 00000100:00100000:3.0:1789366740.160106:0:14364:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751481472 00000100:00100000:3.0:1789366740.160214:0:14364:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 92 00000100:00100000:3.0:1789366740.160225:0:14364:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638987e7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:54a43f6e-a685-4942-96ef-6a0a40cf520e+11:13868:x1876286751481472:12345-192.168.202.23@tcp:502:llog_process_th.0 00000100:00100000:3.0:1789366740.160518:0:14364:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638987e7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:54a43f6e-a685-4942-96ef-6a0a40cf520e+11:13868:x1876286751481472:12345-192.168.202.23@tcp:502:llog_process_th.0 Request processed in 294us (540us total) trans 0 rc 0/0 00000100:00100000:3.0:1789366740.160527:0:14364:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 92 00000100:00100000:2.0:1789366740.165943:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:1.0:1789366740.166226:0:14365:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751481600 00000100:00100000:1.0:1789366740.166235:0:14365:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751481600 00000100:00100000:1.0:1789366740.166292:0:14365:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 93 00000100:00100000:1.0:1789366740.166302:0:14365:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638987e4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:54a43f6e-a685-4942-96ef-6a0a40cf520e+11:13864:x1876286751481600:12345-192.168.202.23@tcp:101:mount.lustre.0 00010000:00010000:1.0:1789366740.166319:0:14365:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789366740.166348:0:14365:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9638c142d000/0x8da3486b955f443b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xda917a494d06c3e1 expref: -99 pid: 14365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366740.166378:0:14365:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9638c142d000/0x8da3486b955f443b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.202.23@tcp remote: 0xda917a494d06c3e1 expref: 12 pid: 14365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366740.166410:0:14365:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9638c142d000/0x8da3486b955f443b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.202.23@tcp remote: 0xda917a494d06c3e1 expref: 12 pid: 14365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366740.166429:0:14365:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9638c142d000, rc 0) 00000100:00100000:1.0:1789366740.166501:0:14365:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638987e4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:54a43f6e-a685-4942-96ef-6a0a40cf520e+12:13864:x1876286751481600:12345-192.168.202.23@tcp:101:mount.lustre.0 Request processed in 200us (569us total) trans 0 rc 0/0 00000100:00100000:1.0:1789366740.166508:0:14365:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 93 00000100:00100000:1.0:1789366740.171794:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:3.0:1789366740.171900:0:14364:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751481728 00000100:00100000:3.0:1789366740.171910:0:14364:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751481728 00000100:00100000:3.0:1789366740.171967:0:14364:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 94 00000100:00100000:3.0:1789366740.171977:0:14364:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638987e6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:54a43f6e-a685-4942-96ef-6a0a40cf520e+12:13864:x1876286751481728:12345-192.168.202.23@tcp:256:mount.lustre.0 20000000:01000000:3.0:1789366740.172002:0:14364:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:3.0:1789366740.172027:0:14364:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:3.0:1789366740.172031:0:14364:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:3.0:1789366740.172033:0:14364:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:3.0:1789366740.172036:0:14364:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 8 00000100:00100000:3.0:1789366740.173797:0:14364:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638987e6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:54a43f6e-a685-4942-96ef-6a0a40cf520e+12:13864:x1876286751481728:12345-192.168.202.23@tcp:256:mount.lustre.0 Request processed in 1816us (2007us total) trans 0 rc 0/0 00000100:00100000:3.0:1789366740.173810:0:14364:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 94 00000100:00100000:2.0:1789366740.175384:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:0.0:1789366740.175451:0:14363:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751481856 00000100:00100000:0.0:1789366740.175460:0:14363:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751481856 00000100:00100000:0.0:1789366740.175508:0:14363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 95 00000100:00100000:0.0:1789366740.175520:0:14363:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638987e7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:54a43f6e-a685-4942-96ef-6a0a40cf520e+12:13864:x1876286751481856:12345-192.168.202.23@tcp:101:mount.lustre.0 00010000:00010000:0.0:1789366740.175534:0:14363:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789366740.175551:0:14363:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9638b720de00/0x8da3486b955f4442 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xda917a494d06c3e8 expref: -99 pid: 14363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366740.175578:0:14363:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9638b720de00/0x8da3486b955f4442 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.202.23@tcp remote: 0xda917a494d06c3e8 expref: 13 pid: 14363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366740.175590:0:14363:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9638b720de00/0x8da3486b955f4442 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.202.23@tcp remote: 0xda917a494d06c3e8 expref: 13 pid: 14363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366740.175600:0:14363:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9638b720de00, rc 0) 00000100:00100000:0.0:1789366740.175639:0:14363:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638987e7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:54a43f6e-a685-4942-96ef-6a0a40cf520e+13:13864:x1876286751481856:12345-192.168.202.23@tcp:101:mount.lustre.0 Request processed in 122us (259us total) trans 0 rc 0/0 00000100:00100000:0.0:1789366740.175647:0:14363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 95 00000100:00100000:1.0:1789366740.176650:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:3.0:1789366740.176910:0:14364:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751481984 00000100:00100000:3.0:1789366740.176915:0:14364:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751481984 00000100:00100000:3.0:1789366740.176974:0:14364:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 96 00000100:00100000:3.0:1789366740.176980:0:14364:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638987e7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:54a43f6e-a685-4942-96ef-6a0a40cf520e+13:13864:x1876286751481984:12345-192.168.202.23@tcp:501:mount.lustre.0 00000100:00100000:3.0:1789366740.177199:0:14364:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638987e7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:54a43f6e-a685-4942-96ef-6a0a40cf520e+13:13864:x1876286751481984:12345-192.168.202.23@tcp:501:mount.lustre.0 Request processed in 219us (549us total) trans 0 rc 0/0 00000100:00100000:3.0:1789366740.177205:0:14364:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 96 00000100:00100000:2.0:1789366740.178212:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:0.0:1789366740.178290:0:14363:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751482112 00000100:00100000:0.0:1789366740.178294:0:14363:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751482112 00000100:00100000:0.0:1789366740.178320:0:14363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 97 00000100:00100000:0.0:1789366740.178329:0:14363:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638987e5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:54a43f6e-a685-4942-96ef-6a0a40cf520e+13:13864:x1876286751482112:12345-192.168.202.23@tcp:503:mount.lustre.0 00000100:00100000:0.0:1789366740.178472:0:14363:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638987e5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:54a43f6e-a685-4942-96ef-6a0a40cf520e+13:13864:x1876286751482112:12345-192.168.202.23@tcp:503:mount.lustre.0 Request processed in 143us (260us total) trans 0 rc 0/0 00000100:00100000:0.0:1789366740.178479:0:14363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 97 00000100:00100000:2.0:1789366740.179919:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:3.0:1789366740.179979:0:14364:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751482240 00000100:00100000:3.0:1789366740.179984:0:14364:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751482240 00000100:00100000:3.0:1789366740.180016:0:14364:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 98 00000100:00100000:3.0:1789366740.180024:0:14364:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638987e4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:54a43f6e-a685-4942-96ef-6a0a40cf520e+13:13872:x1876286751482240:12345-192.168.202.23@tcp:502:llog_process_th.0 00000100:00100000:3.0:1789366740.180185:0:14364:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638987e4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:54a43f6e-a685-4942-96ef-6a0a40cf520e+13:13872:x1876286751482240:12345-192.168.202.23@tcp:502:llog_process_th.0 Request processed in 161us (270us total) trans 0 rc 0/0 00000100:00100000:3.0:1789366740.180190:0:14364:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 98 00000100:00100000:1.0:1789366740.182196:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:0.0:1789366740.182356:0:14363:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751482368 00000100:00100000:0.0:1789366740.182365:0:14363:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751482368 00000100:00100000:0.0:1789366740.182462:0:14363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 99 00000100:00100000:0.0:1789366740.182472:0:14363:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638987e5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:54a43f6e-a685-4942-96ef-6a0a40cf520e+13:13872:x1876286751482368:12345-192.168.202.23@tcp:502:llog_process_th.0 00000100:00100000:0.0:1789366740.189172:0:14363:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638987e5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:54a43f6e-a685-4942-96ef-6a0a40cf520e+13:13872:x1876286751482368:12345-192.168.202.23@tcp:502:llog_process_th.0 Request processed in 6691us (6972us total) trans 0 rc 0/0 00000100:00100000:0.0:1789366740.189187:0:14363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 99 00000100:00100000:2.0:1789366740.192496:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:3.0:1789366740.192618:0:14370:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751482496 00000100:00100000:3.0:1789366740.192628:0:14370:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751482496 00000100:00100000:3.0:1789366740.192687:0:14370:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 9 00000100:00100000:3.0:1789366740.192695:0:14370:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638b703ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2353:x1876286751482496:12345-192.168.202.23@tcp:38:mount.lustre.0 00010000:00080000:3.0:1789366740.192756:0:14370:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from 0702386f-5a7a-4c7b-a250-794778d6bd7f@192.168.202.23@tcp t0 exp 0000000000000000 cur 315 last 0 00000020:00000080:3.0:1789366740.192808:0:14370:0:(genops.c:1385:class_connect()) connect: client 0702386f-5a7a-4c7b-a250-794778d6bd7f, cookie 0x8da3486b955f4449 00000004:00100000:3.0:1789366740.192841:0:14370:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:3.0:1789366740.194325:0:14370:0:(import.c:65:import_set_state_nolock()) ffff963898816800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789366740.194407:0:14370:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638b703ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0702386f-5a7a-4c7b-a250-794778d6bd7f+6:2353:x1876286751482496:12345-192.168.202.23@tcp:38:mount.lustre.0 Request processed in 1709us (1919us total) trans 0 rc 0/0 00000100:00100000:3.0:1789366740.194416:0:14370:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 9 00000100:00100000:2.0:1789366740.196286:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:3.0:1789366740.196528:0:15782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751482880 00000100:00100000:1.0:1789366740.196629:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:3.0:1789366740.196708:0:15782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751482880 00000100:00080000:2.0:1789366740.196915:0:14366:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789366740.197005:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:0.0:1789366740.197300:0:14372:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751482624 00000100:00100000:0.0:1789366740.197305:0:14372:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751482624 00000100:00100000:3.0:1789366740.197359:0:15782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751482752 00000100:00100000:3.0:1789366740.197363:0:15782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751482752 00000100:00100000:3.0:1789366740.197384:0:15782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 10 00000100:00100000:3.0:1789366740.197392:0:15782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638b7039500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5e91e95c-c49d-475c-a425-33e1a73fefb4+6:2357:x1876286751482880:12345-192.168.202.23@tcp:400:kworker.0 00000100:00100000:3.0:1789366740.197464:0:15782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638b7039500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5e91e95c-c49d-475c-a425-33e1a73fefb4+6:2357:x1876286751482880:12345-192.168.202.23@tcp:400:kworker.0 Request processed in 72us (1182us total) trans 0 rc 0/0 00000100:00100000:3.0:1789366740.197485:0:15782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 10 00000100:00100000:3.0:1789366740.197501:0:15782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 10 00000100:00100000:3.0:1789366740.197507:0:15782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96388327d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0702386f-5a7a-4c7b-a250-794778d6bd7f+7:13864:x1876286751482752:12345-192.168.202.23@tcp:41:mount.lustre.0 00000100:00100000:0.0:1789366740.197660:0:14372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 11 00000100:00100000:0.0:1789366740.197667:0:14372:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96388327d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0702386f-5a7a-4c7b-a250-794778d6bd7f+7:0:x1876286751482624:12345-192.168.202.23@tcp:41:mount.lustre.0 00000004:00000024:0.0:1789366740.197682:0:14372:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:0.0:1789366740.197737:0:14372:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96388327d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0702386f-5a7a-4c7b-a250-794778d6bd7f+7:0:x1876286751482624:12345-192.168.202.23@tcp:41:mount.lustre.0 Request processed in 70us (1109us total) trans 0 rc 0/0 00000100:00100000:0.0:1789366740.197744:0:14372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 11 00000004:00000024:3.0:1789366740.198355:0:15782:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:3.0:1789366740.198403:0:15782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96388327d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0702386f-5a7a-4c7b-a250-794778d6bd7f+6:13864:x1876286751482752:12345-192.168.202.23@tcp:41:mount.lustre.0 Request processed in 895us (1398us total) trans 0 rc 0/0 00000100:00100000:3.0:1789366740.198410:0:15782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 10 00000100:00080000:1.0:1789366740.198970:0:14366:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789366740.199899:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:0.0:1789366740.199970:0:14372:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751483008 00000100:00100000:0.0:1789366740.199977:0:14372:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751483008 00000100:00100000:0.0:1789366740.200027:0:14372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 12 00000100:00100000:0.0:1789366740.200036:0:14372:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96388327dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0702386f-5a7a-4c7b-a250-794778d6bd7f+6:13864:x1876286751483008:12345-192.168.202.23@tcp:40:mount.lustre.0 00000100:00100000:0.0:1789366740.200100:0:14372:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96388327dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0702386f-5a7a-4c7b-a250-794778d6bd7f+6:13864:x1876286751483008:12345-192.168.202.23@tcp:40:mount.lustre.0 Request processed in 65us (204us total) trans 0 rc 0/0 00000100:00100000:0.0:1789366740.200116:0:14372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 12 00000100:00100000:2.0:1789366740.202269:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:2.0:1789366740.202355:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:2.0:1789366740.202398:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:3.0:1789366740.202461:0:14374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751483392 00000100:00100000:3.0:1789366740.202469:0:14374:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751483392 00000100:00100000:3.0:1789366740.202514:0:14374:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 1 00000100:00100000:3.0:1789366740.202522:0:14374:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638b703aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0702386f-5a7a-4c7b-a250-794778d6bd7f+6:13864:x1876286751483392:12345-192.168.202.23@tcp:33:mount.lustre.0 00000004:00200000:3.0:1789366740.202612:0:14374:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000100:00100000:3.0:1789366740.202680:0:14374:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638b703aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0702386f-5a7a-4c7b-a250-794778d6bd7f+6:13864:x1876286751483392:12345-192.168.202.23@tcp:33:mount.lustre.0 Request processed in 158us (324us total) trans 0 rc 0/0 00000100:00100000:3.0:1789366740.202688:0:14374:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 1 00000100:00100000:1.0:1789366740.206327:0:15057:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751483136 00000100:00100000:1.0:1789366740.206340:0:15057:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751483136 00000100:00100000:1.0:1789366740.206383:0:15057:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751483264 00000100:00100000:1.0:1789366740.206387:0:15057:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751483264 00000100:00100000:1.0:1789366740.206428:0:15057:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 11 00000100:00100000:1.0:1789366740.206437:0:15057:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638b703b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2353:x1876286751483136:12345-192.168.202.23@tcp:8:mount.lustre.0 00010000:00080000:1.0:1789366740.206465:0:15057:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 0702386f-5a7a-4c7b-a250-794778d6bd7f@192.168.202.23@tcp t0 exp 0000000000000000 cur 315 last 0 00000020:00000080:1.0:1789366740.206511:0:15057:0:(genops.c:1385:class_connect()) connect: client 0702386f-5a7a-4c7b-a250-794778d6bd7f, cookie 0x8da3486b955f4450 00002000:00100000:1.0:1789366740.206522:0:15057:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 0702386f-5a7a-4c7b-a250-794778d6bd7f/ffff963882e36800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a06 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1789366740.206544:0:15057:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:1.0:1789366740.206659:0:15057:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1789366740.206693:0:15057:0:(import.c:65:import_set_state_nolock()) ffff963882e36000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789366740.206774:0:15057:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638b703b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0702386f-5a7a-4c7b-a250-794778d6bd7f+6:2353:x1876286751483136:12345-192.168.202.23@tcp:8:mount.lustre.0 Request processed in 337us (4510us total) trans 0 rc 0/0 00000100:00100000:1.0:1789366740.206782:0:15057:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 11 00000100:00100000:1.0:1789366740.206800:0:15057:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 12 00000100:00100000:1.0:1789366740.206804:0:15057:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638b703a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2353:x1876286751483264:12345-192.168.202.23@tcp:8:mount.lustre.0 00010000:00080000:1.0:1789366740.206819:0:15057:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 0702386f-5a7a-4c7b-a250-794778d6bd7f@192.168.202.23@tcp t0 exp 0000000000000000 cur 315 last 0 00000020:00000080:1.0:1789366740.206835:0:15057:0:(genops.c:1385:class_connect()) connect: client 0702386f-5a7a-4c7b-a250-794778d6bd7f, cookie 0x8da3486b955f4457 00002000:00100000:1.0:1789366740.206840:0:15057:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 0702386f-5a7a-4c7b-a250-794778d6bd7f/ffff963882e31000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a06 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1789366740.206846:0:15057:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:1.0:1789366740.206897:0:15057:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1789366740.206911:0:15057:0:(import.c:65:import_set_state_nolock()) ffff963882e34000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789366740.206932:0:15057:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638b703a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0702386f-5a7a-4c7b-a250-794778d6bd7f+6:2353:x1876286751483264:12345-192.168.202.23@tcp:8:mount.lustre.0 Request processed in 126us (4534us total) trans 0 rc 0/0 00000100:00100000:1.0:1789366740.206939:0:15057:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 12 00000100:00100000:0.0:1789366740.310061:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:3.0:1789366740.310171:0:15782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751483520 00000100:00100000:3.0:1789366740.310179:0:15782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751483520 00000100:00100000:3.0:1789366740.310230:0:15782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 13 00000100:00100000:3.0:1789366740.310237:0:15782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963787499180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0702386f-5a7a-4c7b-a250-794778d6bd7f+6:13893:x1876286751483520:12345-192.168.202.23@tcp:101:mkdir.0 00010000:00010000:3.0:1789366740.310254:0:15782:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789366740.310270:0:15782:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96388148e200/0x8da3486b955f445e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xda917a494d06c412 expref: -99 pid: 15782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366740.310320:0:15782:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96388148e800/0x8da3486b955f4465 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366740.310345:0:15782:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96388148e800/0x8da3486b955f4465 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366740.310356:0:15782:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96388148e800/0x8da3486b955f4465 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15782 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789366740.310394:0:15782:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1789366740.310398:0:15782:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1789366740.310427:0:15782:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff96388148e800/0x8da3486b955f4465 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366740.310453:0:15782:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96388148e200/0x8da3486b955f445e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.23@tcp remote: 0xda917a494d06c412 expref: 8 pid: 15782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366740.310472:0:15782:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96388148e800/0x8da3486b955f4465 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.23@tcp remote: 0xda917a494d06c412 expref: 7 pid: 15782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366740.310478:0:15782:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff96389a30f300) 00010000:00010000:3.0:1789366740.310480:0:15782:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789366740.310483:0:15782:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96388148e800, rc 0) 00000100:00100000:3.0:1789366740.310534:0:15782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963787499180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0702386f-5a7a-4c7b-a250-794778d6bd7f+7:13893:x1876286751483520:12345-192.168.202.23@tcp:101:mkdir.0 Request processed in 298us (482us total) trans 0 rc 0/0 00000100:00100000:3.0:1789366740.310538:0:15782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 13 00000001:00100000:1.0:1789366740.431866:0:6685:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 0702386f-5a7a-4c7b-a250-794778d6bd7f 00000001:00100000:1.0:1789366740.431881:0:6685:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 5e91e95c-c49d-475c-a425-33e1a73fefb4 00010000:00010000:0.0:1789366741.177465:0:14359:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1789366741.857376:0:16328:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:3.0:1789366742.202540:0:14358:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789366742.455983:0:3287:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789366742.456011:0:3287:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96388327ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3287:1876286758803968:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789366742.456081:0:3287:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789366742.456211:0:15058:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286758803968 00000100:00100000:1.0:1789366742.456218:0:15058:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286758803968 00000100:00100000:1.0:1789366742.456301:0:15058:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1789366742.456309:0:15058:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638b703b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3287:x1876286758803968:12345-0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1789366742.456337:0:14366:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00000024:1.0:1789366742.456339:0:15058:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789366742.456385:0:15058:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638b703b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3287:x1876286758803968:12345-0@lo:13:osp-pre-0-0.0 Request processed in 78us (305us total) trans 0 rc 0/0 00000100:00100000:1.0:1789366742.456390:0:15058:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1789366742.456458:0:3287:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96388327ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3287:1876286758803968:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1789366743.225807:0:16242:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789366743.484324:0:3287:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9638b7038700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:987e24be-cce8-4f54-8344-02fd27f3b2a2:3287:1876286758804096:0@lo:400:kworker.0 00000100:00100000:2.0:1789366743.484417:0:3287:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789366743.484468:0:3287:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9638b7038380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3287:1876286758804608:0@lo:400:kworker.0 00000100:00100000:3.0:1789366743.484509:0:3286:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9638b7039880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3286:1876286758804480:0@lo:400:kworker.0 00000100:00100000:2.0:1789366743.484510:0:3287:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789366743.484550:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789366743.484557:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9638b703a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3284:1876286758804224:0@lo:400:kworker.0 00000100:00100000:2.0:1789366743.484591:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789366743.484593:0:14364:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286758804096 00000100:00100000:3.0:1789366743.484601:0:14364:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286758804096 00000100:00100000:2.0:1789366743.484618:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9638b7038a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3284:1876286758804736:0@lo:400:kworker.0 00000100:00100000:2.0:1789366743.484645:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789366743.484665:0:3284:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789366743.484673:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9638b703bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3284:1876286758804352:0@lo:400:kworker.0 00000100:00100000:3.0:1789366743.484677:0:14364:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:3.0:1789366743.484689:0:14364:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638987e4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:987e24be-cce8-4f54-8344-02fd27f3b2a2+19:3287:x1876286758804096:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789366743.484701:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789366743.484760:0:14372:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286758804608 00000100:00100000:2.0:1789366743.484765:0:14372:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286758804608 00000100:00100000:3.0:1789366743.484773:0:14364:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638987e4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:987e24be-cce8-4f54-8344-02fd27f3b2a2+19:3287:x1876286758804096:12345-0@lo:400:kworker.0 Request processed in 85us (354us total) trans 0 rc 0/0 00000100:00100000:3.0:1789366743.484782:0:14364:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1789366743.484811:0:14372:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286758804480 00000100:00100000:2.0:1789366743.484816:0:14372:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286758804480 00000100:00100000:2.0:1789366743.484833:0:14372:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286758804736 00000100:00100000:2.0:1789366743.484836:0:14372:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286758804736 00000100:00100000:2.0:1789366743.484857:0:14372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1789366743.484865:0:14372:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638bfefb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3287:x1876286758804608:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789366743.484893:0:14371:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1789366743.484906:0:14371:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638b6d54000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3286:x1876286758804480:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789366743.484907:0:14372:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638bfefb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3287:x1876286758804608:12345-0@lo:400:kworker.0 Request processed in 40us (393us total) trans 0 rc 0/0 00000100:00100000:2.0:1789366743.484919:0:14372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1789366743.484936:0:14372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1789366743.484943:0:14372:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638bfef9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3284:x1876286758804736:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789366743.484954:0:14371:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638b6d54000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3286:x1876286758804480:12345-0@lo:400:kworker.0 Request processed in 52us (403us total) trans 0 rc 0/0 00000100:00100000:3.0:1789366743.484962:0:14371:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1789366743.484983:0:14372:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638bfef9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3284:x1876286758804736:12345-0@lo:400:kworker.0 Request processed in 40us (337us total) trans 0 rc 0/0 00000100:00100000:2.0:1789366743.484990:0:14372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1789366743.485014:0:15057:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286758804224 00000100:00100000:2.0:1789366743.485018:0:15057:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286758804224 00000100:00100000:3.0:1789366743.485019:0:3286:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9638b7039880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3286:1876286758804480:0@lo:400:kworker.0 00000100:00100000:2.0:1789366743.485050:0:15057:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286758804352 00000100:00100000:3.0:1789366743.485057:0:3287:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9638b7038700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:987e24be-cce8-4f54-8344-02fd27f3b2a2:3287:1876286758804096:0@lo:400:kworker.0 00000100:00100000:2.0:1789366743.485063:0:15057:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286758804352 00000100:00100000:3.0:1789366743.485072:0:3287:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9638b7038380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3287:1876286758804608:0@lo:400:kworker.0 00000100:00100000:2.0:1789366743.485097:0:15057:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1789366743.485175:0:15055:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1789366743.485185:0:15055:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638bfef9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3284:x1876286758804352:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789366743.485203:0:15057:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638bfefbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3284:x1876286758804224:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789366743.485222:0:15055:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638bfef9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3284:x1876286758804352:12345-0@lo:400:kworker.0 Request processed in 39us (520us total) trans 0 rc 0/0 00000100:00100000:3.0:1789366743.485229:0:15055:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1789366743.485248:0:15057:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638bfefbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3284:x1876286758804224:12345-0@lo:400:kworker.0 Request processed in 143us (656us total) trans 0 rc 0/0 00000100:00100000:2.0:1789366743.485256:0:15057:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00080000:3.0:1789366743.485276:0:14366:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789366743.485282:0:14366:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789366743.485285:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff963787499c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3285:1876286758804864:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789366743.485313:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789366743.485442:0:15059:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286758804864 00000100:00100000:2.0:1789366743.485447:0:15059:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286758804864 00000100:00100000:2.0:1789366743.485482:0:15059:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1789366743.485490:0:15059:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638bfef9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3285:x1876286758804864:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789366743.485518:0:15059:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789366743.485562:0:15059:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638bfef9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3285:x1876286758804864:12345-0@lo:13:osp-pre-1-0.0 Request processed in 73us (247us total) trans 0 rc 0/0 00000100:00100000:2.0:1789366743.485568:0:15059:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1789366743.485606:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff963787499c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3285:1876286758804864:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789366743.485629:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9638b703bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3284:1876286758804352:0@lo:400:kworker.0 00000100:00100000:2.0:1789366743.485641:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9638b703a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3284:1876286758804224:0@lo:400:kworker.0 00000100:00100000:2.0:1789366743.485654:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9638b7038a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3284:1876286758804736:0@lo:400:kworker.0 00000001:00100000:1.0:1789366743.520056:0:5837:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 0702386f-5a7a-4c7b-a250-794778d6bd7f 00000001:00100000:1.0:1789366743.548336:0:7617:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 0702386f-5a7a-4c7b-a250-794778d6bd7f 00000001:00100000:1.0:1789366743.548357:0:7617:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:1.0:1789366743.548386:0:7617:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934593 is committed 00000020:00000080:0.0:1789366743.673509:0:16477:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffeee85fe70 20000000:00000080:0.0:1789366743.673533:0:16477:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff963786ef2c00 uarg=0000000000000000 20000000:01000000:0.0:1789366743.673568:0:16477:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:0.0:1789366743.673574:0:16477:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:0.0:1789366743.673579:0:16477:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:2.0:1789366743.674639:0:16478:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 10 20000000:00000400:0.0:1789366743.674946:0:16477:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:0.0:1789366743.679924:0:16477:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1789366743.679954:0:16477:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9638b720cc00/0x8da3486b955f446c lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366743.679972:0:16477:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9638b720d200/0x8da3486b955f4163 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8da3486b955f415c expref: 18 pid: 14365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366743.679980:0:16477:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9638832d3400/0x8da3486b955f41b0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8da3486b955f41a9 expref: 18 pid: 14363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366743.679988:0:16477:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9638b720ca00/0x8da3486b955f42e4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8da3486b955f42dd expref: 18 pid: 14363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366743.679998:0:16477:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9638832d3600/0x8da3486b955f433f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.202.23@tcp remote: 0xda917a494d06c386 expref: 12 pid: 14364 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366743.680005:0:16477:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9638b720de00/0x8da3486b955f4442 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.202.23@tcp remote: 0xda917a494d06c3e8 expref: 12 pid: 14363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366743.680012:0:16477:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9638b720cc00/0x8da3486b955f446c lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 16477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366743.680053:0:16477:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9638b720de00/0x8da3486b955f4442 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.202.23@tcp remote: 0xda917a494d06c3e8 expref: 12 pid: 14363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366743.680068:0:16477:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9638b720de00/0x8da3486b955f4442 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.202.23@tcp remote: 0xda917a494d06c3e8 expref: 12 pid: 14363 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789366743.680090:0:16477:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96378749bb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16477:1876286758804992:192.168.202.23@tcp:104: 00010000:00010000:0.0:1789366743.680317:0:16477:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9638832d3600/0x8da3486b955f433f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.202.23@tcp remote: 0xda917a494d06c386 expref: 12 pid: 14364 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366743.680326:0:16477:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9638832d3600/0x8da3486b955f433f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.202.23@tcp remote: 0xda917a494d06c386 expref: 12 pid: 14364 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789366743.680335:0:16477:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff963787499880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16477:1876286758805120:192.168.202.23@tcp:104: 00010000:00010000:0.0:1789366743.680366:0:16477:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9638b720ca00/0x8da3486b955f42e4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x8da3486b955f42dd expref: 18 pid: 14363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366743.680374:0:16477:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9638b720ca00/0x8da3486b955f42e4 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x8da3486b955f42dd expref: 18 pid: 14363 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789366743.680382:0:16477:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96378749ad80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16477:1876286758805248:0@lo:104: 00000100:00100000:0.0:1789366743.680430:0:16477:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789366743.680468:0:16477:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9638832d3400/0x8da3486b955f41b0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x8da3486b955f41a9 expref: 18 pid: 14363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366743.680475:0:16477:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9638832d3400/0x8da3486b955f41b0 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x8da3486b955f41a9 expref: 18 pid: 14363 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789366743.680483:0:16477:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff963787499f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16477:1876286758805376:0@lo:104: 00000100:00100000:0.0:1789366743.680503:0:16477:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789366743.680532:0:16477:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9638b720d200/0x8da3486b955f4163 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x8da3486b955f415c expref: 18 pid: 14365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366743.680540:0:16477:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9638b720d200/0x8da3486b955f4163 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x8da3486b955f415c expref: 18 pid: 14365 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789366743.680555:0:16477:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96378749b480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16477:1876286758805504:0@lo:104: 00000100:00100000:0.0:1789366743.680579:0:16477:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789366743.680589:0:16477:0:(client.c:2716:ptlrpc_set_wait()) set ffff9638bfe9c240 going to sleep for 11 seconds 00000100:00100000:3.0:1789366743.680666:0:14354:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1789366743.680680:0:14354:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286758805248 00000100:00100000:3.0:1789366743.680686:0:14354:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286758805248 00000100:00100000:3.0:1789366743.680752:0:14354:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286758805376 00000100:00100000:3.0:1789366743.680756:0:14354:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286758805376 00000100:00100000:3.0:1789366743.680776:0:14354:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286758805504 00000100:00100000:3.0:1789366743.680779:0:14354:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286758805504 00000100:00100000:3.0:1789366743.680792:0:14354:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1789366743.680801:0:14354:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963787498700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:987e24be-cce8-4f54-8344-02fd27f3b2a2+5:16477:x1876286758805248:12345-0@lo:104: 00010000:00010000:3.0:1789366743.680813:0:14354:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.123@tcp lock: ffff9638902c9e00/0x8da3486b955f42dd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x8da3486b955f42e4 expref: -99 pid: 15769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366743.680879:0:14354:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1789366743.680886:0:14354:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963787498700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:987e24be-cce8-4f54-8344-02fd27f3b2a2+5:16477:x1876286758805248:12345-0@lo:104: Request processed in 86us (456us total) trans 0 rc 0/0 00000100:00100000:3.0:1789366743.680892:0:14354:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1789366743.680907:0:14354:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1789366743.680913:0:14354:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963787498000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:987e24be-cce8-4f54-8344-02fd27f3b2a2+4:16477:x1876286758805376:12345-0@lo:104: 00010000:00010000:3.0:1789366743.680921:0:14354:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.123@tcp lock: ffff9638b720c600/0x8da3486b955f41a9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x8da3486b955f41b0 expref: -99 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366743.680952:0:14354:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1789366743.680958:0:14354:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963787498000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:987e24be-cce8-4f54-8344-02fd27f3b2a2+4:16477:x1876286758805376:12345-0@lo:104: Request processed in 45us (454us total) trans 0 rc 0/0 00000100:00100000:3.0:1789366743.680963:0:14354:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1789366743.680975:0:14354:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1789366743.680981:0:14354:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638b6ce7450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:987e24be-cce8-4f54-8344-02fd27f3b2a2+3:16477:x1876286758805504:12345-0@lo:104: 00010000:00010000:3.0:1789366743.680988:0:14354:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.123@tcp lock: ffff9638832d2000/0x8da3486b955f415c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x8da3486b955f4163 expref: -99 pid: 14367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366743.681015:0:14354:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:3.0:1789366743.681020:0:14354:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638b6ce7450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:987e24be-cce8-4f54-8344-02fd27f3b2a2+3:16477:x1876286758805504:12345-0@lo:104: Request processed in 40us (441us total) trans 0 rc 0/0 00000100:00100000:3.0:1789366743.681037:0:14354:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00010000:3.0:1789366743.681085:0:14358:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1789366743.681091:0:14358:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.123@tcp lock: ffff9638902c9e00/0x8da3486b955f42dd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x8da3486b955f42e4 expref: -99 pid: 15769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366743.681098:0:14358:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9638902c9e00 already unused, calling callback (ffffffffc1cc7c20) 10000000:00010000:3.0:1789366743.681102:0:14358:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.123@tcp lock: ffff9638902c9e00/0x8da3486b955f42dd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x8da3486b955f42e4 expref: -99 pid: 15769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366743.681112:0:14358:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.123@tcp lock: ffff9638902c9e00/0x8da3486b955f42dd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x8da3486b955f42e4 expref: -99 pid: 15769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789366743.681132:0:14358:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.123@tcp lock: ffff9638902c9e00/0x8da3486b955f42dd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x8da3486b955f42e4 expref: -99 pid: 15769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789366743.681138:0:14358:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1789366743.681164:0:14358:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.123@tcp lock: ffff9638902c9e00/0x8da3486b955f42dd lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8da3486b955f42e4 expref: -99 pid: 15769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366743.681171:0:14358:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789366743.681189:0:14358:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.123@tcp lock: ffff9638902c9e00/0x8da3486b955f42dd lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8da3486b955f42e4 expref: -99 pid: 15769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366743.681197:0:14358:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.123@tcp lock: ffff9638902c9e00/0x8da3486b955f42dd lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8da3486b955f42e4 expref: -99 pid: 15769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366743.681209:0:14358:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1789366743.681212:0:14358:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.123@tcp lock: ffff9638b720c600/0x8da3486b955f41a9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x8da3486b955f41b0 expref: -99 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366743.681228:0:14358:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9638b720c600 already unused, calling callback (ffffffffc1cc7c20) 10000000:00010000:3.0:1789366743.681231:0:14358:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.123@tcp lock: ffff9638b720c600/0x8da3486b955f41a9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x8da3486b955f41b0 expref: -99 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366743.681238:0:14358:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.123@tcp lock: ffff9638b720c600/0x8da3486b955f41a9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x8da3486b955f41b0 expref: -99 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789366743.681244:0:14358:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.123@tcp lock: ffff9638b720c600/0x8da3486b955f41a9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x8da3486b955f41b0 expref: -99 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789366743.681249:0:14358:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1789366743.681262:0:14358:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.123@tcp lock: ffff9638b720c600/0x8da3486b955f41a9 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8da3486b955f41b0 expref: -99 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366743.681269:0:14358:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789366743.681275:0:14358:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.123@tcp lock: ffff9638b720c600/0x8da3486b955f41a9 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8da3486b955f41b0 expref: -99 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366743.681281:0:14358:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.123@tcp lock: ffff9638b720c600/0x8da3486b955f41a9 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8da3486b955f41b0 expref: -99 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366743.681291:0:14358:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789366743.681293:0:14358:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.123@tcp lock: ffff9638832d2000/0x8da3486b955f415c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x8da3486b955f4163 expref: -99 pid: 14367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366743.681299:0:14358:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9638832d2000 already unused, calling callback (ffffffffc1cc7c20) 10000000:00010000:3.0:1789366743.681302:0:14358:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.123@tcp lock: ffff9638832d2000/0x8da3486b955f415c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x8da3486b955f4163 expref: -99 pid: 14367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366743.681319:0:14358:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.123@tcp lock: ffff9638832d2000/0x8da3486b955f415c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x8da3486b955f4163 expref: -99 pid: 14367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789366743.681324:0:14358:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.123@tcp lock: ffff9638832d2000/0x8da3486b955f415c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x8da3486b955f4163 expref: -99 pid: 14367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789366743.681329:0:14358:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1789366743.681340:0:14358:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.123@tcp lock: ffff9638832d2000/0x8da3486b955f415c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8da3486b955f4163 expref: -99 pid: 14367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366743.681346:0:14358:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789366743.681358:0:14358:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.123@tcp lock: ffff9638832d2000/0x8da3486b955f415c lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8da3486b955f4163 expref: -99 pid: 14367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366743.681364:0:14358:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.123@tcp lock: ffff9638832d2000/0x8da3486b955f415c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8da3486b955f4163 expref: -99 pid: 14367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366743.681377:0:14358:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789366743.681379:0:14358:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789366743.681380:0:14358:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789366743.681411:0:3286:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9638b6d57800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:987e24be-cce8-4f54-8344-02fd27f3b2a2:3286:1876286758805632:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789366743.681440:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789366743.681461:0:3286:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789366743.681467:0:3286:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9638b6d54380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:987e24be-cce8-4f54-8344-02fd27f3b2a2:3286:1876286758805760:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789366743.681485:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789366743.681511:0:14355:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286758805632 00000100:00100000:3.0:1789366743.681515:0:14355:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286758805632 00010000:00010000:3.0:1789366743.681532:0:14355:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9638b720ca00/0x8da3486b955f42e4 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8da3486b955f42dd expref: 19 pid: 14363 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789366743.681561:0:14355:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286758805760 00000100:00100000:3.0:1789366743.681564:0:14355:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286758805760 00010000:00010000:3.0:1789366743.681573:0:14355:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9638832d3400/0x8da3486b955f41b0 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8da3486b955f41a9 expref: 20 pid: 14363 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789366743.681583:0:14355:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1789366743.681589:0:14355:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638b6d56300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:987e24be-cce8-4f54-8344-02fd27f3b2a2+20:3286:x1876286758805632:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789366743.681598:0:14355:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789366743.681603:0:14355:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9638b720ca00/0x8da3486b955f42e4 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8da3486b955f42dd expref: 20 pid: 14363 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366743.681612:0:14355:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9638b720ca00/0x8da3486b955f42e4 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x8da3486b955f42dd expref: 20 pid: 14363 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366743.681626:0:14355:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789366743.681651:0:14355:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638b6d56300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:987e24be-cce8-4f54-8344-02fd27f3b2a2+20:3286:x1876286758805632:12345-0@lo:103:ldlm_bl.0 Request processed in 62us (211us total) trans 0 rc 0/0 00000100:00100000:3.0:1789366743.681657:0:14355:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1789366743.681669:0:14355:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1789366743.681675:0:14355:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638b6d55500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:987e24be-cce8-4f54-8344-02fd27f3b2a2+19:3286:x1876286758805760:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789366743.681682:0:14355:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789366743.681687:0:14355:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9638832d3400/0x8da3486b955f41b0 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8da3486b955f41a9 expref: 19 pid: 14363 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366743.681695:0:14355:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9638832d3400/0x8da3486b955f41b0 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x8da3486b955f41a9 expref: 19 pid: 14363 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366743.681704:0:14355:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789366743.681760:0:14355:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638b6d55500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:987e24be-cce8-4f54-8344-02fd27f3b2a2+19:3286:x1876286758805760:12345-0@lo:103:ldlm_bl.0 Request processed in 84us (272us total) trans 0 rc 0/0 00000100:00100000:3.0:1789366743.681767:0:14355:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1789366743.681805:0:3286:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9638b6d54380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:987e24be-cce8-4f54-8344-02fd27f3b2a2:3286:1876286758805760:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789366743.681814:0:3286:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9638b6d57800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:987e24be-cce8-4f54-8344-02fd27f3b2a2:3286:1876286758805632:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789366743.681916:0:14359:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789366743.681939:0:16477:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9638b720ca00/0x8da3486b955f42e4 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x8da3486b955f42dd expref: 18 pid: 14363 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789366743.681950:0:16477:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96378749ad80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16477:1876286758805248:0@lo:104: 00010000:00010000:0.0:1789366743.681960:0:16477:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9638832d3400/0x8da3486b955f41b0 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x8da3486b955f41a9 expref: 17 pid: 14363 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789366743.681967:0:16477:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff963787499f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16477:1876286758805376:0@lo:104: 00000100:00100000:0.0:1789366743.681976:0:16477:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96378749b480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16477:1876286758805504:0@lo:104: 00010000:00010000:2.0:1789366743.682211:0:16242:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789366743.682222:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9638b6d56a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:987e24be-cce8-4f54-8344-02fd27f3b2a2:3284:1876286758805888:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789366743.682253:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789366743.682301:0:14355:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286758805888 00000100:00100000:2.0:1789366743.682305:0:14355:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286758805888 00010000:00010000:2.0:1789366743.682320:0:14355:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9638b720d200/0x8da3486b955f4163 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8da3486b955f415c expref: 17 pid: 14365 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789366743.682339:0:14355:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1789366743.682345:0:14355:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638bf49a850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:987e24be-cce8-4f54-8344-02fd27f3b2a2+17:3284:x1876286758805888:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789366743.682353:0:14355:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789366743.682356:0:14355:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9638b720d200/0x8da3486b955f4163 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8da3486b955f415c expref: 17 pid: 14365 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366743.682364:0:14355:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9638b720d200/0x8da3486b955f4163 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x8da3486b955f415c expref: 17 pid: 14365 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366743.682373:0:14355:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9638b720d200/0x8da3486b955f4163 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x8da3486b955f415c expref: 17 pid: 14365 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366743.682381:0:14355:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789366743.682423:0:14355:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638bf49a850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:987e24be-cce8-4f54-8344-02fd27f3b2a2+16:3284:x1876286758805888:12345-0@lo:103:ldlm_bl.0 Request processed in 78us (169us total) trans 0 rc 0/0 00000100:00100000:2.0:1789366743.682430:0:14355:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1789366743.682474:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9638b6d56a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:987e24be-cce8-4f54-8344-02fd27f3b2a2:3284:1876286758805888:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789366743.688207:0:16477:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96378749bb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16477:1876286758804992:192.168.202.23@tcp:104: 00000100:00100000:3.0:1789366743.688225:0:16477:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff963787499880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16477:1876286758805120:192.168.202.23@tcp:104: 00010000:00010000:3.0:1789366743.688267:0:16477:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9638b720cc00/0x8da3486b955f446c lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 16477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789366743.689402:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:2.0:1789366743.689513:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:3.0:1789366743.689941:0:14357:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751483776 00000100:00100000:3.0:1789366743.689951:0:14357:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751483776 00010000:00010000:3.0:1789366743.689991:0:14357:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9638832d3600/0x8da3486b955f433f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.23@tcp remote: 0xda917a494d06c386 expref: 13 pid: 14364 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789366743.690060:0:14357:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751483648 00000100:00100000:3.0:1789366743.690064:0:14357:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751483648 00010000:00010000:3.0:1789366743.690078:0:14357:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9638b720de00/0x8da3486b955f4442 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.23@tcp remote: 0xda917a494d06c3e8 expref: 14 pid: 14363 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789366743.690120:0:14355:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 7 00000100:00100000:0.0:1789366743.690132:0:14355:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638bfef8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:54a43f6e-a685-4942-96ef-6a0a40cf520e+14:2355:x1876286751483776:12345-192.168.202.23@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789366743.690145:0:14355:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789366743.690151:0:14355:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9638832d3600/0x8da3486b955f433f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.202.23@tcp remote: 0xda917a494d06c386 expref: 14 pid: 14364 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366743.690182:0:14355:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9638832d3600/0x8da3486b955f433f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.202.23@tcp remote: 0xda917a494d06c386 expref: 14 pid: 14364 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366743.690201:0:14355:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9638832d3600/0x8da3486b955f433f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.202.23@tcp remote: 0xda917a494d06c386 expref: 14 pid: 14364 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366743.690224:0:14355:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789366743.690301:0:14355:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638bfef8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:54a43f6e-a685-4942-96ef-6a0a40cf520e+13:2355:x1876286751483776:12345-192.168.202.23@tcp:103:ldlm_bl.0 Request processed in 172us (914us total) trans 0 rc 0/0 00000100:00100000:0.0:1789366743.690309:0:14355:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 7 00000100:00100000:0.0:1789366743.690327:0:14355:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 8 00000100:00100000:0.0:1789366743.690334:0:14355:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638bfefad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:54a43f6e-a685-4942-96ef-6a0a40cf520e+12:2355:x1876286751483648:12345-192.168.202.23@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789366743.690341:0:14355:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789366743.690347:0:14355:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9638b720de00/0x8da3486b955f4442 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.23@tcp remote: 0xda917a494d06c3e8 expref: 12 pid: 14363 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366743.690356:0:14355:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9638b720de00/0x8da3486b955f4442 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.202.23@tcp remote: 0xda917a494d06c3e8 expref: 12 pid: 14363 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366743.690366:0:14355:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9638b720de00/0x8da3486b955f4442 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.202.23@tcp remote: 0xda917a494d06c3e8 expref: 12 pid: 14363 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366743.690377:0:14355:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9638b720cc00/0x8da3486b955f446c lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 16477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366743.690401:0:14355:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9638b720cc00/0x8da3486b955f446c lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 16477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366743.690417:0:14355:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9638b720cc00/0x8da3486b955f446c lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 16477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366743.690424:0:14355:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9638b720cc00/0x8da3486b955f446c lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 16477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366743.690432:0:14355:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9638b720cc00/0x8da3486b955f446c lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 16477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366743.690439:0:14355:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9638b720cc00/0x8da3486b955f446c lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 16477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366743.690452:0:14355:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9638b720cc00 already unused, calling callback (ffffffffc16df520) 00010000:00010000:0.0:1789366743.690456:0:14355:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9638b720cc00/0x8da3486b955f446c lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 16477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366743.690464:0:14355:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9638b720cc00/0x8da3486b955f446c lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 16477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366743.690480:0:14355:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9638b720cc00/0x8da3486b955f446c lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366743.690491:0:14355:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789366743.690511:0:14355:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638bfefad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:54a43f6e-a685-4942-96ef-6a0a40cf520e+11:2355:x1876286751483648:12345-192.168.202.23@tcp:103:ldlm_bl.0 Request processed in 178us (999us total) trans 0 rc 0/0 00000100:00100000:0.0:1789366743.690518:0:14355:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 8 00010000:00010000:3.0:1789366743.691272:0:16477:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9638b720cc00/0x8da3486b955f446c lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366743.691282:0:16477:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9638b720cc00/0x8da3486b955f446c lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366743.691288:0:16477:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9638b720cc00/0x8da3486b955f446c lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366744.251364:0:14358:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789366745.271945:0:14359:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789366745.297317:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:1.0:1789366745.297417:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:1.0:1789366745.297457:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:1.0:1789366745.297593:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:1.0:1789366745.297623:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:3.0:1789366745.297760:0:14371:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751484032 00000100:00100000:3.0:1789366745.297770:0:14371:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751484032 00000100:00100000:3.0:1789366745.297835:0:14371:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 14 00000100:00100000:3.0:1789366745.297846:0:14371:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96388327ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5e91e95c-c49d-475c-a425-33e1a73fefb4+6:2355:x1876286751484032:12345-192.168.202.23@tcp:400:kworker.0 00000100:00100000:3.0:1789366745.297925:0:14371:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96388327ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5e91e95c-c49d-475c-a425-33e1a73fefb4+6:2355:x1876286751484032:12345-192.168.202.23@tcp:400:kworker.0 Request processed in 81us (619us total) trans 0 rc 0/0 00000100:00100000:3.0:1789366745.297933:0:14371:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 14 00000100:00080000:3.0:1789366745.297969:0:14366:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789366745.297998:0:14363:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751483904 00000100:00100000:3.0:1789366745.298002:0:14363:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751483904 00000100:00100000:3.0:1789366745.298024:0:14363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 101 00000100:00100000:3.0:1789366745.298030:0:14363:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638987e4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:54a43f6e-a685-4942-96ef-6a0a40cf520e+11:2355:x1876286751483904:12345-192.168.202.23@tcp:400:kworker.0 00000100:00100000:3.0:1789366745.298052:0:14363:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638987e4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:54a43f6e-a685-4942-96ef-6a0a40cf520e+11:2355:x1876286751483904:12345-192.168.202.23@tcp:400:kworker.0 Request processed in 22us (459us total) trans 0 rc 0/0 00000100:00100000:3.0:1789366745.298058:0:14363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 101 00000100:00100000:1.0:1789366745.299788:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:1.0:1789366745.299831:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:2.0:1789366745.300598:0:15057:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751484288 00000100:00100000:2.0:1789366745.300609:0:15057:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751484288 00000100:00100000:2.0:1789366745.300676:0:15057:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751484544 00000100:00100000:2.0:1789366745.300680:0:15057:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751484544 00000100:00100000:2.0:1789366745.300696:0:15057:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751484160 00000100:00100000:2.0:1789366745.300698:0:15057:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751484160 00000100:00100000:2.0:1789366745.301085:0:15057:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 5 00000100:00100000:2.0:1789366745.301095:0:15057:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96388327f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5e91e95c-c49d-475c-a425-33e1a73fefb4+5:2355:x1876286751484288:12345-192.168.202.23@tcp:400:kworker.0 00000100:00100000:2.0:1789366745.301169:0:15057:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96388327f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5e91e95c-c49d-475c-a425-33e1a73fefb4+5:2355:x1876286751484288:12345-192.168.202.23@tcp:400:kworker.0 Request processed in 76us (3752us total) trans 0 rc 0/0 00000100:00100000:2.0:1789366745.301177:0:15057:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 5 00000100:00100000:2.0:1789366745.301196:0:15057:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 6 00000100:00100000:2.0:1789366745.301203:0:15057:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96388327f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0702386f-5a7a-4c7b-a250-794778d6bd7f+5:2355:x1876286751484544:12345-192.168.202.23@tcp:400:kworker.0 00000100:00100000:2.0:1789366745.301226:0:15057:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96388327f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0702386f-5a7a-4c7b-a250-794778d6bd7f+5:2355:x1876286751484544:12345-192.168.202.23@tcp:400:kworker.0 Request processed in 25us (3769us total) trans 0 rc 0/0 00000100:00100000:2.0:1789366745.301232:0:15057:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 6 00000100:00100000:2.0:1789366745.301244:0:15057:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 7 00000100:00100000:2.0:1789366745.301250:0:15057:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96388327ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5e91e95c-c49d-475c-a425-33e1a73fefb4+5:2355:x1876286751484160:12345-192.168.202.23@tcp:400:kworker.0 00000100:00100000:2.0:1789366745.301271:0:15057:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96388327ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5e91e95c-c49d-475c-a425-33e1a73fefb4+5:2355:x1876286751484160:12345-192.168.202.23@tcp:400:kworker.0 Request processed in 22us (3647us total) trans 0 rc 0/0 00000100:00100000:2.0:1789366745.301278:0:15057:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 7 00000100:00100000:2.0:1789366745.301307:0:14372:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751484416 00000100:00100000:2.0:1789366745.301311:0:14372:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751484416 00000100:00100000:2.0:1789366745.301344:0:14372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 15 00000100:00100000:2.0:1789366745.301350:0:14372:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96388327fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0702386f-5a7a-4c7b-a250-794778d6bd7f+6:2355:x1876286751484416:12345-192.168.202.23@tcp:400:kworker.0 00000100:00080000:0.0:1789366745.301665:0:14366:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789366745.301671:0:14366:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789366745.301672:0:14366:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789366745.302041:0:14372:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96388327fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0702386f-5a7a-4c7b-a250-794778d6bd7f+6:2355:x1876286751484416:12345-192.168.202.23@tcp:400:kworker.0 Request processed in 684us (2253us total) trans 0 rc 0/0 00000100:00100000:2.0:1789366745.302049:0:14372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 15 00000100:00100000:2.0:1789366745.303226:0:15057:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751484672 00000100:00100000:2.0:1789366745.303236:0:15057:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751484672 00000100:00100000:2.0:1789366745.303320:0:15057:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 8 00000100:00100000:2.0:1789366745.303329:0:15057:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96388327e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0702386f-5a7a-4c7b-a250-794778d6bd7f+5:2355:x1876286751484672:12345-192.168.202.23@tcp:400:kworker.0 00000100:00080000:0.0:1789366745.303470:0:14366:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789366745.304129:0:15057:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96388327e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0702386f-5a7a-4c7b-a250-794778d6bd7f+5:2355:x1876286751484672:12345-192.168.202.23@tcp:400:kworker.0 Request processed in 798us (4295us total) trans 0 rc 0/0 00000100:00100000:2.0:1789366745.304137:0:15057:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 8 10000000:01000000:3.0:1789366745.399851:0:14367:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1789366745.399860:0:14367:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff963888974000 from 10 10000000:01000000:3.0:1789366745.399866:0:14367:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1789366745.399918:0:14367:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.123@tcp lock: ffff96388148fa00/0x8da3486b955f4473 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366745.399931:0:14367:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.123@tcp lock: ffff96388148fa00/0x8da3486b955f4473 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366745.399944:0:14367:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.123@tcp lock: ffff96388148fa00/0x8da3486b955f4473 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789366745.399993:0:14367:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9638b6d57800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:987e24be-cce8-4f54-8344-02fd27f3b2a2:14367:1876286758806016:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789366745.400072:0:14367:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789366745.400161:0:14367:0:(client.c:2716:ptlrpc_set_wait()) set ffff963883ba5780 going to sleep for 11 seconds 00000100:00100000:1.0:1789366745.400344:0:14365:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286758806016 00000100:00100000:1.0:1789366745.400353:0:14365:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286758806016 00000100:00100000:1.0:1789366745.400414:0:14365:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1789366745.400424:0:14365:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638af305850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:987e24be-cce8-4f54-8344-02fd27f3b2a2+16:14367:x1876286758806016:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789366745.400437:0:14365:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789366745.400449:0:14365:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9638c142c200/0x8da3486b955f447a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x8da3486b955f4473 expref: -99 pid: 14365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366745.400471:0:14365:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9638c142c200/0x8da3486b955f447a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8da3486b955f4473 expref: 17 pid: 14365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366745.400482:0:14365:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9638c142c200/0x8da3486b955f447a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8da3486b955f4473 expref: 17 pid: 14365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366745.400491:0:14365:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9638c142c200, rc 0) 00000100:00100000:1.0:1789366745.400587:0:14365:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638af305850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:987e24be-cce8-4f54-8344-02fd27f3b2a2+17:14367:x1876286758806016:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 163us (515us total) trans 0 rc 0/0 00000100:00100000:1.0:1789366745.400604:0:14365:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1789366745.404115:0:14367:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9638b6d57800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:987e24be-cce8-4f54-8344-02fd27f3b2a2:14367:1876286758806016:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789366745.404150:0:14367:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.123@tcp lock: ffff96388148fa00/0x8da3486b955f4473 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8da3486b955f447a expref: -99 pid: 14367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366745.404164:0:14367:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.123@tcp lock: ffff96388148fa00/0x8da3486b955f4473 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x8da3486b955f447a expref: -99 pid: 14367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789366745.404258:0:14367:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff963787499880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:987e24be-cce8-4f54-8344-02fd27f3b2a2:14367:1876286758806144:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789366745.404339:0:14367:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789366745.404478:0:14367:0:(client.c:2716:ptlrpc_set_wait()) set ffff96389073cb40 going to sleep for 11 seconds 00000100:00100000:3.0:1789366745.408345:0:14364:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286758806144 00000100:00100000:3.0:1789366745.408359:0:14364:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286758806144 00000100:00100000:3.0:1789366745.408430:0:14364:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1789366745.408439:0:14364:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638af304450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:987e24be-cce8-4f54-8344-02fd27f3b2a2+17:14367:x1876286758806144:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789366745.408944:0:14364:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638af304450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:987e24be-cce8-4f54-8344-02fd27f3b2a2+17:14367:x1876286758806144:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 504us (4605us total) trans 0 rc 0/0 00000100:00100000:3.0:1789366745.408953:0:14364:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1789366745.409078:0:14367:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff963787499880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:987e24be-cce8-4f54-8344-02fd27f3b2a2:14367:1876286758806144:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789366745.409141:0:14367:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff963787499880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:987e24be-cce8-4f54-8344-02fd27f3b2a2:14367:1876286758806272:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789366745.409192:0:14367:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789366745.409236:0:14367:0:(client.c:2716:ptlrpc_set_wait()) set ffff96389073cb40 going to sleep for 11 seconds 00000100:00100000:1.0:1789366745.409652:0:14365:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286758806272 00000100:00100000:1.0:1789366745.409659:0:14365:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286758806272 00000100:00100000:1.0:1789366745.409707:0:14365:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1789366745.409746:0:14365:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638af307850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:987e24be-cce8-4f54-8344-02fd27f3b2a2+17:14367:x1876286758806272:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789366745.410074:0:14365:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638af307850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:987e24be-cce8-4f54-8344-02fd27f3b2a2+17:14367:x1876286758806272:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 330us (881us total) trans 0 rc 0/0 00000100:00100000:1.0:1789366745.410081:0:14365:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1789366745.410476:0:14367:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff963787499880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:987e24be-cce8-4f54-8344-02fd27f3b2a2:14367:1876286758806272:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1789366745.411698:0:16586:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:2.0:1789366745.411902:0:14367:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:2.0:1789366745.411935:0:14367:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.123@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1789366745.411947:0:14367:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.123@tcp lock: ffff96388148fa00/0x8da3486b955f4473 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8da3486b955f447a expref: -99 pid: 14367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366745.411960:0:14367:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.123@tcp lock: ffff96388148fa00/0x8da3486b955f4473 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8da3486b955f447a expref: -99 pid: 14367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789366745.411973:0:14367:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1789366745.411976:0:14367:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9638a739f800 from 10 10000000:01000000:2.0:1789366745.411979:0:14367:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1789366745.412019:0:14367:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.123@tcp lock: ffff9638902c9400/0x8da3486b955f4481 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366745.412028:0:14367:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.123@tcp lock: ffff9638902c9400/0x8da3486b955f4481 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366745.412039:0:14367:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.123@tcp lock: ffff9638902c9400/0x8da3486b955f4481 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789366745.412066:0:14367:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9638bfefa680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:987e24be-cce8-4f54-8344-02fd27f3b2a2:14367:1876286758806400:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789366745.412124:0:14367:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789366745.412173:0:14367:0:(client.c:2716:ptlrpc_set_wait()) set ffff96389883e3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789366745.412321:0:14365:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286758806400 00000100:00100000:1.0:1789366745.412327:0:14365:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286758806400 00000100:00100000:1.0:1789366745.412388:0:14365:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1789366745.412397:0:14365:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638af305050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:987e24be-cce8-4f54-8344-02fd27f3b2a2+17:14367:x1876286758806400:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789366745.412410:0:14365:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789366745.412422:0:14365:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9638c142c600/0x8da3486b955f4488 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x8da3486b955f4481 expref: -99 pid: 14365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366745.412444:0:14365:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9638c142c600/0x8da3486b955f4488 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8da3486b955f4481 expref: 18 pid: 14365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366745.412455:0:14365:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9638c142c600/0x8da3486b955f4488 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8da3486b955f4481 expref: 18 pid: 14365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366745.412464:0:14365:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9638c142c600, rc 0) 00000100:00100000:1.0:1789366745.412522:0:14365:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638af305050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:987e24be-cce8-4f54-8344-02fd27f3b2a2+18:14367:x1876286758806400:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 126us (397us total) trans 0 rc 0/0 00000100:00100000:1.0:1789366745.412529:0:14365:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1789366745.412646:0:14367:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9638bfefa680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:987e24be-cce8-4f54-8344-02fd27f3b2a2:14367:1876286758806400:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789366745.412660:0:14367:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.123@tcp lock: ffff9638902c9400/0x8da3486b955f4481 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8da3486b955f4488 expref: -99 pid: 14367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366745.412669:0:14367:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.123@tcp lock: ffff9638902c9400/0x8da3486b955f4481 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x8da3486b955f4488 expref: -99 pid: 14367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789366745.412760:0:14367:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9638bfefa680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:987e24be-cce8-4f54-8344-02fd27f3b2a2:14367:1876286758806528:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789366745.412785:0:14367:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789366745.412801:0:14367:0:(client.c:2716:ptlrpc_set_wait()) set ffff96389883e3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789366745.413127:0:14363:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286758806528 00000100:00100000:3.0:1789366745.413133:0:14363:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286758806528 00000100:00100000:3.0:1789366745.413167:0:14363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1789366745.413176:0:14363:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638af306c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:987e24be-cce8-4f54-8344-02fd27f3b2a2+18:14367:x1876286758806528:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789366745.413434:0:14363:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638af306c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:987e24be-cce8-4f54-8344-02fd27f3b2a2+18:14367:x1876286758806528:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 259us (647us total) trans 0 rc 0/0 00000100:00100000:3.0:1789366745.413441:0:14363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1789366745.413550:0:14367:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9638bfefa680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:987e24be-cce8-4f54-8344-02fd27f3b2a2:14367:1876286758806528:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789366745.413578:0:14367:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9638bfefa680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:987e24be-cce8-4f54-8344-02fd27f3b2a2:14367:1876286758806656:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789366745.413616:0:14367:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789366745.413652:0:14367:0:(client.c:2716:ptlrpc_set_wait()) set ffff96389883e3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789366745.413707:0:14364:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286758806656 00000100:00100000:0.0:1789366745.413740:0:14364:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286758806656 00000100:00100000:0.0:1789366745.413768:0:14364:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1789366745.413776:0:14364:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638af307050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:987e24be-cce8-4f54-8344-02fd27f3b2a2+18:14367:x1876286758806656:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789366745.413936:0:14364:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638af307050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:987e24be-cce8-4f54-8344-02fd27f3b2a2+18:14367:x1876286758806656:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 160us (318us total) trans 0 rc 0/0 00000100:00100000:0.0:1789366745.413944:0:14364:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:2.0:1789366745.414091:0:14367:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9638bfefa680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:987e24be-cce8-4f54-8344-02fd27f3b2a2:14367:1876286758806656:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1789366745.420008:0:16587:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:2.0:1789366745.420224:0:14367:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:2.0:1789366745.420251:0:14367:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.123@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1789366745.420262:0:14367:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.123@tcp lock: ffff9638902c9400/0x8da3486b955f4481 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8da3486b955f4488 expref: -99 pid: 14367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366745.420273:0:14367:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.123@tcp lock: ffff9638902c9400/0x8da3486b955f4481 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8da3486b955f4488 expref: -99 pid: 14367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789366745.420283:0:14367:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1789366745.420286:0:14367:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff963888959000 from 10 10000000:01000000:2.0:1789366745.420289:0:14367:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1789366745.420340:0:14367:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.123@tcp lock: ffff9638902c8000/0x8da3486b955f448f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366745.420348:0:14367:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.123@tcp lock: ffff9638902c8000/0x8da3486b955f448f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366745.420360:0:14367:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.123@tcp lock: ffff9638902c8000/0x8da3486b955f448f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789366745.420398:0:14367:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9638bfefa680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:987e24be-cce8-4f54-8344-02fd27f3b2a2:14367:1876286758806784:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789366745.420467:0:14367:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789366745.420515:0:14367:0:(client.c:2716:ptlrpc_set_wait()) set ffff96389883e3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789366745.420584:0:14364:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286758806784 00000100:00100000:0.0:1789366745.420592:0:14364:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286758806784 00000100:00100000:0.0:1789366745.420639:0:14364:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:0.0:1789366745.420649:0:14364:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638af304850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:987e24be-cce8-4f54-8344-02fd27f3b2a2+18:14367:x1876286758806784:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789366745.420662:0:14364:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789366745.420674:0:14364:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9638b720da00/0x8da3486b955f4496 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x8da3486b955f448f expref: -99 pid: 14364 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366745.420696:0:14364:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9638b720da00/0x8da3486b955f4496 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8da3486b955f448f expref: 19 pid: 14364 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366745.420707:0:14364:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9638b720da00/0x8da3486b955f4496 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8da3486b955f448f expref: 19 pid: 14364 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366745.420763:0:14364:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9638b720da00, rc 0) 00000100:00100000:0.0:1789366745.420812:0:14364:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638af304850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:987e24be-cce8-4f54-8344-02fd27f3b2a2+19:14367:x1876286758806784:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 164us (344us total) trans 0 rc 0/0 00000100:00100000:0.0:1789366745.420818:0:14364:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1789366745.420998:0:14367:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9638bfefa680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:987e24be-cce8-4f54-8344-02fd27f3b2a2:14367:1876286758806784:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789366745.421013:0:14367:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.123@tcp lock: ffff9638902c8000/0x8da3486b955f448f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x8da3486b955f4496 expref: -99 pid: 14367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366745.421023:0:14367:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.123@tcp lock: ffff9638902c8000/0x8da3486b955f448f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x8da3486b955f4496 expref: -99 pid: 14367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789366745.421073:0:14367:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9638bfefa680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:987e24be-cce8-4f54-8344-02fd27f3b2a2:14367:1876286758806912:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789366745.421099:0:14367:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789366745.421131:0:14367:0:(client.c:2716:ptlrpc_set_wait()) set ffff96389883e3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789366745.421184:0:14365:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286758806912 00000100:00100000:1.0:1789366745.421195:0:14365:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286758806912 00000100:00100000:1.0:1789366745.421229:0:14365:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1789366745.421237:0:14365:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638af305c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:987e24be-cce8-4f54-8344-02fd27f3b2a2+19:14367:x1876286758806912:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789366745.421497:0:14365:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638af305c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:987e24be-cce8-4f54-8344-02fd27f3b2a2+19:14367:x1876286758806912:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 260us (396us total) trans 0 rc 0/0 00000100:00100000:1.0:1789366745.421504:0:14365:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1789366745.421938:0:14367:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9638bfefa680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:987e24be-cce8-4f54-8344-02fd27f3b2a2:14367:1876286758806912:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789366745.421971:0:14367:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9638bfefa680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:987e24be-cce8-4f54-8344-02fd27f3b2a2:14367:1876286758807040:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789366745.422010:0:14367:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789366745.422051:0:14367:0:(client.c:2716:ptlrpc_set_wait()) set ffff96389883e3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789366745.422102:0:14365:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286758807040 00000100:00100000:1.0:1789366745.422107:0:14365:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286758807040 00000100:00100000:1.0:1789366745.422129:0:14365:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:1.0:1789366745.422137:0:14365:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638af306450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:987e24be-cce8-4f54-8344-02fd27f3b2a2+19:14367:x1876286758807040:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789366745.422288:0:14365:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638af306450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:987e24be-cce8-4f54-8344-02fd27f3b2a2+19:14367:x1876286758807040:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 151us (276us total) trans 0 rc 0/0 00000100:00100000:1.0:1789366745.422295:0:14365:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1789366745.422657:0:14367:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9638bfefa680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:987e24be-cce8-4f54-8344-02fd27f3b2a2:14367:1876286758807040:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789366745.423016:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:2.0:1789366745.423082:0:14365:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751484800 00000100:00100000:2.0:1789366745.423087:0:14365:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751484800 00000100:00100000:2.0:1789366745.423120:0:14365:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 111 00000100:00100000:2.0:1789366745.423127:0:14365:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638af307450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:54a43f6e-a685-4942-96ef-6a0a40cf520e+11:13747:x1876286751484800:12345-192.168.202.23@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789366745.423136:0:14365:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789366745.423151:0:14365:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9638902c9e00/0x8da3486b955f449d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xda917a494d06c419 expref: -99 pid: 14365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366745.423174:0:14365:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9638902c9e00/0x8da3486b955f449d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.202.23@tcp remote: 0xda917a494d06c419 expref: 12 pid: 14365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366745.423185:0:14365:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9638902c9e00/0x8da3486b955f449d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.202.23@tcp remote: 0xda917a494d06c419 expref: 12 pid: 14365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366745.423194:0:14365:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9638902c9e00, rc 0) 00000100:00100000:2.0:1789366745.423230:0:14365:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638af307450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:54a43f6e-a685-4942-96ef-6a0a40cf520e+12:13747:x1876286751484800:12345-192.168.202.23@tcp:101:ll_cfg_requeue.0 Request processed in 103us (216us total) trans 0 rc 0/0 00000100:00100000:2.0:1789366745.423237:0:14365:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 111 00000100:00100000:0.0:1789366745.428579:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:3.0:1789366745.428754:0:14363:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751484928 00000100:00100000:3.0:1789366745.428765:0:14363:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751484928 00000100:00100000:3.0:1789366745.428829:0:14363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 112 00000100:00100000:3.0:1789366745.428839:0:14363:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638bfe9b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:54a43f6e-a685-4942-96ef-6a0a40cf520e+12:13747:x1876286751484928:12345-192.168.202.23@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789366745.429121:0:14363:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638bfe9b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:54a43f6e-a685-4942-96ef-6a0a40cf520e+12:13747:x1876286751484928:12345-192.168.202.23@tcp:501:ll_cfg_requeue.0 Request processed in 282us (555us total) trans 0 rc 0/0 00000100:00100000:3.0:1789366745.429139:0:14363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 112 00000100:00100000:0.0:1789366745.431482:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:1.0:1789366745.431568:0:14364:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751485056 00000100:00100000:1.0:1789366745.431577:0:14364:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751485056 00000100:00100000:1.0:1789366745.431636:0:14364:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 113 00000100:00100000:1.0:1789366745.431647:0:14364:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638bfe9ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:54a43f6e-a685-4942-96ef-6a0a40cf520e+12:13747:x1876286751485056:12345-192.168.202.23@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789366745.431899:0:14364:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638bfe9ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:54a43f6e-a685-4942-96ef-6a0a40cf520e+12:13747:x1876286751485056:12345-192.168.202.23@tcp:503:ll_cfg_requeue.0 Request processed in 253us (424us total) trans 0 rc 0/0 00000100:00100000:1.0:1789366745.431908:0:14364:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 113 00000100:00100000:0.0:1789366745.434813:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:1.0:1789366745.434934:0:14365:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751485184 00000100:00100000:1.0:1789366745.434944:0:14365:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751485184 00000100:00100000:1.0:1789366745.434995:0:14365:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 114 00000100:00100000:1.0:1789366745.435005:0:14365:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638bfe9b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:54a43f6e-a685-4942-96ef-6a0a40cf520e+12:13747:x1876286751485184:12345-192.168.202.23@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789366745.435022:0:14365:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789366745.435052:0:14365:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9638c142cc00/0x8da3486b955f44a4 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xda917a494d06c420 expref: -99 pid: 14365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366745.435079:0:14365:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9638c142cc00/0x8da3486b955f44a4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.202.23@tcp remote: 0xda917a494d06c420 expref: 13 pid: 14365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366745.435090:0:14365:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9638c142cc00/0x8da3486b955f44a4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.202.23@tcp remote: 0xda917a494d06c420 expref: 13 pid: 14365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366745.435100:0:14365:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9638c142cc00, rc 0) 00000100:00100000:1.0:1789366745.435154:0:14365:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638bfe9b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:54a43f6e-a685-4942-96ef-6a0a40cf520e+13:13747:x1876286751485184:12345-192.168.202.23@tcp:101:ll_cfg_requeue.0 Request processed in 151us (351us total) trans 0 rc 0/0 00000100:00100000:1.0:1789366745.435161:0:14365:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 114 00000040:00080000:2.0:1789366745.435644:0:16588:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000100:00100000:2.0:1789366745.439387:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:1.0:1789366745.439458:0:14364:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751485312 00000100:00100000:1.0:1789366745.439469:0:14364:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751485312 00000100:00100000:1.0:1789366745.439530:0:14364:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 115 00000100:00100000:1.0:1789366745.439540:0:14364:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638bfe99850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:54a43f6e-a685-4942-96ef-6a0a40cf520e+13:13747:x1876286751485312:12345-192.168.202.23@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789366745.440006:0:14364:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638bfe99850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:54a43f6e-a685-4942-96ef-6a0a40cf520e+13:13747:x1876286751485312:12345-192.168.202.23@tcp:501:ll_cfg_requeue.0 Request processed in 465us (636us total) trans 0 rc 0/0 00000100:00100000:1.0:1789366745.440015:0:14364:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 115 00000020:01000000:0.0:1789366745.441809:0:14367:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:0.0:1789366745.441852:0:14367:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.123@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1789366745.441865:0:14367:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.123@tcp lock: ffff9638902c8000/0x8da3486b955f448f lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x8da3486b955f4496 expref: -99 pid: 14367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366745.441878:0:14367:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.123@tcp lock: ffff9638902c8000/0x8da3486b955f448f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x8da3486b955f4496 expref: -99 pid: 14367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789366745.453225:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:3.0:1789366745.453328:0:14363:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751485440 00000100:00100000:3.0:1789366745.453339:0:14363:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751485440 00000100:00100000:3.0:1789366745.453401:0:14363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 116 00000100:00100000:3.0:1789366745.453412:0:14363:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638bfe99c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:54a43f6e-a685-4942-96ef-6a0a40cf520e+13:13747:x1876286751485440:12345-192.168.202.23@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789366745.453912:0:14363:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638bfe99c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:54a43f6e-a685-4942-96ef-6a0a40cf520e+13:13747:x1876286751485440:12345-192.168.202.23@tcp:503:ll_cfg_requeue.0 Request processed in 498us (696us total) trans 0 rc 0/0 00000100:00100000:3.0:1789366745.453922:0:14363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 116 00000100:00100000:2.0:1789366745.779690:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:3.0:1789366745.779783:0:14371:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751485568 00000100:00100000:3.0:1789366745.779794:0:14371:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751485568 00000100:00100000:3.0:1789366745.779877:0:14371:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 14 00000100:00100000:3.0:1789366745.779889:0:14371:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638bfefa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5e91e95c-c49d-475c-a425-33e1a73fefb4+6:14401:x1876286751485568:12345-192.168.202.23@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789366745.779919:0:14371:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789366745.779942:0:14371:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96388148e200/0x8da3486b955f44ab lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xda917a494d06c427 expref: -99 pid: 14371 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366745.780022:0:14371:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96388148fc00/0x8da3486b955f44b2 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14371 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366745.780039:0:14371:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96388148fc00/0x8da3486b955f44b2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14371 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366745.780052:0:14371:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96388148fc00/0x8da3486b955f44b2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14371 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366745.780079:0:14371:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96388148f000/0x8da3486b955f44b9 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14371 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366745.780113:0:14371:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96388148f000/0x8da3486b955f44b9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14371 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366745.780121:0:14371:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96388148f000/0x8da3486b955f44b9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14371 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366745.780443:0:14371:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96388148ea00/0x8da3486b955f44c0 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14371 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366745.780453:0:14371:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96388148ea00/0x8da3486b955f44c0 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14371 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366745.780461:0:14371:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96388148ea00/0x8da3486b955f44c0 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14371 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789366745.780486:0:14371:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1789366745.780490:0:14371:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1789366745.780526:0:14371:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff96388148ea00/0x8da3486b955f44c0 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14371 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366745.780537:0:14371:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96388148fc00/0x8da3486b955f44b2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14371 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366745.780544:0:14371:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96388148fc00/0x8da3486b955f44b2 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14371 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366745.780551:0:14371:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96388148fc00/0x8da3486b955f44b2 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14371 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366745.780556:0:14371:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96388148fc00 already unused, calling callback (ffffffffc20ee4f0) 00010000:00010000:3.0:1789366745.780561:0:14371:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96388148fc00/0x8da3486b955f44b2 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14371 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366745.780574:0:14371:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96388148fc00/0x8da3486b955f44b2 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14371 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366745.780586:0:14371:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff96389a30f300) 00010000:00010000:3.0:1789366745.780589:0:14371:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789366745.780594:0:14371:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96388148fc00/0x8da3486b955f44b2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14371 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366745.780600:0:14371:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96388148fc00/0x8da3486b955f44b2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14371 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366745.780612:0:14371:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96388148f000/0x8da3486b955f44b9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14371 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366745.780618:0:14371:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96388148f000/0x8da3486b955f44b9 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14371 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366745.780624:0:14371:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96388148f000/0x8da3486b955f44b9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14371 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366745.780629:0:14371:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96388148f000 already unused, calling callback (ffffffffc20ee4f0) 00010000:00010000:3.0:1789366745.780632:0:14371:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96388148f000/0x8da3486b955f44b9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14371 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366745.780637:0:14371:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96388148f000/0x8da3486b955f44b9 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14371 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366745.780644:0:14371:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff96389a30f100) 00010000:00010000:3.0:1789366745.780646:0:14371:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789366745.780649:0:14371:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96388148f000/0x8da3486b955f44b9 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14371 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366745.780663:0:14371:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96388148f000/0x8da3486b955f44b9 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14371 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366745.780693:0:14371:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96388148e200/0x8da3486b955f44ab lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.23@tcp remote: 0xda917a494d06c427 expref: 8 pid: 14371 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366745.780706:0:14371:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96388148ea00/0x8da3486b955f44c0 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.23@tcp remote: 0xda917a494d06c427 expref: 7 pid: 14371 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366745.780714:0:14371:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff96389a30ff00) 00010000:00010000:3.0:1789366745.780761:0:14371:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789366745.780764:0:14371:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96388148ea00, rc 0) 00000100:00100000:3.0:1789366745.780833:0:14371:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638bfefa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5e91e95c-c49d-475c-a425-33e1a73fefb4+7:14401:x1876286751485568:12345-192.168.202.23@tcp:101:lhsmtool_posix.0 Request processed in 947us (1151us total) trans 0 rc 0/0 00000100:00100000:3.0:1789366745.780841:0:14371:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 14 00000100:00100000:0.0:1789366745.783216:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:3.0:1789366745.783299:0:14370:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751485824 00000100:00100000:3.0:1789366745.783308:0:14370:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751485824 00000100:00100000:3.0:1789366745.783532:0:14370:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 15 00000100:00100000:3.0:1789366745.783543:0:14370:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96378749bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5e91e95c-c49d-475c-a425-33e1a73fefb4+7:14401:x1876286751485824:12345-192.168.202.23@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789366745.783572:0:14370:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789366745.783589:0:14370:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96388148f800/0x8da3486b955f44c7 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xda917a494d06c42e expref: -99 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366745.784833:0:14370:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96388148e000/0x8da3486b955f44ce lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366745.784847:0:14370:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96388148e000/0x8da3486b955f44ce lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366745.784870:0:14370:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96388148e000/0x8da3486b955f44ce lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366745.784923:0:14370:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96388148f600/0x8da3486b955f44d5 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366745.784932:0:14370:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96388148f600/0x8da3486b955f44d5 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366745.784938:0:14370:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96388148f600/0x8da3486b955f44d5 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366745.785254:0:14370:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96388148fe00/0x8da3486b955f44dc lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366745.785263:0:14370:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96388148fe00/0x8da3486b955f44dc lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366745.785269:0:14370:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96388148fe00/0x8da3486b955f44dc lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789366745.785278:0:14370:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 16384 00010000:00010000:3.0:1789366745.788743:0:14370:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96388148e000/0x8da3486b955f44ce lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366745.788762:0:14370:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96388148e000/0x8da3486b955f44ce lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366745.788770:0:14370:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96388148e000/0x8da3486b955f44ce lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366745.788776:0:14370:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96388148e000 already unused, calling callback (ffffffffc20ee4f0) 00010000:00010000:3.0:1789366745.788796:0:14370:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96388148e000/0x8da3486b955f44ce lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366745.788806:0:14370:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96388148e000/0x8da3486b955f44ce lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366745.788823:0:14370:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff96389a30ff00) 00010000:00010000:3.0:1789366745.788826:0:14370:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789366745.788831:0:14370:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96388148e000/0x8da3486b955f44ce lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366745.788838:0:14370:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96388148e000/0x8da3486b955f44ce lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366745.788855:0:14370:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96388148f600/0x8da3486b955f44d5 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366745.788859:0:14370:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96388148f600/0x8da3486b955f44d5 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366745.788863:0:14370:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96388148f600/0x8da3486b955f44d5 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366745.788866:0:14370:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96388148f600 already unused, calling callback (ffffffffc20ee4f0) 00010000:00010000:3.0:1789366745.788868:0:14370:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96388148f600/0x8da3486b955f44d5 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366745.788871:0:14370:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96388148f600/0x8da3486b955f44d5 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366745.788876:0:14370:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff96389a30f600) 00010000:00010000:3.0:1789366745.788877:0:14370:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789366745.788884:0:14370:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96388148f600/0x8da3486b955f44d5 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366745.788888:0:14370:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96388148f600/0x8da3486b955f44d5 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366745.791964:0:14370:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96388148f800/0x8da3486b955f44c7 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.23@tcp remote: 0xda917a494d06c42e expref: 10 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366745.791989:0:14370:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96388148fe00/0x8da3486b955f44dc lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.23@tcp remote: 0xda917a494d06c42e expref: 9 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366745.791999:0:14370:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff96389a30f000) 00010000:00010000:3.0:1789366745.792002:0:14370:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789366745.792005:0:14370:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96388148fe00, rc 0) 00000100:00100000:3.0:1789366745.792084:0:14370:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96378749bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5e91e95c-c49d-475c-a425-33e1a73fefb4+9:14401:x1876286751485824:12345-192.168.202.23@tcp:101:lhsmtool_posix.0 Request processed in 8542us (8875us total) trans 8589934593 rc 0/0 00000100:00100000:3.0:1789366745.792093:0:14370:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 15 00000100:00100000:1.0:1789366745.803895:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:0.0:1789366745.808615:0:15782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751485952 00000100:00100000:0.0:1789366745.808632:0:15782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751485952 00000100:00100000:0.0:1789366745.808714:0:15782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 16 00000100:00100000:0.0:1789366745.808751:0:15782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96388327ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5e91e95c-c49d-475c-a425-33e1a73fefb4+9:14401:x1876286751485952:12345-192.168.202.23@tcp:59:lhsmtool_posix.0 00000100:00100000:0.0:1789366745.808881:0:15782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96388327ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5e91e95c-c49d-475c-a425-33e1a73fefb4+9:14401:x1876286751485952:12345-192.168.202.23@tcp:59:lhsmtool_posix.0 Request processed in 137us (4996us total) trans 0 rc 0/0 00000100:00100000:0.0:1789366745.808889:0:15782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 16 00000100:00100000:2.0:1789366745.833255:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:0.0:1789366745.833798:0:14372:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751486080 00000100:00100000:0.0:1789366745.833809:0:14372:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751486080 00000100:00100000:0.0:1789366745.833939:0:14372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 17 00000100:00100000:0.0:1789366745.833950:0:14372:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638bfef9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5e91e95c-c49d-475c-a425-33e1a73fefb4+9:14407:x1876286751486080:12345-192.168.202.23@tcp:101:lfs.0 00010000:00010000:0.0:1789366745.833970:0:14372:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789366745.833992:0:14372:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720c600/0x8da3486b955f44ea lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xda917a494d06c435 expref: -99 pid: 14372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366745.834054:0:14372:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720d200/0x8da3486b955f44f1 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14372 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366745.834069:0:14372:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720d200/0x8da3486b955f44f1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14372 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366745.834081:0:14372:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720d200/0x8da3486b955f44f1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14372 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366745.834096:0:14372:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720cc00/0x8da3486b955f44f8 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14372 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366745.834103:0:14372:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720cc00/0x8da3486b955f44f8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14372 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366745.834110:0:14372:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720cc00/0x8da3486b955f44f8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14372 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366745.834301:0:14372:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720d200/0x8da3486b955f44f1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14372 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366745.834310:0:14372:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720d200/0x8da3486b955f44f1 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14372 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366745.834317:0:14372:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720d200/0x8da3486b955f44f1 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14372 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366745.834333:0:14372:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9638b720d200 already unused, calling callback (ffffffffc20ee4f0) 00010000:00010000:0.0:1789366745.834337:0:14372:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720d200/0x8da3486b955f44f1 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14372 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366745.834345:0:14372:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720d200/0x8da3486b955f44f1 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14372 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366745.834357:0:14372:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff96389a30f300) 00010000:00010000:0.0:1789366745.834360:0:14372:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789366745.834365:0:14372:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720d200/0x8da3486b955f44f1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14372 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366745.834384:0:14372:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720d200/0x8da3486b955f44f1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14372 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366745.834397:0:14372:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720cc00/0x8da3486b955f44f8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14372 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366745.834403:0:14372:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720cc00/0x8da3486b955f44f8 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14372 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366745.834409:0:14372:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720cc00/0x8da3486b955f44f8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14372 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366745.834415:0:14372:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9638b720cc00 already unused, calling callback (ffffffffc20ee4f0) 00010000:00010000:0.0:1789366745.834418:0:14372:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720cc00/0x8da3486b955f44f8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14372 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366745.834423:0:14372:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720cc00/0x8da3486b955f44f8 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14372 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366745.834442:0:14372:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff963890797500) 00010000:00010000:0.0:1789366745.834445:0:14372:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789366745.834448:0:14372:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720cc00/0x8da3486b955f44f8 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14372 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366745.835625:0:14372:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720cc00/0x8da3486b955f44f8 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14372 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366745.835674:0:14372:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720c600/0x8da3486b955f44ea lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.23@tcp remote: 0xda917a494d06c435 expref: 10 pid: 14372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366745.835686:0:14372:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff96389a30f300) 00010000:00010000:0.0:1789366745.835689:0:14372:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789366745.835693:0:14372:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720c600/0x8da3486b955f44ea lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.23@tcp remote: 0xda917a494d06c435 expref: 10 pid: 14372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366745.835702:0:14372:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9638b720c600, rc 0) 00000100:00100000:0.0:1789366745.835796:0:14372:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638bfef9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5e91e95c-c49d-475c-a425-33e1a73fefb4+9:14407:x1876286751486080:12345-192.168.202.23@tcp:101:lfs.0 Request processed in 1847us (2549us total) trans 0 rc 301/301 00000100:00100000:0.0:1789366745.835804:0:14372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 17 00000100:00100000:2.0:1789366745.839777:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:1.0:1789366745.840200:0:14379:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751486208 00000100:00100000:1.0:1789366745.840209:0:14379:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751486208 00000100:00100000:1.0:1789366745.840264:0:14379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 0 00000100:00100000:1.0:1789366745.840274:0:14379:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638bfef8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:5e91e95c-c49d-475c-a425-33e1a73fefb4+9:14407:x1876286751486208:12345-192.168.202.23@tcp:700:lfs.0 00000100:00100000:1.0:1789366745.840359:0:14379:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638bfef8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:5e91e95c-c49d-475c-a425-33e1a73fefb4+9:14407:x1876286751486208:12345-192.168.202.23@tcp:700:lfs.0 Request processed in 85us (591us total) trans 0 rc 0/0 00000100:00100000:1.0:1789366745.840394:0:14379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 0 00000100:00100000:2.0:1789366745.842935:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:0.0:1789366745.844547:0:15782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751486464 00000100:00100000:0.0:1789366745.844560:0:15782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751486464 00000100:00100000:0.0:1789366745.844636:0:15782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 18 00000100:00100000:0.0:1789366745.844647:0:15782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638bfef8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5e91e95c-c49d-475c-a425-33e1a73fefb4+9:14407:x1876286751486464:12345-192.168.202.23@tcp:36:lfs.0 00010000:00010000:0.0:1789366745.845038:0:15782:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789366745.845067:0:15782:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96388148e400/0x8da3486b955f440a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.23@tcp remote: 0xda917a494d06c3b0 expref: 9 pid: 14372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366745.845169:0:15782:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff96389a30f300) 00010000:00010000:0.0:1789366745.845174:0:15782:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789366745.845477:0:15782:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9638c142ca00/0x8da3486b955f44ff lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366745.845493:0:15782:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff96388148e800/0x8da3486b955f4465 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.23@tcp remote: 0xda917a494d06c412 expref: 5 pid: 15782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366745.845502:0:15782:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9638c142ca00/0x8da3486b955f44ff lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366745.845536:0:15782:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff96388148e800/0x8da3486b955f4465 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.23@tcp remote: 0xda917a494d06c412 expref: 5 pid: 15782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366745.845551:0:15782:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff96388148e800/0x8da3486b955f4465 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.23@tcp remote: 0xda917a494d06c412 expref: 5 pid: 15782 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789366745.845566:0:15782:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9638aef24000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15782:1876286758807168:192.168.202.23@tcp:104: 00000100:00100000:1.0:1789366745.846894:0:15782:0:(client.c:2716:ptlrpc_set_wait()) set ffff9638ba5f6240 going to sleep for 11 seconds 00000100:00100000:3.0:1789366745.847438:0:15782:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9638aef24000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15782:1876286758807168:192.168.202.23@tcp:104: 00010000:00010000:3.0:1789366745.847461:0:15782:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9638c142ca00/0x8da3486b955f44ff lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15782 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789366745.847683:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:3.0:1789366745.848001:0:14357:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751486592 00000100:00100000:3.0:1789366745.848007:0:14357:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751486592 00010000:00010000:3.0:1789366745.848034:0:14357:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff96388148e800/0x8da3486b955f4465 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.23@tcp remote: 0xda917a494d06c412 expref: 6 pid: 15782 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789366745.848064:0:14357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 9 00000100:00100000:3.0:1789366745.848071:0:14357:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638bfefa300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0702386f-5a7a-4c7b-a250-794778d6bd7f+6:2354:x1876286751486592:12345-192.168.202.23@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789366745.848090:0:14357:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789366745.848097:0:14357:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff96388148e800/0x8da3486b955f4465 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.23@tcp remote: 0xda917a494d06c412 expref: 6 pid: 15782 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366745.848108:0:14357:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff96388148e800/0x8da3486b955f4465 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.23@tcp remote: 0xda917a494d06c412 expref: 6 pid: 15782 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366745.848128:0:14357:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96388148e800/0x8da3486b955f4465 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.23@tcp remote: 0xda917a494d06c412 expref: 6 pid: 15782 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366745.848143:0:14357:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff96389a30f300) 00010000:00010000:3.0:1789366745.848146:0:14357:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9638c142ca00/0x8da3486b955f44ff lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366745.848153:0:14357:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9638c142ca00/0x8da3486b955f44ff lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 15782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366745.848158:0:14357:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9638c142ca00/0x8da3486b955f44ff lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 15782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366745.848182:0:14357:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789366745.848330:0:14357:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638bfefa300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0702386f-5a7a-4c7b-a250-794778d6bd7f+5:2354:x1876286751486592:12345-192.168.202.23@tcp:103:ldlm_bl.0 Request processed in 258us (648us total) trans 0 rc 0/0 00000100:00100000:3.0:1789366745.848336:0:14357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 9 00010000:00010000:1.0:1789366745.848392:0:15782:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9638c142ca00/0x8da3486b955f44ff lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366745.848400:0:15782:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9638c142ca00/0x8da3486b955f44ff lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366745.848423:0:15782:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9638c142da00/0x8da3486b955f4506 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366745.848433:0:15782:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9638c142da00/0x8da3486b955f4506 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366745.848454:0:15782:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9638c142da00/0x8da3486b955f4506 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15782 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789366745.850502:0:15782:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00010000:00010000:1.0:1789366745.850520:0:15782:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9638c142ca00/0x8da3486b955f44ff lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366745.850528:0:15782:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9638c142ca00/0x8da3486b955f44ff lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366745.850535:0:15782:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9638c142ca00/0x8da3486b955f44ff lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366745.850540:0:15782:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9638c142ca00 already unused, calling callback (ffffffffc20ee4f0) 00010000:00010000:1.0:1789366745.850545:0:15782:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9638c142ca00/0x8da3486b955f44ff lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366745.850552:0:15782:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9638c142ca00/0x8da3486b955f44ff lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366745.850565:0:15782:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff96389a30f300) 00010000:00010000:1.0:1789366745.850569:0:15782:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789366745.850573:0:15782:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9638c142ca00/0x8da3486b955f44ff lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366745.850579:0:15782:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9638c142ca00/0x8da3486b955f44ff lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15782 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789366745.850597:0:15782:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000af560307 reply state 00000000885f758f transno 8589934594 ns: mdt-lustre-MDT0000_UUID lock: ffff9638c142da00/0x8da3486b955f4506 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15782 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789366745.850618:0:15782:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1789366745.850948:0:15782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638bfef8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5e91e95c-c49d-475c-a425-33e1a73fefb4+10:14407:x1876286751486464:12345-192.168.202.23@tcp:36:lfs.0 Request processed in 6301us (8016us total) trans 8589934594 rc 0/0 00000100:00100000:1.0:1789366745.850955:0:15782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 18 00010000:00010000:3.0:1789366745.852265:0:3270:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9638c142da00/0x8da3486b955f4506 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366745.852276:0:3270:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9638c142da00/0x8da3486b955f4506 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366745.852296:0:3270:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9638c142da00/0x8da3486b955f4506 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366745.852303:0:3270:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9638c142da00 already unused, calling callback (ffffffffc20ee4f0) 00010000:00010000:3.0:1789366745.852307:0:3270:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9638c142da00/0x8da3486b955f4506 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366745.852315:0:3270:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9638c142da00/0x8da3486b955f4506 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366745.852328:0:3270:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff96389a5eca00) 00010000:00010000:3.0:1789366745.852330:0:3270:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789366745.852334:0:3270:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9638c142da00/0x8da3486b955f4506 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366745.852340:0:3270:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9638c142da00/0x8da3486b955f4506 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15782 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789366745.893638:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:3.0:1789366745.893687:0:14370:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751486720 00000100:00100000:3.0:1789366745.893696:0:14370:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751486720 00000100:00100000:3.0:1789366745.893772:0:14370:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 19 00000100:00100000:3.0:1789366745.893784:0:14370:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638bfefb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5e91e95c-c49d-475c-a425-33e1a73fefb4+9:14415:x1876286751486720:12345-192.168.202.23@tcp:101:lctl.0 00010000:00010000:3.0:1789366745.893808:0:14370:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789366745.893832:0:14370:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96388148e800/0x8da3486b955f450d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xda917a494d06c43c expref: -99 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366745.893912:0:14370:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96388148f800/0x8da3486b955f4514 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366745.893940:0:14370:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96388148f800/0x8da3486b955f4514 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366745.893951:0:14370:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96388148f800/0x8da3486b955f4514 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789366745.893986:0:14370:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1789366745.893990:0:14370:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1789366745.894027:0:14370:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff96388148f800/0x8da3486b955f4514 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366745.894053:0:14370:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96388148e800/0x8da3486b955f450d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.23@tcp remote: 0xda917a494d06c43c expref: 11 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366745.894073:0:14370:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96388148f800/0x8da3486b955f4514 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.23@tcp remote: 0xda917a494d06c43c expref: 10 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366745.894081:0:14370:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff96389a30f600) 00010000:00010000:3.0:1789366745.894084:0:14370:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789366745.894087:0:14370:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96388148f800, rc 0) 00000100:00100000:3.0:1789366745.894139:0:14370:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638bfefb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5e91e95c-c49d-475c-a425-33e1a73fefb4+10:14415:x1876286751486720:12345-192.168.202.23@tcp:101:lctl.0 Request processed in 359us (512us total) trans 0 rc 0/0 00000100:00100000:3.0:1789366745.894145:0:14370:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 19 00000100:00100000:2.0:1789366745.911084:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:3.0:1789366745.911160:0:14371:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751486848 00000100:00100000:3.0:1789366745.911170:0:14371:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751486848 00000100:00100000:3.0:1789366745.911235:0:14371:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 20 00000100:00100000:3.0:1789366745.911247:0:14371:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638bfef8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0702386f-5a7a-4c7b-a250-794778d6bd7f+5:14416:x1876286751486848:12345-192.168.202.23@tcp:101:lfs.0 00010000:00010000:3.0:1789366745.911267:0:14371:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789366745.911295:0:14371:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96388148e800/0x8da3486b955f451b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xda917a494d06c443 expref: -99 pid: 14371 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366745.911380:0:14371:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96388148f600/0x8da3486b955f4522 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14371 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366745.911395:0:14371:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96388148f600/0x8da3486b955f4522 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14371 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366745.911419:0:14371:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96388148f600/0x8da3486b955f4522 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14371 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789366745.911459:0:14371:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1789366745.911463:0:14371:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1789366745.911485:0:14371:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff96388148f600/0x8da3486b955f4522 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14371 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366745.911509:0:14371:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96388148e800/0x8da3486b955f451b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.23@tcp remote: 0xda917a494d06c443 expref: 7 pid: 14371 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366745.911527:0:14371:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96388148f600/0x8da3486b955f4522 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.23@tcp remote: 0xda917a494d06c443 expref: 6 pid: 14371 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366745.911535:0:14371:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff96389a30f600) 00010000:00010000:3.0:1789366745.911538:0:14371:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789366745.911542:0:14371:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96388148f600, rc 0) 00000100:00100000:3.0:1789366745.911611:0:14371:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638bfef8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0702386f-5a7a-4c7b-a250-794778d6bd7f+6:14416:x1876286751486848:12345-192.168.202.23@tcp:101:lfs.0 Request processed in 366us (535us total) trans 0 rc 0/0 00000100:00100000:3.0:1789366745.911618:0:14371:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 20 00000100:00100000:2.0:1789366745.914307:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:0.0:1789366745.914432:0:14372:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751486976 00000100:00100000:0.0:1789366745.914441:0:14372:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751486976 00000100:00100000:0.0:1789366745.914500:0:14372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 21 00000100:00100000:0.0:1789366745.914511:0:14372:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638bfefb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0702386f-5a7a-4c7b-a250-794778d6bd7f+6:14416:x1876286751486976:12345-192.168.202.23@tcp:101:lfs.0 00010000:00010000:0.0:1789366745.914531:0:14372:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789366745.914550:0:14372:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720c600/0x8da3486b955f4529 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xda917a494d06c44a expref: -99 pid: 14372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366745.914628:0:14372:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720cc00/0x8da3486b955f4530 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14372 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366745.914641:0:14372:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720cc00/0x8da3486b955f4530 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14372 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366745.914651:0:14372:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720cc00/0x8da3486b955f4530 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14372 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366745.914664:0:14372:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720d200/0x8da3486b955f4537 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14372 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366745.914670:0:14372:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720d200/0x8da3486b955f4537 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14372 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366745.914675:0:14372:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720d200/0x8da3486b955f4537 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14372 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366745.914817:0:14372:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720de00/0x8da3486b955f453e lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14372 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366745.914837:0:14372:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720de00/0x8da3486b955f453e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14372 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366745.914844:0:14372:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720de00/0x8da3486b955f453e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14372 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789366745.914872:0:14372:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1789366745.914876:0:14372:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1789366745.914907:0:14372:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720de00/0x8da3486b955f453e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14372 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366745.914919:0:14372:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720cc00/0x8da3486b955f4530 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14372 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366745.914925:0:14372:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720cc00/0x8da3486b955f4530 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14372 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366745.914931:0:14372:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720cc00/0x8da3486b955f4530 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14372 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366745.914936:0:14372:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9638b720cc00 already unused, calling callback (ffffffffc20ee4f0) 00010000:00010000:0.0:1789366745.914940:0:14372:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720cc00/0x8da3486b955f4530 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14372 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366745.914947:0:14372:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720cc00/0x8da3486b955f4530 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14372 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366745.914957:0:14372:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff96389a30f600) 00010000:00010000:0.0:1789366745.914959:0:14372:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789366745.914964:0:14372:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720cc00/0x8da3486b955f4530 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14372 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366745.914979:0:14372:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720cc00/0x8da3486b955f4530 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14372 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366745.914991:0:14372:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720d200/0x8da3486b955f4537 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14372 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366745.914997:0:14372:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720d200/0x8da3486b955f4537 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14372 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366745.915003:0:14372:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720d200/0x8da3486b955f4537 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14372 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366745.915008:0:14372:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9638b720d200 already unused, calling callback (ffffffffc20ee4f0) 00010000:00010000:0.0:1789366745.915011:0:14372:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720d200/0x8da3486b955f4537 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14372 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366745.915016:0:14372:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720d200/0x8da3486b955f4537 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14372 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366745.915022:0:14372:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff963890797500) 00010000:00010000:0.0:1789366745.915024:0:14372:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789366745.915027:0:14372:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720d200/0x8da3486b955f4537 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14372 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366745.915032:0:14372:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720d200/0x8da3486b955f4537 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14372 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366745.915058:0:14372:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720c600/0x8da3486b955f4529 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.23@tcp remote: 0xda917a494d06c44a expref: 8 pid: 14372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366745.915081:0:14372:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720de00/0x8da3486b955f453e lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.23@tcp remote: 0xda917a494d06c44a expref: 7 pid: 14372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366745.915087:0:14372:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff963890797700) 00010000:00010000:0.0:1789366745.915089:0:14372:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789366745.915092:0:14372:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9638b720de00, rc 0) 00000100:00100000:0.0:1789366745.915161:0:14372:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638bfefb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0702386f-5a7a-4c7b-a250-794778d6bd7f+7:14416:x1876286751486976:12345-192.168.202.23@tcp:101:lfs.0 Request processed in 652us (862us total) trans 0 rc 0/0 00000100:00100000:0.0:1789366745.915169:0:14372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 21 00000100:00100000:2.0:1789366745.920882:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:1.0:1789366745.920931:0:15782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751487232 00000100:00100000:1.0:1789366745.920941:0:15782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751487232 00000100:00100000:1.0:1789366745.920997:0:15782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 22 00000100:00100000:1.0:1789366745.921007:0:15782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638bfef9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0702386f-5a7a-4c7b-a250-794778d6bd7f+7:14416:x1876286751487232:12345-192.168.202.23@tcp:101:lfs.0 00010000:00010000:1.0:1789366745.921028:0:15782:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789366745.921047:0:15782:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9638c142ca00/0x8da3486b955f4545 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xda917a494d06c451 expref: -99 pid: 15782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789366745.921241:0:15782:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00010000:00010000:1.0:1789366745.921680:0:15782:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9638c142ca00/0x8da3486b955f4545 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.23@tcp remote: 0xda917a494d06c451 expref: 9 pid: 15782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366745.921695:0:15782:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff96389a30f600) 00010000:00010000:1.0:1789366745.921697:0:15782:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1789366745.921702:0:15782:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9638c142ca00/0x8da3486b955f4545 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.23@tcp remote: 0xda917a494d06c451 expref: 9 pid: 15782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366745.921715:0:15782:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9638c142ca00, rc 0) 00000100:00100000:1.0:1789366745.921807:0:15782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638bfef9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0702386f-5a7a-4c7b-a250-794778d6bd7f+8:14416:x1876286751487232:12345-192.168.202.23@tcp:101:lfs.0 Request processed in 801us (932us total) trans 8589934595 rc 301/301 00000100:00100000:1.0:1789366745.921815:0:15782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 22 00000100:00100000:2.0:1789366745.927795:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:3.0:1789366745.927851:0:14370:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751487488 00000100:00100000:3.0:1789366745.927871:0:14370:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751487488 00000100:00100000:3.0:1789366745.927919:0:14370:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 23 00000100:00100000:3.0:1789366745.927944:0:14370:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638bfefaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0702386f-5a7a-4c7b-a250-794778d6bd7f+8:14416:x1876286751487488:12345-192.168.202.23@tcp:36:lfs.0 00010000:00010000:3.0:1789366745.927996:0:14370:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789366745.928020:0:14370:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720de00/0x8da3486b955f453e lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.23@tcp remote: 0xda917a494d06c44a expref: 8 pid: 14372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366745.928038:0:14370:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff963890797700) 00010000:00010000:3.0:1789366745.928048:0:14370:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789366745.928070:0:14370:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff96388148e800/0x8da3486b955f4553 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366745.928083:0:14370:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96388148e800/0x8da3486b955f4553 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366745.928092:0:14370:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96388148e800/0x8da3486b955f4553 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789366745.928497:0:14370:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000bfff3ecd reply state 00000000334e8d3f transno 8589934596 ns: mdt-lustre-MDT0000_UUID lock: ffff96388148e800/0x8da3486b955f4553 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789366745.928507:0:14370:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1789366745.928515:0:14370:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00000100:00100000:3.0:1789366745.928583:0:14370:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638bfefaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0702386f-5a7a-4c7b-a250-794778d6bd7f+9:14416:x1876286751487488:12345-192.168.202.23@tcp:36:lfs.0 Request processed in 656us (876us total) trans 8589934596 rc 0/0 00000100:00100000:3.0:1789366745.928590:0:14370:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 23 00010000:00010000:1.0:1789366745.930652:0:3271:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff96388148e800/0x8da3486b955f4553 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789366745.930906:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:3.0:1789366745.930970:0:14374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751487744 00000100:00100000:3.0:1789366745.930978:0:14374:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751487744 00000100:00100000:3.0:1789366745.931021:0:14374:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 2 00000100:00100000:3.0:1789366745.931068:0:14374:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638bfef8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0702386f-5a7a-4c7b-a250-794778d6bd7f+9:14416:x1876286751487744:12345-192.168.202.23@tcp:35:lfs.0 00010000:00010000:1.0:1789366745.931349:0:3271:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96388148e800/0x8da3486b955f4553 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366745.931357:0:3271:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96388148e800/0x8da3486b955f4553 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366745.931362:0:3271:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96388148e800 already unused, calling callback (ffffffffc20ee4f0) 00010000:00010000:1.0:1789366745.931376:0:3271:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96388148e800/0x8da3486b955f4553 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366745.931383:0:3271:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96388148e800/0x8da3486b955f4553 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366745.931397:0:3271:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff96389a30f100) 00010000:00010000:1.0:1789366745.931400:0:3271:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00010000:00010000:1.0:1789366745.931404:0:3271:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96388148e800/0x8da3486b955f4553 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366745.931410:0:3271:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96388148e800/0x8da3486b955f4553 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789366745.931505:0:14374:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638bfef8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0702386f-5a7a-4c7b-a250-794778d6bd7f+9:14416:x1876286751487744:12345-192.168.202.23@tcp:35:lfs.0 Request processed in 475us (602us total) trans 8589934597 rc 0/0 00000100:00100000:3.0:1789366745.931514:0:14374:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 2 00000100:00100000:2.0:1789366745.934339:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:3.0:1789366745.934414:0:14371:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751488000 00000100:00100000:3.0:1789366745.934422:0:14371:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751488000 00000100:00100000:3.0:1789366745.934475:0:14371:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 24 00000100:00100000:3.0:1789366745.934485:0:14371:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638aef23800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0702386f-5a7a-4c7b-a250-794778d6bd7f+9:14416:x1876286751488000:12345-192.168.202.23@tcp:101:lfs.0 00010000:00010000:3.0:1789366745.934506:0:14371:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789366745.934523:0:14371:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96388148e000/0x8da3486b955f455a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xda917a494d06c458 expref: -99 pid: 14371 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366745.934586:0:14371:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96388148e200/0x8da3486b955f4561 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14371 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366745.934600:0:14371:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96388148e200/0x8da3486b955f4561 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14371 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366745.934612:0:14371:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96388148e200/0x8da3486b955f4561 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14371 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366745.934627:0:14371:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96388148f000/0x8da3486b955f4568 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14371 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366745.934634:0:14371:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96388148f000/0x8da3486b955f4568 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14371 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366745.934640:0:14371:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96388148f000/0x8da3486b955f4568 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14371 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789366745.934776:0:14371:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00010000:00010000:3.0:1789366745.934864:0:14371:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96388148e200/0x8da3486b955f4561 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14371 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366745.934872:0:14371:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96388148e200/0x8da3486b955f4561 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14371 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366745.934879:0:14371:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96388148e200/0x8da3486b955f4561 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14371 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366745.934885:0:14371:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96388148e200 already unused, calling callback (ffffffffc20ee4f0) 00010000:00010000:3.0:1789366745.934889:0:14371:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96388148e200/0x8da3486b955f4561 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14371 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366745.934897:0:14371:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96388148e200/0x8da3486b955f4561 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14371 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366745.934909:0:14371:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff96389a30f600) 00010000:00010000:3.0:1789366745.934912:0:14371:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789366745.934916:0:14371:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96388148e200/0x8da3486b955f4561 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14371 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366745.935381:0:14371:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96388148e200/0x8da3486b955f4561 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14371 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366745.935399:0:14371:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96388148f000/0x8da3486b955f4568 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14371 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366745.935405:0:14371:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96388148f000/0x8da3486b955f4568 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14371 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366745.935412:0:14371:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96388148f000/0x8da3486b955f4568 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14371 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366745.935428:0:14371:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96388148f000 already unused, calling callback (ffffffffc20ee4f0) 00010000:00010000:3.0:1789366745.935431:0:14371:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96388148f000/0x8da3486b955f4568 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14371 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366745.935438:0:14371:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96388148f000/0x8da3486b955f4568 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14371 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366745.935446:0:14371:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff96389a30f300) 00010000:00010000:3.0:1789366745.935449:0:14371:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789366745.935452:0:14371:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96388148f000/0x8da3486b955f4568 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14371 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366745.935458:0:14371:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96388148f000/0x8da3486b955f4568 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14371 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366745.935495:0:14371:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96388148e000/0x8da3486b955f455a lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.23@tcp remote: 0xda917a494d06c458 expref: 11 pid: 14371 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366745.935506:0:14371:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff96389a30f600) 00010000:00010000:3.0:1789366745.935508:0:14371:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789366745.935512:0:14371:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96388148e000/0x8da3486b955f455a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.23@tcp remote: 0xda917a494d06c458 expref: 11 pid: 14371 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366745.935522:0:14371:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96388148e000, rc 0) 00000100:00100000:3.0:1789366745.935622:0:14371:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638aef23800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0702386f-5a7a-4c7b-a250-794778d6bd7f+10:14416:x1876286751488000:12345-192.168.202.23@tcp:101:lfs.0 Request processed in 1138us (1290us total) trans 8589934598 rc 301/301 00000100:00100000:3.0:1789366745.935630:0:14371:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 24 00000100:00100000:2.0:1789366745.937897:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:0.0:1789366745.937959:0:14372:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751488128 00000100:00100000:0.0:1789366745.937966:0:14372:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751488128 00000100:00100000:0.0:1789366745.938007:0:14372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 25 00000100:00100000:0.0:1789366745.938017:0:14372:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638aef22a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0702386f-5a7a-4c7b-a250-794778d6bd7f+10:14416:x1876286751488128:12345-192.168.202.23@tcp:101:lfs.0 00010000:00010000:0.0:1789366745.938049:0:14372:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789366745.938066:0:14372:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720c600/0x8da3486b955f4576 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xda917a494d06c45f expref: -99 pid: 14372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366745.938136:0:14372:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720d200/0x8da3486b955f457d lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14372 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366745.938150:0:14372:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720d200/0x8da3486b955f457d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14372 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366745.938158:0:14372:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720d200/0x8da3486b955f457d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14372 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789366745.938177:0:14372:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1789366745.938189:0:14372:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1789366745.938204:0:14372:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720d200/0x8da3486b955f457d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14372 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366745.938222:0:14372:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720c600/0x8da3486b955f4576 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.23@tcp remote: 0xda917a494d06c45f expref: 12 pid: 14372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366745.938244:0:14372:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720d200/0x8da3486b955f457d lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.23@tcp remote: 0xda917a494d06c45f expref: 11 pid: 14372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366745.938252:0:14372:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff963890797500) 00010000:00010000:0.0:1789366745.938255:0:14372:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789366745.938258:0:14372:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9638b720d200, rc 0) 00000100:00100000:0.0:1789366745.938309:0:14372:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638aef22a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0702386f-5a7a-4c7b-a250-794778d6bd7f+11:14416:x1876286751488128:12345-192.168.202.23@tcp:101:lfs.0 Request processed in 292us (417us total) trans 0 rc 0/0 00000100:00100000:0.0:1789366745.938326:0:14372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 25 00000100:00100000:2.0:1789366745.940898:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:0.0:1789366745.941271:0:14373:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751488256 00000100:00100000:0.0:1789366745.941281:0:14373:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751488256 00000100:00100000:0.0:1789366745.941343:0:14373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 3 00000100:00100000:0.0:1789366745.941351:0:14373:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638aef22d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0702386f-5a7a-4c7b-a250-794778d6bd7f+11:14416:x1876286751488256:12345-192.168.202.23@tcp:37:lfs.0 00000100:00100000:0.0:1789366745.944291:0:14373:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638aef22d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0702386f-5a7a-4c7b-a250-794778d6bd7f+11:14416:x1876286751488256:12345-192.168.202.23@tcp:37:lfs.0 Request processed in 2930us (3389us total) trans 0 rc 0/0 00000100:00100000:0.0:1789366745.944306:0:14373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 3 00000100:00100000:1.0:1789366745.948667:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:3.0:1789366745.948764:0:14374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751488512 00000100:00100000:3.0:1789366745.948786:0:14374:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751488512 00000100:00100000:3.0:1789366745.948841:0:14374:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 4 00000100:00100000:3.0:1789366745.948850:0:14374:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963887005050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0702386f-5a7a-4c7b-a250-794778d6bd7f+11:14416:x1876286751488512:12345-192.168.202.23@tcp:35:lfs.0 00000100:00100000:3.0:1789366745.949052:0:14374:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963887005050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0702386f-5a7a-4c7b-a250-794778d6bd7f+12:14416:x1876286751488512:12345-192.168.202.23@tcp:35:lfs.0 Request processed in 203us (395us total) trans 8589934599 rc 0/0 00000100:00100000:3.0:1789366745.949060:0:14374:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 4 00000100:00100000:2.0:1789366745.999841:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:1.0:1789366745.999934:0:15782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751488640 00000100:00100000:1.0:1789366745.999944:0:15782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751488640 00000100:00100000:1.0:1789366746.000040:0:15782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 26 00000100:00100000:1.0:1789366746.000051:0:15782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638aef21500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5e91e95c-c49d-475c-a425-33e1a73fefb4+10:14422:x1876286751488640:12345-192.168.202.23@tcp:101:bash.0 00010000:00010000:1.0:1789366746.000070:0:15782:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789366746.000090:0:15782:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9638c142d800/0x8da3486b955f4584 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xda917a494d06c466 expref: -99 pid: 15782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366746.000183:0:15782:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9638c142de00/0x8da3486b955f458b lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 15782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366746.000198:0:15782:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9638c142de00/0x8da3486b955f458b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366746.000210:0:15782:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9638c142de00/0x8da3486b955f458b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 15782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366746.000225:0:15782:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9638c142d400/0x8da3486b955f4592 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366746.000232:0:15782:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9638c142d400/0x8da3486b955f4592 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366746.000239:0:15782:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9638c142d400/0x8da3486b955f4592 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366746.000349:0:15782:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9638c142c800/0x8da3486b955f4599 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366746.000358:0:15782:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9638c142c800/0x8da3486b955f4599 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366746.000376:0:15782:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9638c142c800/0x8da3486b955f4599 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15782 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789366746.000404:0:15782:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00000004:00200000:1.0:1789366746.000407:0:15782:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1789366746.000445:0:15782:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9638c142c800/0x8da3486b955f4599 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366746.000467:0:15782:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9638c142de00/0x8da3486b955f458b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366746.000473:0:15782:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9638c142de00/0x8da3486b955f458b lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 15782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366746.000481:0:15782:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9638c142de00/0x8da3486b955f458b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 15782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366746.000487:0:15782:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9638c142de00 already unused, calling callback (ffffffffc20ee4f0) 00010000:00010000:1.0:1789366746.000492:0:15782:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9638c142de00/0x8da3486b955f458b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 15782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366746.000500:0:15782:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9638c142de00/0x8da3486b955f458b lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 15782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366746.000512:0:15782:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff96389a30f600) 00010000:00010000:1.0:1789366746.000516:0:15782:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789366746.000522:0:15782:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9638c142de00/0x8da3486b955f458b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 15782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366746.000528:0:15782:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9638c142de00/0x8da3486b955f458b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 15782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366746.000541:0:15782:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9638c142d400/0x8da3486b955f4592 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366746.000547:0:15782:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9638c142d400/0x8da3486b955f4592 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366746.000553:0:15782:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9638c142d400/0x8da3486b955f4592 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366746.000564:0:15782:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9638c142d400 already unused, calling callback (ffffffffc20ee4f0) 00010000:00010000:1.0:1789366746.000567:0:15782:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9638c142d400/0x8da3486b955f4592 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366746.000574:0:15782:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9638c142d400/0x8da3486b955f4592 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366746.000582:0:15782:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff96389a5ec000) 00010000:00010000:1.0:1789366746.000585:0:15782:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789366746.000588:0:15782:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9638c142d400/0x8da3486b955f4592 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366746.000594:0:15782:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9638c142d400/0x8da3486b955f4592 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366746.000626:0:15782:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9638c142d800/0x8da3486b955f4584 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.23@tcp remote: 0xda917a494d06c466 expref: 12 pid: 15782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366746.000640:0:15782:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9638c142c800/0x8da3486b955f4599 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.23@tcp remote: 0xda917a494d06c466 expref: 11 pid: 15782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366746.000647:0:15782:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff963890797500) 00010000:00010000:1.0:1789366746.000649:0:15782:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1789366746.000651:0:15782:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9638c142c800, rc 0) 00000100:00100000:1.0:1789366746.000765:0:15782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638aef21500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5e91e95c-c49d-475c-a425-33e1a73fefb4+11:14422:x1876286751488640:12345-192.168.202.23@tcp:101:bash.0 Request processed in 668us (957us total) trans 0 rc 0/0 00000100:00100000:1.0:1789366746.000774:0:15782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 26 00000100:00100000:0.0:1789366746.011169:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:3.0:1789366746.011309:0:14370:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751488896 00000100:00100000:3.0:1789366746.011320:0:14370:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751488896 00000100:00100000:3.0:1789366746.011388:0:14370:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 27 00000100:00100000:3.0:1789366746.011399:0:14370:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96378749b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5e91e95c-c49d-475c-a425-33e1a73fefb4+11:14422:x1876286751488896:12345-192.168.202.23@tcp:101:bash.0 00010000:00010000:3.0:1789366746.011422:0:14370:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789366746.011443:0:14370:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96388148e000/0x8da3486b955f45a0 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xda917a494d06c46d expref: -99 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366746.011573:0:14370:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff96388148f000/0x8da3486b955f45a7 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366746.011589:0:14370:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720d200/0x8da3486b955f457d lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.23@tcp remote: 0xda917a494d06c45f expref: 11 pid: 14372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366746.011600:0:14370:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff96388148f000/0x8da3486b955f45a7 lrc: 4/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366746.011635:0:14370:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720d200/0x8da3486b955f457d lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.23@tcp remote: 0xda917a494d06c45f expref: 11 pid: 14372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366746.011649:0:14370:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720d200/0x8da3486b955f457d lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.23@tcp remote: 0xda917a494d06c45f expref: 11 pid: 14372 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789366746.011681:0:14370:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9638b6d54380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14370:1876286758807296:192.168.202.23@tcp:104: 00000100:00100000:3.0:1789366746.011824:0:14370:0:(client.c:2716:ptlrpc_set_wait()) set ffff9638bf0cd3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789366746.017813:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:0.0:1789366746.018105:0:14356:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751489024 00000100:00100000:0.0:1789366746.018116:0:14356:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751489024 00010000:00010000:0.0:1789366746.018162:0:14356:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720d200/0x8da3486b955f457d lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.23@tcp remote: 0xda917a494d06c45f expref: 12 pid: 14372 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789366746.018227:0:14356:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 10 00000100:00100000:0.0:1789366746.018238:0:14356:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638aef22680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0702386f-5a7a-4c7b-a250-794778d6bd7f+12:2354:x1876286751489024:12345-192.168.202.23@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789366746.018254:0:14356:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789366746.018261:0:14356:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720d200/0x8da3486b955f457d lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.23@tcp remote: 0xda917a494d06c45f expref: 12 pid: 14372 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366746.018274:0:14356:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720d200/0x8da3486b955f457d lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.23@tcp remote: 0xda917a494d06c45f expref: 12 pid: 14372 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366746.018309:0:14356:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff963890797500) 00010000:00010000:0.0:1789366746.018315:0:14356:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff96388148f000/0x8da3486b955f45a7 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366746.018325:0:14356:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff96388148f000/0x8da3486b955f45a7 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366746.018334:0:14356:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96388148f000/0x8da3486b955f45a7 lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366746.018354:0:14356:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789366746.018422:0:14356:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638aef22680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0702386f-5a7a-4c7b-a250-794778d6bd7f+12:2354:x1876286751489024:12345-192.168.202.23@tcp:103:ldlm_bl.0 Request processed in 185us (621us total) trans 0 rc 0/0 00000100:00100000:0.0:1789366746.018429:0:14356:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 10 00010000:00010000:3.0:1789366746.019269:0:14370:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720d200/0x8da3486b955f457d lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.23@tcp remote: 0xda917a494d06c45f expref: 11 pid: 14372 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789366746.019300:0:14370:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9638b6d54380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14370:1876286758807296:192.168.202.23@tcp:104: 00010000:00010000:3.0:1789366746.019323:0:14370:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff96388148f000/0x8da3486b955f45a7 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366746.019333:0:14370:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff96388148f000/0x8da3486b955f45a7 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366746.019339:0:14370:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96388148f000/0x8da3486b955f45a7 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366746.019397:0:14370:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff96388148e200/0x8da3486b955f45ae lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366746.019409:0:14370:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96388148e200/0x8da3486b955f45ae lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366746.019420:0:14370:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96388148e200/0x8da3486b955f45ae lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366746.020324:0:14370:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96388148fc00/0x8da3486b955f45b5 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366746.020336:0:14370:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96388148fc00/0x8da3486b955f45b5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366746.020354:0:14370:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96388148fc00/0x8da3486b955f45b5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789366746.020376:0:14370:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:3.0:1789366746.020405:0:14370:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff96388148f000/0x8da3486b955f45a7 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366746.020413:0:14370:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96388148f000/0x8da3486b955f45a7 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366746.020420:0:14370:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96388148f000/0x8da3486b955f45a7 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366746.020427:0:14370:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96388148f000 already unused, calling callback (ffffffffc20ee4f0) 00010000:00010000:3.0:1789366746.020432:0:14370:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96388148f000/0x8da3486b955f45a7 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366746.020440:0:14370:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96388148f000/0x8da3486b955f45a7 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366746.020452:0:14370:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff963890797500) 00010000:00010000:3.0:1789366746.020455:0:14370:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789366746.020459:0:14370:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96388148f000/0x8da3486b955f45a7 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366746.020466:0:14370:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96388148f000/0x8da3486b955f45a7 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789366746.020478:0:14370:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000e3731b84 reply state 000000008e4a0d88 transno 8589934600 ns: mdt-lustre-MDT0000_UUID lock: ffff96388148e200/0x8da3486b955f45ae lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789366746.020497:0:14370:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1789366746.020533:0:14370:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96388148e000/0x8da3486b955f45a0 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.23@tcp remote: 0xda917a494d06c46d expref: 14 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366746.020550:0:14370:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96388148fc00/0x8da3486b955f45b5 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.23@tcp remote: 0xda917a494d06c46d expref: 13 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366746.020558:0:14370:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff96389a30fb00) 00010000:00010000:3.0:1789366746.020560:0:14370:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 9 00010000:00010000:3.0:1789366746.020563:0:14370:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96388148fc00, rc 0) 00000100:00100000:3.0:1789366746.020630:0:14370:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96378749b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5e91e95c-c49d-475c-a425-33e1a73fefb4+14:14422:x1876286751488896:12345-192.168.202.23@tcp:101:bash.0 Request processed in 9232us (9470us total) trans 8589934600 rc 0/0 00000100:00100000:3.0:1789366746.020639:0:14370:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 27 00010000:00010000:3.0:1789366746.022876:0:3270:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff96388148e200/0x8da3486b955f45ae lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366746.022894:0:3270:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96388148e200/0x8da3486b955f45ae lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366746.022901:0:3270:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96388148e200/0x8da3486b955f45ae lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366746.022907:0:3270:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96388148e200 already unused, calling callback (ffffffffc20ee4f0) 00010000:00010000:3.0:1789366746.022912:0:3270:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96388148e200/0x8da3486b955f45ae lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366746.022920:0:3270:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96388148e200/0x8da3486b955f45ae lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366746.022954:0:3270:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff96389a30f300) 00010000:00010000:3.0:1789366746.022958:0:3270:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789366746.022963:0:3270:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96388148e200/0x8da3486b955f45ae lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366746.022970:0:3270:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96388148e200/0x8da3486b955f45ae lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789366746.036660:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:3.0:1789366746.036903:0:14371:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751489152 00000100:00100000:3.0:1789366746.036913:0:14371:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751489152 00000100:00100000:3.0:1789366746.036975:0:14371:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 28 00000100:00100000:3.0:1789366746.036985:0:14371:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638aef25c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5e91e95c-c49d-475c-a425-33e1a73fefb4+13:14422:x1876286751489152:12345-192.168.202.23@tcp:101:bash.0 00010000:00010000:3.0:1789366746.037008:0:14371:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789366746.037029:0:14371:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96388148e200/0x8da3486b955f45c3 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xda917a494d06c474 expref: -99 pid: 14371 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366746.037171:0:14371:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96388148e000/0x8da3486b955f45ca lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14371 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366746.037185:0:14371:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96388148e000/0x8da3486b955f45ca lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14371 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366746.037196:0:14371:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96388148e000/0x8da3486b955f45ca lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14371 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789366746.037232:0:14371:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:3.0:1789366746.037236:0:14371:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1789366746.037252:0:14371:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff96388148e000/0x8da3486b955f45ca lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14371 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366746.037273:0:14371:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96388148e000/0x8da3486b955f45ca lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14371 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366746.037297:0:14371:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96388148e200/0x8da3486b955f45c3 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.23@tcp remote: 0xda917a494d06c474 expref: 15 pid: 14371 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366746.037316:0:14371:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96388148e000/0x8da3486b955f45ca lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.23@tcp remote: 0xda917a494d06c474 expref: 14 pid: 14371 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366746.037324:0:14371:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff96389a30fb00) 00010000:00010000:3.0:1789366746.037327:0:14371:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789366746.037331:0:14371:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96388148e000, rc 0) 00000100:00100000:3.0:1789366746.039522:0:14371:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638aef25c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5e91e95c-c49d-475c-a425-33e1a73fefb4+14:14422:x1876286751489152:12345-192.168.202.23@tcp:101:bash.0 Request processed in 2527us (2861us total) trans 0 rc 0/0 00000100:00100000:3.0:1789366746.039535:0:14371:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 28 00000100:00100000:2.0:1789366746.047976:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:0.0:1789366746.048065:0:14373:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751489408 00000100:00100000:0.0:1789366746.048076:0:14373:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751489408 00000100:00100000:0.0:1789366746.048151:0:14373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 5 00000100:00100000:0.0:1789366746.048161:0:14373:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638aef21f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5e91e95c-c49d-475c-a425-33e1a73fefb4+14:14422:x1876286751489408:12345-192.168.202.23@tcp:35:bash.0 00000100:00100000:0.0:1789366746.048546:0:14373:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638aef21f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5e91e95c-c49d-475c-a425-33e1a73fefb4+15:14422:x1876286751489408:12345-192.168.202.23@tcp:35:bash.0 Request processed in 385us (582us total) trans 8589934601 rc 0/0 00000100:00100000:0.0:1789366746.048554:0:14373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 5 00000100:00100000:2.0:1789366746.105572:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:0.0:1789366746.105669:0:14372:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751489664 00000100:00100000:0.0:1789366746.105679:0:14372:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751489664 00000100:00100000:0.0:1789366746.105792:0:14372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 29 00000100:00100000:0.0:1789366746.105803:0:14372:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638aef23b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5e91e95c-c49d-475c-a425-33e1a73fefb4+15:14432:x1876286751489664:12345-192.168.202.23@tcp:101:lfs.0 00010000:00010000:0.0:1789366746.105828:0:14372:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789366746.105849:0:14372:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720c600/0x8da3486b955f45d1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xda917a494d06c47b expref: -99 pid: 14372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789366746.105939:0:14372:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00010000:00010000:0.0:1789366746.106054:0:14372:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720c600/0x8da3486b955f45d1 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.23@tcp remote: 0xda917a494d06c47b expref: 17 pid: 14372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366746.106070:0:14372:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff96389a30f600) 00010000:00010000:0.0:1789366746.106073:0:14372:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1789366746.106078:0:14372:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720c600/0x8da3486b955f45d1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.23@tcp remote: 0xda917a494d06c47b expref: 17 pid: 14372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366746.106092:0:14372:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9638b720c600, rc 0) 00000100:00100000:0.0:1789366746.106157:0:14372:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638aef23b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5e91e95c-c49d-475c-a425-33e1a73fefb4+16:14432:x1876286751489664:12345-192.168.202.23@tcp:101:lfs.0 Request processed in 355us (592us total) trans 8589934602 rc 301/301 00000100:00100000:0.0:1789366746.106165:0:14372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 29 00000100:00100000:1.0:1789366746.108910:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:3.0:1789366746.108984:0:14374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751489920 00000100:00100000:3.0:1789366746.108993:0:14374:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751489920 00000100:00100000:3.0:1789366746.109048:0:14374:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 6 00000100:00100000:3.0:1789366746.109058:0:14374:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638aef26d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5e91e95c-c49d-475c-a425-33e1a73fefb4+16:14432:x1876286751489920:12345-192.168.202.23@tcp:35:lfs.0 00000100:00100000:3.0:1789366746.109266:0:14374:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638aef26d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5e91e95c-c49d-475c-a425-33e1a73fefb4+17:14432:x1876286751489920:12345-192.168.202.23@tcp:35:lfs.0 Request processed in 208us (364us total) trans 8589934603 rc 0/0 00000100:00100000:3.0:1789366746.109274:0:14374:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 6 00000100:00100000:2.0:1789366746.150463:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:1.0:1789366746.151508:0:15782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751490176 00000100:00100000:1.0:1789366746.151519:0:15782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751490176 00000100:00100000:1.0:1789366746.151572:0:15782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 30 00000100:00100000:1.0:1789366746.151579:0:15782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638aef21880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5e91e95c-c49d-475c-a425-33e1a73fefb4+17:14435:x1876286751490176:12345-192.168.202.23@tcp:101:lfs.0 00010000:00010000:1.0:1789366746.151784:0:15782:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789366746.151802:0:15782:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9638c142d600/0x8da3486b955f45df lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xda917a494d06c482 expref: -99 pid: 15782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366746.151945:0:15782:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9638c142ce00/0x8da3486b955f45e6 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366746.151959:0:15782:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9638c142ce00/0x8da3486b955f45e6 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366746.151971:0:15782:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9638c142ce00/0x8da3486b955f45e6 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15782 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789366746.151984:0:15782:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:1.0:1789366746.152152:0:15782:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9638c142d600/0x8da3486b955f45df lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.23@tcp remote: 0xda917a494d06c482 expref: 20 pid: 15782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366746.152171:0:15782:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9638c142ce00/0x8da3486b955f45e6 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.23@tcp remote: 0xda917a494d06c482 expref: 19 pid: 15782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366746.152181:0:15782:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff96389a30fb00) 00010000:00010000:1.0:1789366746.152184:0:15782:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789366746.152188:0:15782:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9638c142ce00, rc 0) 00000100:00100000:1.0:1789366746.152254:0:15782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638aef21880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5e91e95c-c49d-475c-a425-33e1a73fefb4+19:14435:x1876286751490176:12345-192.168.202.23@tcp:101:lfs.0 Request processed in 675us (1805us total) trans 8589934604 rc 0/0 00000100:00100000:1.0:1789366746.152270:0:15782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 30 00000100:00100000:1.0:1789366746.158622:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:1.0:1789366746.158704:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:0.0:1789366746.158883:0:14357:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751490432 00000100:00100000:0.0:1789366746.158894:0:14357:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751490432 00000100:00100000:0.0:1789366746.158981:0:14357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 0 00000100:00100000:0.0:1789366746.158991:0:14357:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638aef27100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5e91e95c-c49d-475c-a425-33e1a73fefb4+19:2355:x1876286751490432:12345-192.168.202.23@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789366746.159009:0:14357:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789366746.159036:0:14357:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9638c142ce00/0x8da3486b955f45e6 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.23@tcp remote: 0xda917a494d06c482 expref: 19 pid: 15782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366746.159058:0:14357:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff96389a30fb00) 00010000:00010000:0.0:1789366746.159063:0:14357:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789366746.159132:0:14357:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638aef27100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5e91e95c-c49d-475c-a425-33e1a73fefb4+18:2355:x1876286751490432:12345-192.168.202.23@tcp:103:ldlm_bl.0 Request processed in 142us (427us total) trans 0 rc 0/0 00000100:00100000:0.0:1789366746.159141:0:14357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 0 00000100:00100000:3.0:1789366746.159329:0:14370:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751490304 00000100:00100000:3.0:1789366746.159335:0:14370:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751490304 00000100:00100000:3.0:1789366746.159418:0:14370:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 31 00000100:00100000:3.0:1789366746.159425:0:14370:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638aef26680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5e91e95c-c49d-475c-a425-33e1a73fefb4+18:14435:x1876286751490304:12345-192.168.202.23@tcp:54:lfs.0 00010000:00010000:3.0:1789366746.159494:0:14370:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96388148e200/0x8da3486b955f45f4 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366746.159511:0:14370:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96388148e200/0x8da3486b955f45f4 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366746.159522:0:14370:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96388148e200/0x8da3486b955f45f4 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366746.159550:0:14370:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96388148e200/0x8da3486b955f45f4 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366746.159559:0:14370:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96388148e200/0x8da3486b955f45f4 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366746.159566:0:14370:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96388148e200/0x8da3486b955f45f4 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366746.159572:0:14370:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96388148e200 already unused, calling callback (ffffffffc20ee4f0) 00010000:00010000:3.0:1789366746.159580:0:14370:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96388148e200/0x8da3486b955f45f4 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366746.159589:0:14370:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96388148e200/0x8da3486b955f45f4 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366746.159597:0:14370:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff96389a30fb00) 00010000:00010000:3.0:1789366746.159600:0:14370:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789366746.159604:0:14370:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96388148e200/0x8da3486b955f45f4 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366746.159610:0:14370:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96388148e200/0x8da3486b955f45f4 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789366746.159769:0:14370:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638aef26680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5e91e95c-c49d-475c-a425-33e1a73fefb4+18:14435:x1876286751490304:12345-192.168.202.23@tcp:54:lfs.0 Request processed in 343us (1159us total) trans 0 rc 0/0 00000100:00100000:3.0:1789366746.159776:0:14370:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 31 00000100:00100000:1.0:1789366746.163466:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:3.0:1789366746.165522:0:14374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751490688 00000100:00100000:3.0:1789366746.165537:0:14374:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751490688 00000100:00100000:3.0:1789366746.165607:0:14374:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 7 00000100:00100000:3.0:1789366746.165618:0:14374:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638aef25500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5e91e95c-c49d-475c-a425-33e1a73fefb4+18:14435:x1876286751490688:12345-192.168.202.23@tcp:35:lfs.0 00000100:00100000:3.0:1789366746.165899:0:14374:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638aef25500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5e91e95c-c49d-475c-a425-33e1a73fefb4+19:14435:x1876286751490688:12345-192.168.202.23@tcp:35:lfs.0 Request processed in 282us (2491us total) trans 8589934605 rc 0/0 00000100:00100000:3.0:1789366746.165908:0:14374:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 7 00010000:00010000:2.0:1789366746.295989:0:16242:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789366746.383040:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:3.0:1789366746.383131:0:14371:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751490944 00000100:00100000:3.0:1789366746.383140:0:14371:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751490944 00000100:00100000:3.0:1789366746.383200:0:14371:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 32 00000100:00100000:3.0:1789366746.383212:0:14371:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638aef27800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5e91e95c-c49d-475c-a425-33e1a73fefb4+19:14466:x1876286751490944:12345-192.168.202.23@tcp:101:cat.0 00010000:00010000:3.0:1789366746.383235:0:14371:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789366746.383255:0:14371:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96388148e200/0x8da3486b955f45fb lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xda917a494d06c489 expref: -99 pid: 14371 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366746.383349:0:14371:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96388148f000/0x8da3486b955f4602 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14371 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366746.383372:0:14371:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96388148f000/0x8da3486b955f4602 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14371 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366746.383384:0:14371:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96388148f000/0x8da3486b955f4602 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14371 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789366746.383414:0:14371:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:3.0:1789366746.383547:0:14371:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96388148e200/0x8da3486b955f45fb lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.23@tcp remote: 0xda917a494d06c489 expref: 22 pid: 14371 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366746.383568:0:14371:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96388148f000/0x8da3486b955f4602 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.23@tcp remote: 0xda917a494d06c489 expref: 21 pid: 14371 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366746.383577:0:14371:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff96389a30fb00) 00010000:00010000:3.0:1789366746.383579:0:14371:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789366746.383583:0:14371:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96388148f000, rc 0) 00000100:00100000:3.0:1789366746.383651:0:14371:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638aef27800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5e91e95c-c49d-475c-a425-33e1a73fefb4+21:14466:x1876286751490944:12345-192.168.202.23@tcp:101:cat.0 Request processed in 441us (619us total) trans 8589934606 rc 0/0 00000100:00100000:3.0:1789366746.383666:0:14371:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 32 00000100:00100000:1.0:1789366746.386711:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:1.0:1789366746.386783:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:3.0:1789366746.386873:0:14374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751491200 00000100:00100000:3.0:1789366746.386882:0:14374:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751491200 00000100:00100000:0.0:1789366746.386884:0:14355:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751491328 00000100:00100000:0.0:1789366746.386890:0:14355:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751491328 00000100:00100000:3.0:1789366746.386941:0:14374:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 8 00000100:00100000:0.0:1789366746.386954:0:14355:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 1 00000100:00100000:3.0:1789366746.386956:0:14374:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638aef24000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5e91e95c-c49d-475c-a425-33e1a73fefb4+22:14466:x1876286751491200:12345-192.168.202.23@tcp:35:cat.0 00000100:00100000:0.0:1789366746.386967:0:14355:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638af332680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5e91e95c-c49d-475c-a425-33e1a73fefb4+22:2355:x1876286751491328:12345-192.168.202.23@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789366746.386983:0:14355:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789366746.387323:0:14355:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96388148f000/0x8da3486b955f4602 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.23@tcp remote: 0xda917a494d06c489 expref: 23 pid: 14371 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789366746.387335:0:14374:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638aef24000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5e91e95c-c49d-475c-a425-33e1a73fefb4+23:14466:x1876286751491200:12345-192.168.202.23@tcp:35:cat.0 Request processed in 382us (629us total) trans 8589934607 rc 0/0 00010000:00010000:0.0:1789366746.387343:0:14355:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff96389a30fb00) 00000100:00100000:3.0:1789366746.387345:0:14374:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 8 00010000:00010000:0.0:1789366746.387352:0:14355:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789366746.387388:0:14355:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638af332680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5e91e95c-c49d-475c-a425-33e1a73fefb4+21:2355:x1876286751491328:12345-192.168.202.23@tcp:103:ldlm_bl.0 Request processed in 425us (603us total) trans 0 rc 0/0 00000100:00100000:0.0:1789366746.387394:0:14355:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 1 00000100:00100000:2.0:1789366746.438250:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:0.0:1789366746.438503:0:14372:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751491584 00000100:00100000:0.0:1789366746.438514:0:14372:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751491584 00000100:00100000:0.0:1789366746.438575:0:14372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 33 00000100:00100000:0.0:1789366746.438601:0:14372:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638aef20700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5e91e95c-c49d-475c-a425-33e1a73fefb4+21:14472:x1876286751491584:12345-192.168.202.23@tcp:101:dd.0 00010000:00010000:0.0:1789366746.438626:0:14372:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789366746.438647:0:14372:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720ca00/0x8da3486b955f4610 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xda917a494d06c490 expref: -99 pid: 14372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366746.438771:0:14372:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720d000/0x8da3486b955f4617 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14372 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366746.438786:0:14372:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff96388148fc00/0x8da3486b955f45b5 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.23@tcp remote: 0xda917a494d06c46d expref: 22 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366746.438794:0:14372:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff96388148e000/0x8da3486b955f45ca lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.23@tcp remote: 0xda917a494d06c474 expref: 22 pid: 14371 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366746.438803:0:14372:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720d000/0x8da3486b955f4617 lrc: 5/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14372 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366746.438839:0:14372:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff96388148e000/0x8da3486b955f45ca lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.23@tcp remote: 0xda917a494d06c474 expref: 22 pid: 14371 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366746.438852:0:14372:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff96388148e000/0x8da3486b955f45ca lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.23@tcp remote: 0xda917a494d06c474 expref: 22 pid: 14371 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789366746.438865:0:14372:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff963787499f80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14372:1876286758807424:192.168.202.23@tcp:104: 00010000:00010000:0.0:1789366746.439095:0:14372:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff96388148fc00/0x8da3486b955f45b5 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.23@tcp remote: 0xda917a494d06c46d expref: 22 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366746.439105:0:14372:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff96388148fc00/0x8da3486b955f45b5 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.23@tcp remote: 0xda917a494d06c46d expref: 22 pid: 14370 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789366746.439121:0:14372:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96378749ad80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14372:1876286758807552:192.168.202.23@tcp:104: 00000100:00100000:0.0:1789366746.439148:0:14372:0:(client.c:2716:ptlrpc_set_wait()) set ffff9638896409c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789366746.441509:0:14372:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96378749ad80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14372:1876286758807552:192.168.202.23@tcp:104: 00000100:00100000:0.0:1789366746.441524:0:14372:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff963787499f80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14372:1876286758807424:192.168.202.23@tcp:104: 00010000:00010000:0.0:1789366746.441549:0:14372:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720d000/0x8da3486b955f4617 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14372 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789366746.443015:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:2.0:1789366746.443054:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:1.0:1789366746.443234:0:14356:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751491712 00000100:00100000:1.0:1789366746.443243:0:14356:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751491712 00010000:00010000:1.0:1789366746.443275:0:14356:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff96388148fc00/0x8da3486b955f45b5 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.23@tcp remote: 0xda917a494d06c46d expref: 23 pid: 14370 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789366746.443347:0:14356:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751491840 00000100:00100000:1.0:1789366746.443352:0:14356:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751491840 00010000:00010000:1.0:1789366746.443375:0:14356:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff96388148e000/0x8da3486b955f45ca lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.23@tcp remote: 0xda917a494d06c474 expref: 24 pid: 14371 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789366746.443391:0:14356:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 11 00000100:00100000:1.0:1789366746.443399:0:14356:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638bf499450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5e91e95c-c49d-475c-a425-33e1a73fefb4+24:2355:x1876286751491712:12345-192.168.202.23@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789366746.443411:0:14356:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789366746.443418:0:14356:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff96388148fc00/0x8da3486b955f45b5 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.23@tcp remote: 0xda917a494d06c46d expref: 24 pid: 14370 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366746.443428:0:14356:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff96388148fc00/0x8da3486b955f45b5 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.23@tcp remote: 0xda917a494d06c46d expref: 24 pid: 14370 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366746.443447:0:14356:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96388148fc00/0x8da3486b955f45b5 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.23@tcp remote: 0xda917a494d06c46d expref: 24 pid: 14370 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366746.443476:0:14356:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff96389a30fb00) 00010000:00010000:1.0:1789366746.443481:0:14356:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720d000/0x8da3486b955f4617 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14372 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366746.443489:0:14356:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720d000/0x8da3486b955f4617 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14372 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366746.443495:0:14356:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789366746.443548:0:14356:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638bf499450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5e91e95c-c49d-475c-a425-33e1a73fefb4+23:2355:x1876286751491712:12345-192.168.202.23@tcp:103:ldlm_bl.0 Request processed in 149us (536us total) trans 0 rc 0/0 00000100:00100000:1.0:1789366746.443555:0:14356:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 11 00000100:00100000:1.0:1789366746.443596:0:14356:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 12 00000100:00100000:1.0:1789366746.443602:0:14356:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638aef20a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5e91e95c-c49d-475c-a425-33e1a73fefb4+22:2354:x1876286751491840:12345-192.168.202.23@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789366746.443609:0:14356:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789366746.443613:0:14356:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff96388148e000/0x8da3486b955f45ca lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.23@tcp remote: 0xda917a494d06c474 expref: 22 pid: 14371 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366746.443622:0:14356:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff96388148e000/0x8da3486b955f45ca lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.23@tcp remote: 0xda917a494d06c474 expref: 22 pid: 14371 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366746.443633:0:14356:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96388148e000/0x8da3486b955f45ca lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.23@tcp remote: 0xda917a494d06c474 expref: 22 pid: 14371 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366746.443644:0:14356:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff96389a30fb00) 00010000:00010000:1.0:1789366746.443648:0:14356:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720d000/0x8da3486b955f4617 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14372 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366746.443664:0:14356:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720d000/0x8da3486b955f4617 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 14372 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366746.443671:0:14356:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720d000/0x8da3486b955f4617 lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 14372 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366746.443696:0:14356:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789366746.443758:0:14356:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638aef20a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5e91e95c-c49d-475c-a425-33e1a73fefb4+21:2354:x1876286751491840:12345-192.168.202.23@tcp:103:ldlm_bl.0 Request processed in 155us (703us total) trans 0 rc 0/0 00000100:00100000:1.0:1789366746.443765:0:14356:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 12 00010000:00010000:1.0:1789366746.443786:0:14372:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720d000/0x8da3486b955f4617 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14372 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366746.443793:0:14372:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720d000/0x8da3486b955f4617 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14372 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789366746.443810:0:14372:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:1.0:1789366746.443978:0:14372:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720ca00/0x8da3486b955f4610 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.23@tcp remote: 0xda917a494d06c490 expref: 22 pid: 14372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366746.443994:0:14372:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720d000/0x8da3486b955f4617 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.23@tcp remote: 0xda917a494d06c490 expref: 21 pid: 14372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366746.444002:0:14372:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff96389a30fb00) 00010000:00010000:1.0:1789366746.444005:0:14372:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1789366746.444008:0:14372:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9638b720d000, rc 0) 00000100:00100000:1.0:1789366746.444033:0:14372:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638aef20700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5e91e95c-c49d-475c-a425-33e1a73fefb4+21:14472:x1876286751491584:12345-192.168.202.23@tcp:101:dd.0 Request processed in 5437us (5794us total) trans 8589934608 rc 0/0 00000100:00100000:1.0:1789366746.444049:0:14372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 33 00000100:00100000:1.0:1789366746.445819:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:3.0:1789366746.445919:0:14371:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751492096 00000100:00100000:3.0:1789366746.445928:0:14371:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751492096 00000100:00100000:3.0:1789366746.445989:0:14371:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 34 00000100:00100000:3.0:1789366746.445999:0:14371:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638af332680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5e91e95c-c49d-475c-a425-33e1a73fefb4+21:14472:x1876286751492096:12345-192.168.202.23@tcp:36:dd.0 00010000:00010000:3.0:1789366746.446218:0:14371:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff96388148e200/0x8da3486b955f4625 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14371 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366746.446242:0:14371:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96388148e200/0x8da3486b955f4625 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14371 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366746.446252:0:14371:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96388148e200/0x8da3486b955f4625 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14371 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789366746.446305:0:14371:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934609 00000004:00010000:3.0:1789366746.446342:0:14371:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000007202ae85 reply state 000000000ac94167 transno 8589934610 ns: mdt-lustre-MDT0000_UUID lock: ffff96388148e200/0x8da3486b955f4625 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14371 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789366746.446351:0:14371:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789366746.446437:0:14371:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638af332680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5e91e95c-c49d-475c-a425-33e1a73fefb4+24:14472:x1876286751492096:12345-192.168.202.23@tcp:36:dd.0 Request processed in 439us (622us total) trans 8589934610 rc 0/0 00000100:00100000:3.0:1789366746.446444:0:14371:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 34 00000020:00080000:3.0:1789366746.446448:0:14371:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1789366746.453612:0:3271:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff96388148e200/0x8da3486b955f4625 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14371 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789366746.453687:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00010000:00010000:1.0:1789366746.453698:0:3271:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96388148e200/0x8da3486b955f4625 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14371 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366746.453708:0:3271:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96388148e200/0x8da3486b955f4625 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14371 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366746.453715:0:3271:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96388148e200 already unused, calling callback (ffffffffc20ee4f0) 00010000:00010000:1.0:1789366746.453750:0:3271:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96388148e200/0x8da3486b955f4625 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14371 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366746.453760:0:3271:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96388148e200/0x8da3486b955f4625 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14371 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789366746.453768:0:14370:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751492224 00010000:00010000:1.0:1789366746.453778:0:3271:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff96389a30fb00) 00000100:00100000:0.0:1789366746.453780:0:14370:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751492224 00010000:00010000:1.0:1789366746.453786:0:3271:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789366746.453791:0:3271:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96388148e200/0x8da3486b955f4625 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14371 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366746.453806:0:3271:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96388148e200/0x8da3486b955f4625 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14371 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789366746.454431:0:14372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 35 00000100:00100000:2.0:1789366746.454446:0:14372:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638b6d54380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5e91e95c-c49d-475c-a425-33e1a73fefb4+23:14472:x1876286751492224:12345-192.168.202.23@tcp:101:dd.0 00010000:00010000:2.0:1789366746.454470:0:14372:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789366746.454490:0:14372:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9c00/0x8da3486b955f462c lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xda917a494d06c497 expref: -99 pid: 14372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366746.454561:0:14372:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9c00/0x8da3486b955f462c lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.23@tcp remote: 0xda917a494d06c497 expref: 24 pid: 14372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366746.454577:0:14372:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9c00/0x8da3486b955f462c lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.23@tcp remote: 0xda917a494d06c497 expref: 24 pid: 14372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366746.454611:0:14372:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff96389a30fb00) 00010000:00010000:2.0:1789366746.454614:0:14372:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789366746.454618:0:14372:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9638902c9c00, rc 0) 00000100:00100000:2.0:1789366746.454679:0:14372:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638b6d54380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5e91e95c-c49d-475c-a425-33e1a73fefb4+24:14472:x1876286751492224:12345-192.168.202.23@tcp:101:dd.0 Request processed in 237us (1000us total) trans 0 rc 0/0 00000100:00100000:2.0:1789366746.454687:0:14372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 35 00000100:00100000:2.0:1789366746.462816:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:1.0:1789366746.462884:0:14356:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751492480 00000100:00100000:1.0:1789366746.462962:0:14356:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751492480 00000100:00100000:1.0:1789366746.463081:0:14356:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 2 00000100:00100000:1.0:1789366746.463093:0:14356:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638aef23100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5e91e95c-c49d-475c-a425-33e1a73fefb4+24:14472:x1876286751492480:12345-192.168.202.23@tcp:103:dd.0 00010000:00010000:1.0:1789366746.463123:0:14356:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789366746.463148:0:14356:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9c00/0x8da3486b955f462c lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.23@tcp remote: 0xda917a494d06c497 expref: 24 pid: 14372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366746.463168:0:14356:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff96389a30fb00) 00010000:00010000:1.0:1789366746.463173:0:14356:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789366746.463234:0:14356:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638aef23100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5e91e95c-c49d-475c-a425-33e1a73fefb4+23:14472:x1876286751492480:12345-192.168.202.23@tcp:103:dd.0 Request processed in 144us (428us total) trans 0 rc 0/0 00000100:00100000:1.0:1789366746.463242:0:14356:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 2 00000100:00100000:1.0:1789366746.464540:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:3.0:1789366746.464595:0:15782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751492608 00000100:00100000:3.0:1789366746.464602:0:15782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751492608 00000100:00100000:3.0:1789366746.464654:0:15782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 36 00000100:00100000:3.0:1789366746.464664:0:15782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638af331880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5e91e95c-c49d-475c-a425-33e1a73fefb4+23:14472:x1876286751492608:12345-192.168.202.23@tcp:58:dd.0 00010000:00010000:3.0:1789366746.464769:0:15782:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff96388148e200/0x8da3486b955f4633 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366746.464785:0:15782:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96388148e200/0x8da3486b955f4633 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366746.464796:0:15782:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96388148e200/0x8da3486b955f4633 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15782 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1789366746.465506:0:15782:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789366746.465670:0:15782:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 64 off8320 00000040:00080000:3.0:1789366746.465780:0:15782:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xe:0x0].1, 136 off8328 00000100:00100000:3.0:1789366746.465879:0:15782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638af331880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5e91e95c-c49d-475c-a425-33e1a73fefb4+23:14472:x1876286751492608:12345-192.168.202.23@tcp:58:dd.0 Request processed in 1214us (1340us total) trans 0 rc 0/0 00000100:00100000:3.0:1789366746.465889:0:15782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 36 00000100:00100000:3.0:1789366746.468985:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:0.0:1789366746.469048:0:14370:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751492736 00000100:00100000:0.0:1789366746.469058:0:14370:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751492736 00000100:00100000:0.0:1789366746.469117:0:14370:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 37 00000100:00100000:0.0:1789366746.469126:0:14370:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638b6d57100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5e91e95c-c49d-475c-a425-33e1a73fefb4+23:14472:x1876286751492736:12345-192.168.202.23@tcp:101:dd.0 00010000:00010000:0.0:1789366746.469145:0:14370:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789366746.469165:0:14370:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720ca00/0x8da3486b955f463a lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xda917a494d06c49e expref: -99 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366746.469219:0:14370:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff96388148e200/0x8da3486b955f4633 lrc: 2/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366746.469229:0:14370:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720ca00/0x8da3486b955f463a lrc: 4/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.23@tcp remote: 0xda917a494d06c49e expref: 24 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366746.469248:0:14370:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff96388148e200/0x8da3486b955f4633 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 15782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366746.469277:0:14370:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720ca00/0x8da3486b955f463a lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.23@tcp remote: 0xda917a494d06c49e expref: 24 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366746.469291:0:14370:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff96389a30fb00) 00010000:00010000:0.0:1789366746.469294:0:14370:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1789366746.469299:0:14370:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720ca00/0x8da3486b955f463a lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.23@tcp remote: 0xda917a494d06c49e expref: 24 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366746.469305:0:14370:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9638b720ca00, rc 0) 00000100:00100000:0.0:1789366746.469357:0:14370:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638b6d57100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5e91e95c-c49d-475c-a425-33e1a73fefb4+24:14472:x1876286751492736:12345-192.168.202.23@tcp:101:dd.0 Request processed in 232us (380us total) trans 0 rc 0/0 00000100:00100000:0.0:1789366746.469377:0:14370:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 37 00000040:00080000:3.0:1789366746.488314:0:14406:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1789366746.488324:0:14406:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1789366746.488403:0:14406:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:3.0:1789366746.488412:0:14406:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:3.0:1789366746.488533:0:14406:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9638b6d54e00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:14406:1876286758807680:192.168.202.23@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1789366746.488642:0:14406:0:(client.c:2716:ptlrpc_set_wait()) set ffff96388524b780 going to sleep for 11 seconds 00000100:00100000:2.0:1789366746.494824:0:14406:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9638b6d54e00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:14406:1876286758807680:192.168.202.23@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1789366746.495185:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:0.0:1789366746.495283:0:14381:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751492864 00000100:00100000:0.0:1789366746.495291:0:14381:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751492864 00000100:00100000:0.0:1789366746.495345:0:14381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 0 00000100:00100000:0.0:1789366746.495355:0:14381:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638af333b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:5e91e95c-c49d-475c-a425-33e1a73fefb4+24:14474:x1876286751492864:12345-192.168.202.23@tcp:900:lhsmtool_posix.0 00000100:00100000:0.0:1789366746.495443:0:14381:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638af333b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:5e91e95c-c49d-475c-a425-33e1a73fefb4+24:14474:x1876286751492864:12345-192.168.202.23@tcp:900:lhsmtool_posix.0 Request processed in 90us (260us total) trans 0 rc 0/0 00000100:00100000:0.0:1789366746.495451:0:14381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 0 00000100:00100000:3.0:1789366746.497856:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:1.0:1789366746.497924:0:15782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751492992 00000100:00100000:1.0:1789366746.497934:0:15782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751492992 00000100:00100000:1.0:1789366746.497992:0:15782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 38 00000100:00100000:1.0:1789366746.498002:0:15782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638b6d54e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5e91e95c-c49d-475c-a425-33e1a73fefb4+24:14474:x1876286751492992:12345-192.168.202.23@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1789366746.498031:0:15782:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1789366746.498308:0:15782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638b6d54e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5e91e95c-c49d-475c-a425-33e1a73fefb4+24:14474:x1876286751492992:12345-192.168.202.23@tcp:53:lhsmtool_posix.0 Request processed in 306us (459us total) trans 0 rc 0/0 00000100:00100000:1.0:1789366746.498317:0:15782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 38 00000100:00100000:2.0:1789366746.502261:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:1.0:1789366746.502489:0:14372:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751493120 00000100:00100000:1.0:1789366746.502499:0:14372:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751493120 00000100:00100000:1.0:1789366746.502556:0:14372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 39 00000100:00100000:1.0:1789366746.502569:0:14372:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638aef20380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5e91e95c-c49d-475c-a425-33e1a73fefb4+24:14474:x1876286751493120:12345-192.168.202.23@tcp:34:lhsmtool_posix.0 00010000:00010000:1.0:1789366746.502638:0:14372:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9638c142ca00/0x8da3486b955f4641 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14372 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366746.502672:0:14372:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9638c142ca00/0x8da3486b955f4641 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14372 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366746.502684:0:14372:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9638c142ca00/0x8da3486b955f4641 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14372 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366746.502747:0:14372:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9638c142da00/0x8da3486b955f4648 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14372 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366746.502756:0:14372:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9638c142da00/0x8da3486b955f4648 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14372 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366746.502762:0:14372:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9638c142da00/0x8da3486b955f4648 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14372 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366746.502785:0:14372:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9638c142d200/0x8da3486b955f464f lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14372 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366746.502793:0:14372:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9638c142d200/0x8da3486b955f464f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14372 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366746.502800:0:14372:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9638c142d200/0x8da3486b955f464f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14372 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789366746.502839:0:14372:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:1.0:1789366746.502844:0:14372:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1789366746.502858:0:14372:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9638c142d200/0x8da3486b955f464f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14372 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366746.502868:0:14372:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9638c142ca00/0x8da3486b955f4641 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14372 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366746.502887:0:14372:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9638c142ca00/0x8da3486b955f4641 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14372 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366746.502895:0:14372:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9638c142ca00/0x8da3486b955f4641 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14372 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366746.502901:0:14372:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9638c142ca00 already unused, calling callback (ffffffffc20ee4f0) 00010000:00010000:1.0:1789366746.502905:0:14372:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9638c142ca00/0x8da3486b955f4641 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14372 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366746.502913:0:14372:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9638c142ca00/0x8da3486b955f4641 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14372 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366746.502925:0:14372:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff96389a30f000) 00010000:00010000:1.0:1789366746.502928:0:14372:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789366746.502933:0:14372:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9638c142ca00/0x8da3486b955f4641 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14372 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366746.502939:0:14372:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9638c142ca00/0x8da3486b955f4641 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14372 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366746.502953:0:14372:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9638c142da00/0x8da3486b955f4648 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14372 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366746.502959:0:14372:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9638c142da00/0x8da3486b955f4648 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14372 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366746.502966:0:14372:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9638c142da00/0x8da3486b955f4648 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14372 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366746.502971:0:14372:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9638c142da00 already unused, calling callback (ffffffffc20ee4f0) 00010000:00010000:1.0:1789366746.502980:0:14372:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9638c142da00/0x8da3486b955f4648 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14372 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366746.502987:0:14372:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9638c142da00/0x8da3486b955f4648 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14372 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366746.502994:0:14372:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x4549062c (ffff96389a5ec000) 00010000:00010000:1.0:1789366746.502997:0:14372:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789366746.503000:0:14372:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9638c142da00/0x8da3486b955f4648 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14372 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366746.503006:0:14372:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9638c142da00/0x8da3486b955f4648 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14372 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366746.503022:0:14372:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9638c142d200/0x8da3486b955f464f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14372 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366746.503029:0:14372:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9638c142d200/0x8da3486b955f464f lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14372 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366746.503035:0:14372:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9638c142d200/0x8da3486b955f464f lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14372 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366746.503040:0:14372:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9638c142d200 already unused, calling callback (ffffffffc20ee4f0) 00010000:00010000:1.0:1789366746.503044:0:14372:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9638c142d200/0x8da3486b955f464f lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14372 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366746.503062:0:14372:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9638c142d200/0x8da3486b955f464f lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14372 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366746.503070:0:14372:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff96389a30fb00) 00010000:00010000:1.0:1789366746.503072:0:14372:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789366746.503080:0:14372:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9638c142d200/0x8da3486b955f464f lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14372 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366746.503087:0:14372:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9638c142d200/0x8da3486b955f464f lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14372 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789366746.503180:0:14372:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638aef20380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5e91e95c-c49d-475c-a425-33e1a73fefb4+24:14474:x1876286751493120:12345-192.168.202.23@tcp:34:lhsmtool_posix.0 Request processed in 614us (927us total) trans 0 rc 0/0 00000100:00100000:1.0:1789366746.503189:0:14372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 39 00000100:00100000:0.0:1789366746.506814:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:2.0:1789366746.506904:0:14371:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751493376 00000100:00100000:2.0:1789366746.506914:0:14371:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751493376 00000100:00100000:2.0:1789366746.507009:0:14371:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 40 00000100:00100000:2.0:1789366746.507021:0:14371:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963787499f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5e91e95c-c49d-475c-a425-33e1a73fefb4+24:14474:x1876286751493376:12345-192.168.202.23@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789366746.507054:0:14371:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789366746.507073:0:14371:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9600/0x8da3486b955f4656 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xda917a494d06c4a5 expref: -99 pid: 14371 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366746.507190:0:14371:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c8a00/0x8da3486b955f465d lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14371 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366746.507205:0:14371:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c8a00/0x8da3486b955f465d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14371 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366746.507217:0:14371:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c8a00/0x8da3486b955f465d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14371 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789366746.507229:0:14371:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1789366746.507336:0:14371:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c8a00/0x8da3486b955f465d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14371 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366746.507345:0:14371:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c8a00/0x8da3486b955f465d lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14371 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366746.507370:0:14371:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c8a00/0x8da3486b955f465d lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14371 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366746.507377:0:14371:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9638902c8a00 already unused, calling callback (ffffffffc20ee4f0) 00010000:00010000:2.0:1789366746.507382:0:14371:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c8a00/0x8da3486b955f465d lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14371 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366746.507390:0:14371:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c8a00/0x8da3486b955f465d lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14371 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366746.507411:0:14371:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff96389a30fb00) 00010000:00010000:2.0:1789366746.507415:0:14371:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1789366746.507419:0:14371:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c8a00/0x8da3486b955f465d lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14371 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366746.507425:0:14371:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c8a00/0x8da3486b955f465d lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14371 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366746.507469:0:14371:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9600/0x8da3486b955f4656 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.23@tcp remote: 0xda917a494d06c4a5 expref: 26 pid: 14371 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366746.507479:0:14371:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff96389a30f000) 00010000:00010000:2.0:1789366746.507481:0:14371:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789366746.507485:0:14371:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9600/0x8da3486b955f4656 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.23@tcp remote: 0xda917a494d06c4a5 expref: 26 pid: 14371 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366746.507506:0:14371:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9638902c9600, rc 0) 00000100:00100000:2.0:1789366746.507570:0:14371:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963787499f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5e91e95c-c49d-475c-a425-33e1a73fefb4+25:14474:x1876286751493376:12345-192.168.202.23@tcp:101:lhsmtool_posix.0 Request processed in 549us (763us total) trans 8589934611 rc 301/301 00000100:00100000:2.0:1789366746.507577:0:14371:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 40 00000100:00100000:3.0:1789366746.513100:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:0.0:1789366746.513154:0:14370:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751493504 00000100:00100000:0.0:1789366746.513163:0:14370:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751493504 00000100:00100000:0.0:1789366746.513221:0:14370:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 41 00000100:00100000:0.0:1789366746.513231:0:14370:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638b6d57800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5e91e95c-c49d-475c-a425-33e1a73fefb4+25:14474:x1876286751493504:12345-192.168.202.23@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1789366746.513391:0:14370:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1789366746.513514:0:14370:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638b6d57800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5e91e95c-c49d-475c-a425-33e1a73fefb4+25:14474:x1876286751493504:12345-192.168.202.23@tcp:53:lhsmtool_posix.0 Request processed in 283us (422us total) trans 0 rc 0/0 00000100:00100000:0.0:1789366746.513522:0:14370:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 41 00000100:00100000:2.0:1789366746.517135:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:1.0:1789366746.518609:0:15782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751493760 00000100:00100000:1.0:1789366746.518621:0:15782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751493760 00000100:00100000:1.0:1789366746.518696:0:15782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 42 00000100:00100000:1.0:1789366746.518708:0:15782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638aef23480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5e91e95c-c49d-475c-a425-33e1a73fefb4+25:14474:x1876286751493760:12345-192.168.202.23@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789366746.518760:0:15782:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789366746.518781:0:15782:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9638c142da00/0x8da3486b955f466b lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xda917a494d06c4ac expref: -99 pid: 15782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1789366746.519394:0:15782:0:(osp_internal.h:553:osp_update_last_fid()) Gap in objids: start=[0x280000400:0x6:0x0], count =28 00000004:00080000:1.0:1789366746.519400:0:15782:0:(osp_object.c:1645:osp_create()) Writing gap [0x280000400:0x6:0x0]+28 in llog 00000004:00080000:1.0:1789366746.519450:0:15782:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x22:0x0], index 1: 0 00010000:00010000:1.0:1789366746.519711:0:15782:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9638c142ca00/0x8da3486b955f4672 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366746.519760:0:15782:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9638c142ca00/0x8da3486b955f4672 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366746.519772:0:15782:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9638c142ca00/0x8da3486b955f4672 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366746.519827:0:15782:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9638c142da00/0x8da3486b955f466b lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.23@tcp remote: 0xda917a494d06c4ac expref: 28 pid: 15782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366746.519850:0:15782:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9638c142ca00/0x8da3486b955f4672 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.23@tcp remote: 0xda917a494d06c4ac expref: 27 pid: 15782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366746.519859:0:15782:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff96389a5ec000) 00010000:00010000:1.0:1789366746.519862:0:15782:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789366746.519866:0:15782:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9638c142ca00, rc 0) 00000100:00100000:1.0:1789366746.519932:0:15782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638aef23480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5e91e95c-c49d-475c-a425-33e1a73fefb4+27:14474:x1876286751493760:12345-192.168.202.23@tcp:101:lhsmtool_posix.0 Request processed in 1226us (2805us total) trans 8589934612 rc 0/0 00000100:00100000:1.0:1789366746.519940:0:15782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 42 00000100:00100000:1.0:1789366746.524534:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:2.0:1789366746.525062:0:14372:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751494016 00000100:00100000:2.0:1789366746.525070:0:14372:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751494016 00000100:00100000:2.0:1789366746.525122:0:14372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 43 00000100:00100000:2.0:1789366746.525132:0:14372:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638af332d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5e91e95c-c49d-475c-a425-33e1a73fefb4+27:14474:x1876286751494016:12345-192.168.202.23@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1789366746.525185:0:14372:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789366746.525211:0:14372:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9638c142ca00/0x8da3486b955f4672 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.23@tcp remote: 0xda917a494d06c4ac expref: 27 pid: 15782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366746.525295:0:14372:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff96389a5ec000) 00010000:00010000:2.0:1789366746.525308:0:14372:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789366746.525329:0:14372:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9600/0x8da3486b955f4680 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14372 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366746.525342:0:14372:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9600/0x8da3486b955f4680 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14372 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366746.525351:0:14372:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9600/0x8da3486b955f4680 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14372 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366746.525435:0:14372:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c8a00/0x8da3486b955f4687 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x2d0b9fde bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14372 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366746.525461:0:14372:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c8a00/0x8da3486b955f4687 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x2d0b9fde bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14372 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366746.525469:0:14372:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c8a00/0x8da3486b955f4687 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x2d0b9fde bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14372 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366746.525530:0:14372:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9600/0x8da3486b955f4680 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14372 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366746.525538:0:14372:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9600/0x8da3486b955f4680 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14372 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366746.525543:0:14372:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9600/0x8da3486b955f4680 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14372 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366746.525549:0:14372:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9638902c9600 already unused, calling callback (ffffffffc20ee4f0) 00010000:00010000:2.0:1789366746.525553:0:14372:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9600/0x8da3486b955f4680 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14372 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366746.525560:0:14372:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9600/0x8da3486b955f4680 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14372 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366746.525569:0:14372:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff963890797500) 00010000:00010000:2.0:1789366746.525572:0:14372:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789366746.525576:0:14372:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9600/0x8da3486b955f4680 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14372 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366746.525582:0:14372:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9600/0x8da3486b955f4680 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14372 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366746.525591:0:14372:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c8a00/0x8da3486b955f4687 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x2d0b9fde bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14372 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366746.525604:0:14372:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c8a00/0x8da3486b955f4687 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x2d0b9fde bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14372 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366746.525609:0:14372:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c8a00/0x8da3486b955f4687 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x2d0b9fde bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14372 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366746.525619:0:14372:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9638902c8a00 already unused, calling callback (ffffffffc20ee4f0) 00010000:00010000:2.0:1789366746.525623:0:14372:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c8a00/0x8da3486b955f4687 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x2d0b9fde bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14372 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366746.525630:0:14372:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c8a00/0x8da3486b955f4687 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x2d0b9fde bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14372 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366746.525638:0:14372:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x2d0b9fde (ffff9638a7404500) 00010000:00010000:2.0:1789366746.525640:0:14372:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789366746.525643:0:14372:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c8a00/0x8da3486b955f4687 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x2d0b9fde bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14372 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366746.525648:0:14372:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c8a00/0x8da3486b955f4687 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x2d0b9fde bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14372 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789366746.526472:0:14372:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638af332d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5e91e95c-c49d-475c-a425-33e1a73fefb4+26:14474:x1876286751494016:12345-192.168.202.23@tcp:36:lhsmtool_posix.0 Request processed in 1338us (1944us total) trans 0 rc -2/-2 00000100:00100000:2.0:1789366746.526482:0:14372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 43 00000100:00100000:3.0:1789366746.530163:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:2.0:1789366746.530246:0:14371:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751494144 00000100:00100000:2.0:1789366746.530256:0:14371:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751494144 00000100:00100000:2.0:1789366746.530314:0:14371:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 44 00000100:00100000:2.0:1789366746.530323:0:14371:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638b6d56a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5e91e95c-c49d-475c-a425-33e1a73fefb4+26:14474:x1876286751494144:12345-192.168.202.23@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789366746.530343:0:14371:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789366746.530393:0:14371:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c8e00/0x8da3486b955f468e lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xda917a494d06c4b3 expref: -99 pid: 14371 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366746.530431:0:14371:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9c00/0x8da3486b955f4695 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14371 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366746.530445:0:14371:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9c00/0x8da3486b955f4695 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14371 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366746.530456:0:14371:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9c00/0x8da3486b955f4695 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14371 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366746.530543:0:14371:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c8e00/0x8da3486b955f468e lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.23@tcp remote: 0xda917a494d06c4b3 expref: 28 pid: 14371 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366746.530561:0:14371:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c9c00/0x8da3486b955f4695 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.23@tcp remote: 0xda917a494d06c4b3 expref: 27 pid: 14371 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366746.530570:0:14371:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9638a7404400) 00010000:00010000:2.0:1789366746.530573:0:14371:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1789366746.530576:0:14371:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9638902c9c00, rc 0) 00000100:00100000:2.0:1789366746.530635:0:14371:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638b6d56a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5e91e95c-c49d-475c-a425-33e1a73fefb4+27:14474:x1876286751494144:12345-192.168.202.23@tcp:101:lhsmtool_posix.0 Request processed in 312us (480us total) trans 0 rc 0/0 00000100:00100000:2.0:1789366746.530642:0:14371:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 44 00000100:00100000:3.0:1789366746.535017:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:0.0:1789366746.535377:0:14370:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751494400 00000100:00100000:0.0:1789366746.535388:0:14370:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751494400 00000100:00100000:0.0:1789366746.535452:0:14370:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 45 00000100:00100000:0.0:1789366746.535464:0:14370:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638b6d57480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5e91e95c-c49d-475c-a425-33e1a73fefb4+27:14474:x1876286751494400:12345-192.168.202.23@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1789366746.535545:0:14370:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720d200/0x8da3486b955f469c lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366746.535562:0:14370:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720d200/0x8da3486b955f469c lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366746.535573:0:14370:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720d200/0x8da3486b955f469c lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1789366746.536045:0:14370:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].2, 88 off8344 00000004:00080000:0.0:1789366746.536055:0:14370:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 322000336846ns, next at 323000334671ns, rc = 0 00000004:00010000:0.0:1789366746.536135:0:14370:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000a393abdf reply state 0000000060a20934 transno 8589934613 ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720d200/0x8da3486b955f469c lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789366746.536145:0:14370:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789366746.536233:0:14370:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638b6d57480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5e91e95c-c49d-475c-a425-33e1a73fefb4+29:14474:x1876286751494400:12345-192.168.202.23@tcp:36:lhsmtool_posix.0 Request processed in 771us (1225us total) trans 8589934613 rc 0/0 00000100:00100000:0.0:1789366746.536241:0:14370:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 45 00010000:00010000:3.0:1789366746.537750:0:3270:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720d200/0x8da3486b955f469c lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366746.537762:0:3270:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720d200/0x8da3486b955f469c lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366746.537770:0:3270:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720d200/0x8da3486b955f469c lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366746.537777:0:3270:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9638b720d200 already unused, calling callback (ffffffffc20ee4f0) 00010000:00010000:3.0:1789366746.537782:0:3270:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720d200/0x8da3486b955f469c lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366746.537790:0:3270:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720d200/0x8da3486b955f469c lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366746.537830:0:3270:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9638a7404400) 00010000:00010000:3.0:1789366746.537834:0:3270:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1789366746.537839:0:3270:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720d200/0x8da3486b955f469c lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366746.537846:0:3270:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720d200/0x8da3486b955f469c lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789366746.538467:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:1.0:1789366746.538633:0:15782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751494528 00000100:00100000:1.0:1789366746.538642:0:15782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751494528 00000100:00100000:1.0:1789366746.538690:0:15782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 46 00000100:00100000:1.0:1789366746.538700:0:15782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638b6d54700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5e91e95c-c49d-475c-a425-33e1a73fefb4+28:14474:x1876286751494528:12345-192.168.202.23@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789366746.538752:0:15782:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789366746.538769:0:15782:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9638c142da00/0x8da3486b955f46a3 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xda917a494d06c4ba expref: -99 pid: 15782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366746.538818:0:15782:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9638c142da00/0x8da3486b955f46a3 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.23@tcp remote: 0xda917a494d06c4ba expref: 29 pid: 15782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366746.538831:0:15782:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9638c142da00/0x8da3486b955f46a3 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.23@tcp remote: 0xda917a494d06c4ba expref: 29 pid: 15782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366746.538848:0:15782:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9638a7404400) 00010000:00010000:1.0:1789366746.538858:0:15782:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789366746.538862:0:15782:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9638c142da00, rc 0) 00000100:00100000:1.0:1789366746.538903:0:15782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638b6d54700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5e91e95c-c49d-475c-a425-33e1a73fefb4+29:14474:x1876286751494528:12345-192.168.202.23@tcp:101:lhsmtool_posix.0 Request processed in 206us (440us total) trans 0 rc 0/0 00000100:00100000:1.0:1789366746.538910:0:15782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 46 00000100:00100000:1.0:1789366746.542110:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:2.0:1789366746.542340:0:15056:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751494656 00000100:00100000:2.0:1789366746.542351:0:15056:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751494656 00000100:00100000:2.0:1789366746.542414:0:15056:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 13 00000100:00100000:2.0:1789366746.542426:0:15056:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638af333100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5e91e95c-c49d-475c-a425-33e1a73fefb4+5:2355:x1876286751494656:12345-192.168.202.23@tcp:2:lhsmtool_posix.0 00000100:00100000:2.0:1789366746.542778:0:15056:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638af333100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5e91e95c-c49d-475c-a425-33e1a73fefb4+6:2355:x1876286751494656:12345-192.168.202.23@tcp:2:lhsmtool_posix.0 Request processed in 354us (675us total) trans 8589934594 rc 0/0 00000100:00100000:2.0:1789366746.542797:0:15056:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 13 00000100:00100000:3.0:1789366746.544784:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:2.0:1789366746.546352:0:14373:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751494912 00000100:00100000:2.0:1789366746.546373:0:14373:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751494912 00000100:00100000:2.0:1789366746.546440:0:14373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 9 00000100:00100000:2.0:1789366746.546450:0:14373:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638b6d56300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5e91e95c-c49d-475c-a425-33e1a73fefb4+29:14474:x1876286751494912:12345-192.168.202.23@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1789366746.546678:0:14373:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638b6d56300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5e91e95c-c49d-475c-a425-33e1a73fefb4+30:14474:x1876286751494912:12345-192.168.202.23@tcp:35:lhsmtool_posix.0 Request processed in 228us (1973us total) trans 8589934614 rc 0/0 00000100:00100000:2.0:1789366746.546686:0:14373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 9 00000100:00100000:3.0:1789366746.548043:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:2.0:1789366746.548186:0:14372:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751495168 00000100:00100000:2.0:1789366746.548193:0:14372:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751495168 00000100:00100000:2.0:1789366746.548232:0:14372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 47 00000100:00100000:2.0:1789366746.548240:0:14372:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638b6d55500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5e91e95c-c49d-475c-a425-33e1a73fefb4+30:14474:x1876286751495168:12345-192.168.202.23@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1789366746.548414:0:14372:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638b6d55500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5e91e95c-c49d-475c-a425-33e1a73fefb4+30:14474:x1876286751495168:12345-192.168.202.23@tcp:57:lhsmtool_posix.0 Request processed in 173us (374us total) trans 0 rc 0/0 00000100:00100000:2.0:1789366746.548422:0:14372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 47 00000100:00100000:1.0:1789366746.552426:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:2.0:1789366746.552489:0:14371:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751495296 00000100:00100000:2.0:1789366746.552498:0:14371:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751495296 00000100:00100000:2.0:1789366746.552556:0:14371:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 48 00000100:00100000:2.0:1789366746.552566:0:14371:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638af330380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5e91e95c-c49d-475c-a425-33e1a73fefb4+30:14474:x1876286751495296:12345-192.168.202.23@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789366746.552698:0:14371:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789366746.552799:0:14371:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c8e00/0x8da3486b955f46aa lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xda917a494d06c4c1 expref: -99 pid: 14371 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366746.552874:0:14371:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c8a00/0x8da3486b955f46b1 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14371 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366746.552906:0:14371:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c8a00/0x8da3486b955f46b1 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14371 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366746.552918:0:14371:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c8a00/0x8da3486b955f46b1 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14371 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789366746.552955:0:14371:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1789366746.552974:0:14371:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c8a00/0x8da3486b955f46b1 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14371 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366746.553001:0:14371:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c8e00/0x8da3486b955f46aa lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.23@tcp remote: 0xda917a494d06c4c1 expref: 32 pid: 14371 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366746.553020:0:14371:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c8a00/0x8da3486b955f46b1 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.23@tcp remote: 0xda917a494d06c4c1 expref: 31 pid: 14371 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366746.553029:0:14371:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9638a7404400) 00010000:00010000:2.0:1789366746.553033:0:14371:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1789366746.553037:0:14371:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9638902c8a00, rc 0) 00000100:00100000:2.0:1789366746.553149:0:14371:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638af330380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5e91e95c-c49d-475c-a425-33e1a73fefb4+31:14474:x1876286751495296:12345-192.168.202.23@tcp:101:lhsmtool_posix.0 Request processed in 583us (731us total) trans 0 rc 0/0 00000100:00100000:2.0:1789366746.553157:0:14371:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 48 00000100:00100000:3.0:1789366746.555047:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:2.0:1789366746.555098:0:15057:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751495424 00000100:00100000:2.0:1789366746.555106:0:15057:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751495424 00000100:00100000:2.0:1789366746.555152:0:15057:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 14 00000100:00100000:2.0:1789366746.555163:0:15057:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638b6d55c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5e91e95c-c49d-475c-a425-33e1a73fefb4+6:2354:x1876286751495424:12345-192.168.202.23@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789366746.555178:0:15057:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789366746.555204:0:15057:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002b616cf5/0x8da3486b955f46b8 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xda917a494d06c4c8 expref: -99 pid: 15057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789366746.555229:0:15057:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x22:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6aa791da, blocks: 0x1 00010000:00010000:2.0:1789366746.555245:0:15057:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=322s v=(0 0) 00010000:00010000:2.0:1789366746.555249:0:15057:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789366746.555259:0:15057:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002b616cf5/0x8da3486b955f46b8 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.23@tcp remote: 0xda917a494d06c4c8 expref: 7 pid: 15057 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366746.555275:0:15057:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000002b616cf5/0x8da3486b955f46b8 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.23@tcp remote: 0xda917a494d06c4c8 expref: 7 pid: 15057 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366746.555287:0:15057:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9638902c9600, rc 0) 00000100:00100000:2.0:1789366746.555461:0:15057:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638b6d55c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5e91e95c-c49d-475c-a425-33e1a73fefb4+7:2354:x1876286751495424:12345-192.168.202.23@tcp:101:lhsmtool_posix.0 Request processed in 299us (418us total) trans 0 rc 0/0 00000100:00100000:2.0:1789366746.555469:0:15057:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 14 00000100:00100000:3.0:1789366746.557297:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:0.0:1789366746.557422:0:14370:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751495680 00000100:00100000:0.0:1789366746.557430:0:14370:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751495680 00000100:00100000:0.0:1789366746.557483:0:14370:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 49 00000100:00100000:0.0:1789366746.557493:0:14370:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638bfef8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5e91e95c-c49d-475c-a425-33e1a73fefb4+31:14474:x1876286751495680:12345-192.168.202.23@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1789366746.557628:0:14370:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638bfef8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5e91e95c-c49d-475c-a425-33e1a73fefb4+31:14474:x1876286751495680:12345-192.168.202.23@tcp:57:lhsmtool_posix.0 Request processed in 136us (334us total) trans 0 rc 0/0 00000100:00100000:0.0:1789366746.557636:0:14370:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 49 00000100:00100000:1.0:1789366746.559374:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:3.0:1789366746.559463:0:15782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751495808 00000100:00100000:3.0:1789366746.559470:0:15782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751495808 00000100:00100000:3.0:1789366746.559518:0:15782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 50 00000100:00100000:3.0:1789366746.559528:0:15782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638af333800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5e91e95c-c49d-475c-a425-33e1a73fefb4+31:14474:x1876286751495808:12345-192.168.202.23@tcp:44:lhsmtool_posix.0 00000100:00100000:3.0:1789366746.582952:0:15782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638af333800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5e91e95c-c49d-475c-a425-33e1a73fefb4+31:14474:x1876286751495808:12345-192.168.202.23@tcp:44:lhsmtool_posix.0 Request processed in 23413us (23581us total) trans 0 rc 0/0 00000100:00100000:3.0:1789366746.582965:0:15782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 50 00000001:00080000:1.0:1789366746.583027:0:5837:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934613 is committed 00000004:00080000:1.0:1789366746.583034:0:5837:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2 committed 00000001:00080000:1.0:1789366746.583057:0:5837:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934595 is committed 00000001:00080000:1.0:1789366746.583062:0:5837:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934614 is committed 00000001:00080000:1.0:1789366746.583082:0:5837:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934599 is committed 00000100:00100000:2.0:1789366746.583577:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9638bfefad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3285:1876286758807808:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1789366746.583625:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789366746.583784:0:15055:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286758807808 00000100:00100000:1.0:1789366746.583790:0:15055:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286758807808 00000100:00100000:1.0:1789366746.583857:0:15055:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1789366746.583863:0:15055:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638aef21180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3285:x1876286758807808:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1789366746.583996:0:15055:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1789366746.583999:0:15055:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:1.0:1789366746.584001:0:15055:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1789366746.584002:0:15055:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb ctime from disk: 1789366746 -> 1789366746 00002000:00010000:1.0:1789366746.584004:0:15055:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:1.0:1789366746.584040:0:15055:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638aef21180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3285:x1876286758807808:12345-0@lo:2:osp-syn-1-0.0 Request processed in 178us (416us total) trans 8589934595 rc 0/0 00000100:00100000:1.0:1789366746.584045:0:15055:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1789366746.584131:0:3285:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934593 gen 2 00000100:00100000:3.0:1789366746.584145:0:3285:0:(client.c:3170:ptlrpc_free_committed()) @@@ stopping search req@ffff9638bfefad80 x1876286758807808/t8589934595(8589934595) o2->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 440/432 e 0 to 0 dl 1789366762 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:3.0:1789366746.584153:0:3285:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9638bfefad80/2, rc 0, transno 8589934595 00000100:00100000:3.0:1789366746.584157:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9638bfefad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3285:1876286758807808:0@lo:2:osp-syn-1-0.0 00000100:00080000:0.0:1789366746.584215:0:14366:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789366746.584887:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:2.0:1789366746.584982:0:15698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751495936 00000100:00100000:2.0:1789366746.584987:0:15698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751495936 00000100:00100000:2.0:1789366746.585040:0:15698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 16 00000100:00100000:2.0:1789366746.585046:0:15698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638bfefa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5e91e95c-c49d-475c-a425-33e1a73fefb4+7:2355:x1876286751495936:12345-192.168.202.23@tcp:16:lhsmtool_posix.0 00000100:00100000:2.0:1789366746.585098:0:15698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638bfefa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5e91e95c-c49d-475c-a425-33e1a73fefb4+7:2355:x1876286751495936:12345-192.168.202.23@tcp:16:lhsmtool_posix.0 Request processed in 52us (212us total) trans 0 rc 0/0 00000100:00100000:2.0:1789366746.585102:0:15698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 16 00000100:00100000:2.0:1789366746.587198:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:0.0:1789366746.587315:0:14370:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751496192 00000100:00100000:0.0:1789366746.587323:0:14370:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751496192 00000100:00100000:0.0:1789366746.587401:0:14370:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 51 00000100:00100000:0.0:1789366746.587409:0:14370:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638aef22300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5e91e95c-c49d-475c-a425-33e1a73fefb4+14:14474:x1876286751496192:12345-192.168.202.23@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1789366746.587450:0:14370:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789366746.587471:0:14370:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c8a00/0x8da3486b955f46b1 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.23@tcp remote: 0xda917a494d06c4c1 expref: 14 pid: 14371 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366746.587485:0:14370:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9638a7404400) 00010000:00010000:0.0:1789366746.587489:0:14370:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789366746.587511:0:14370:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720de00/0x8da3486b955f46bf lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366746.587522:0:14370:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720de00/0x8da3486b955f46bf lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366746.587529:0:14370:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720de00/0x8da3486b955f46bf lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789366746.587691:0:14370:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000d6c7937f reply state 000000005c7358f6 transno 8589934615 ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720de00/0x8da3486b955f46bf lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789366746.587698:0:14370:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789366746.587879:0:14370:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638aef22300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5e91e95c-c49d-475c-a425-33e1a73fefb4+15:14474:x1876286751496192:12345-192.168.202.23@tcp:36:lhsmtool_posix.0 Request processed in 470us (685us total) trans 8589934615 rc 0/0 00000100:00100000:0.0:1789366746.587897:0:14370:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 51 00010000:00010000:1.0:1789366746.589153:0:3271:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720de00/0x8da3486b955f46bf lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366746.589163:0:3271:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720de00/0x8da3486b955f46bf lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366746.589174:0:3271:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720de00/0x8da3486b955f46bf lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366746.589178:0:3271:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9638b720de00 already unused, calling callback (ffffffffc20ee4f0) 00010000:00010000:1.0:1789366746.589181:0:3271:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720de00/0x8da3486b955f46bf lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366746.589186:0:3271:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720de00/0x8da3486b955f46bf lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366746.589196:0:3271:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9638a7404400) 00010000:00010000:1.0:1789366746.589198:0:3271:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789366746.589201:0:3271:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720de00/0x8da3486b955f46bf lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366746.589205:0:3271:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720de00/0x8da3486b955f46bf lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789366746.589921:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:1.0:1789366746.590127:0:15055:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751496320 00000100:00100000:1.0:1789366746.590135:0:15055:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751496320 00000100:00100000:1.0:1789366746.590168:0:15055:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 17 00000100:00100000:1.0:1789366746.590174:0:15055:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638aef20e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5e91e95c-c49d-475c-a425-33e1a73fefb4+7:2355:x1876286751496320:12345-192.168.202.23@tcp:2:lhsmtool_posix.0 00002000:00010000:1.0:1789366746.590327:0:15055:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1789366746.590330:0:15055:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb mtime from disk: 0 -> 1789366746 00002000:00010000:1.0:1789366746.590332:0:15055:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb atime from disk: 0 -> 1789366746 00002000:00010000:1.0:1789366746.590333:0:15055:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb ctime from disk: 1789366746 -> 1789366746 00002000:00010000:1.0:1789366746.590335:0:15055:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:1.0:1789366746.590395:0:15055:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638aef20e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5e91e95c-c49d-475c-a425-33e1a73fefb4+8:2355:x1876286751496320:12345-192.168.202.23@tcp:2:lhsmtool_posix.0 Request processed in 219us (476us total) trans 8589934596 rc 0/0 00000100:00100000:1.0:1789366746.590411:0:15055:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 17 00000100:00100000:3.0:1789366746.591892:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:1.0:1789366746.591970:0:15057:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751496448 00000100:00100000:1.0:1789366746.591978:0:15057:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751496448 00000100:00100000:1.0:1789366746.592061:0:15057:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 18 00000100:00100000:1.0:1789366746.592068:0:15057:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638bfef8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5e91e95c-c49d-475c-a425-33e1a73fefb4+8:2355:x1876286751496448:12345-192.168.202.23@tcp:1:lhsmtool_posix.0 00010000:00010000:1.0:1789366746.592110:0:15057:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000e9e75be4/0x8da3486b955f46c6 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366746.592126:0:15057:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789366746.592131:0:15057:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789366746.592136:0:15057:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e9e75be4/0x8da3486b955f46c6 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366746.592151:0:15057:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e9e75be4/0x8da3486b955f46c6 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366746.592172:0:15057:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000e9e75be4/0x8da3486b955f46c6 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366746.592179:0:15057:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e9e75be4/0x8da3486b955f46c6 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366746.592187:0:15057:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e9e75be4/0x8da3486b955f46c6 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366746.592194:0:15057:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9638c142d200 already unused, calling callback (ffffffffc16df520) 00010000:00010000:1.0:1789366746.592210:0:15057:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e9e75be4/0x8da3486b955f46c6 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366746.592221:0:15057:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e9e75be4/0x8da3486b955f46c6 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366746.592235:0:15057:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e9e75be4/0x8da3486b955f46c6 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366746.592243:0:15057:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e9e75be4/0x8da3486b955f46c6 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789366746.592311:0:15057:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638bfef8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5e91e95c-c49d-475c-a425-33e1a73fefb4+8:2355:x1876286751496448:12345-192.168.202.23@tcp:1:lhsmtool_posix.0 Request processed in 235us (415us total) trans 0 rc 0/0 00000100:00100000:1.0:1789366746.592318:0:15057:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 18 00000100:00100000:0.0:1789366746.597418:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:2.0:1789366746.597606:0:14371:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751496704 00000100:00100000:2.0:1789366746.597615:0:14371:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751496704 00000100:00100000:2.0:1789366746.597690:0:14371:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 52 00000100:00100000:2.0:1789366746.597701:0:14371:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96378749ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5e91e95c-c49d-475c-a425-33e1a73fefb4+14:14474:x1876286751496704:12345-192.168.202.23@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1789366746.597878:0:14371:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c8600/0x8da3486b955f46cd lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14371 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366746.597893:0:14371:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c8600/0x8da3486b955f46cd lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14371 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366746.597902:0:14371:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c8600/0x8da3486b955f46cd lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14371 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366746.598166:0:14371:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c8a00/0x8da3486b955f46d4 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14371 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366746.598174:0:14371:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9638c142da00/0x8da3486b955f46a3 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.23@tcp remote: 0xda917a494d06c4ba expref: 15 pid: 15782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366746.598180:0:14371:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c8a00/0x8da3486b955f46d4 lrc: 4/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14371 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366746.598226:0:14371:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9638c142da00/0x8da3486b955f46a3 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.23@tcp remote: 0xda917a494d06c4ba expref: 15 pid: 15782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366746.598239:0:14371:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9638c142da00/0x8da3486b955f46a3 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.23@tcp remote: 0xda917a494d06c4ba expref: 15 pid: 15782 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789366746.598254:0:14371:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9638aef21c00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14371:1876286758807936:192.168.202.23@tcp:104: 00000100:00100000:2.0:1789366746.598459:0:14371:0:(client.c:2716:ptlrpc_set_wait()) set ffff96389883e480 going to sleep for 11 seconds 00000100:00100000:2.0:1789366746.600193:0:14371:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9638aef21c00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14371:1876286758807936:192.168.202.23@tcp:104: 00010000:00010000:2.0:1789366746.600235:0:14371:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c8a00/0x8da3486b955f46d4 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14371 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789366746.600639:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:2.0:1789366746.600706:0:14355:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751496832 00000100:00100000:2.0:1789366746.600713:0:14355:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751496832 00010000:00010000:2.0:1789366746.600816:0:14355:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9638c142da00/0x8da3486b955f46a3 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.23@tcp remote: 0xda917a494d06c4ba expref: 16 pid: 15782 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789366746.600851:0:14355:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 13 00000100:00100000:2.0:1789366746.600861:0:14355:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963787498700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5e91e95c-c49d-475c-a425-33e1a73fefb4+16:2354:x1876286751496832:12345-192.168.202.23@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789366746.600873:0:14355:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789366746.600880:0:14355:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9638c142da00/0x8da3486b955f46a3 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.23@tcp remote: 0xda917a494d06c4ba expref: 16 pid: 15782 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366746.600892:0:14355:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9638c142da00/0x8da3486b955f46a3 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.23@tcp remote: 0xda917a494d06c4ba expref: 16 pid: 15782 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366746.600917:0:14355:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9638c142da00/0x8da3486b955f46a3 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.23@tcp remote: 0xda917a494d06c4ba expref: 16 pid: 15782 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366746.600935:0:14355:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9638a7404400) 00010000:00010000:2.0:1789366746.600941:0:14355:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c8a00/0x8da3486b955f46d4 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14371 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366746.600950:0:14355:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c8a00/0x8da3486b955f46d4 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 14371 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366746.600969:0:14355:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c8a00/0x8da3486b955f46d4 lrc: 4/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 14371 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366746.600992:0:14355:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789366746.601027:0:14371:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c8a00/0x8da3486b955f46d4 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14371 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366746.601038:0:14371:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c8a00/0x8da3486b955f46d4 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14371 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789366746.601040:0:14355:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963787498700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5e91e95c-c49d-475c-a425-33e1a73fefb4+15:2354:x1876286751496832:12345-192.168.202.23@tcp:103:ldlm_bl.0 Request processed in 179us (401us total) trans 0 rc 0/0 00000100:00100000:2.0:1789366746.601052:0:14355:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 13 00000001:00080000:3.0:1789366746.601220:0:14371:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934616 00000001:00080000:3.0:1789366746.601374:0:14371:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934617 00000001:00080000:3.0:1789366746.601421:0:14371:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934618 00000100:00100000:3.0:1789366746.601493:0:14371:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9638b6d56d80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:14371:1876286758808064:0@lo:1000:mdt00_001.0 00000100:00100000:3.0:1789366746.601572:0:14371:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789366746.601600:0:14371:0:(client.c:2716:ptlrpc_set_wait()) set ffff96388524b3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789366746.601628:0:14375:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286758808064 00000100:00100000:2.0:1789366746.601634:0:14375:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286758808064 00000100:00100000:2.0:1789366746.601668:0:14375:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789366746.601676:0:14375:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638b703aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:14371:x1876286758808064:12345-0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1789366746.601922:0:14375:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638b703aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:14371:x1876286758808064:12345-0@lo:1000:mdt00_001.0 Request processed in 247us (350us total) trans 0 rc 0/0 00000100:00100000:2.0:1789366746.601928:0:14375:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789366746.602004:0:14371:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9638b6d56d80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:14371:1876286758808064:0@lo:1000:mdt00_001.0 00000001:00080000:0.0:1789366746.602806:0:14371:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934619 00000100:00100000:0.0:1789366746.602861:0:14371:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff963787498000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:14371:1876286758808192:0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1789366746.602888:0:14371:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789366746.602979:0:14376:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286758808192 00000100:00100000:0.0:1789366746.602983:0:14371:0:(client.c:2716:ptlrpc_set_wait()) set ffff96388a342b40 going to sleep for 11 seconds 00000100:00100000:3.0:1789366746.602985:0:14376:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286758808192 00000100:00100000:3.0:1789366746.603012:0:14376:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789366746.603019:0:14376:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963787499c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:14371:x1876286758808192:12345-0@lo:1000:mdt00_001.0 00000100:00100000:3.0:1789366746.603509:0:14376:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963787499c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:14371:x1876286758808192:12345-0@lo:1000:mdt00_001.0 Request processed in 488us (617us total) trans 8589934597 rc 0/0 00000100:00100000:0.0:1789366746.603513:0:14371:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff963787498000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:14371:1876286758808192:0@lo:1000:mdt00_001.0 00000100:00100000:3.0:1789366746.603523:0:14376:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00010000:0.0:1789366746.603542:0:14371:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c8a00/0x8da3486b955f46d4 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14371 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366746.603549:0:14371:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c8a00/0x8da3486b955f46d4 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14371 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366746.603554:0:14371:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c8a00/0x8da3486b955f46d4 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14371 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366746.603558:0:14371:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9638902c8a00 already unused, calling callback (ffffffffc20ee4f0) 00010000:00010000:0.0:1789366746.603561:0:14371:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c8a00/0x8da3486b955f46d4 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14371 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366746.603566:0:14371:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c8a00/0x8da3486b955f46d4 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14371 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366746.603577:0:14371:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9638a7404400) 00010000:00010000:0.0:1789366746.603579:0:14371:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1789366746.603582:0:14371:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c8a00/0x8da3486b955f46d4 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14371 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366746.603595:0:14371:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c8a00/0x8da3486b955f46d4 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14371 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366746.603626:0:14371:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff96388148e200/0x8da3486b955f4633 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 15782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366746.603634:0:14371:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96388148e200/0x8da3486b955f4633 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 15782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366746.603639:0:14371:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96388148e200/0x8da3486b955f4633 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 15782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366746.603645:0:14371:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96388148e200 already unused, calling callback (ffffffffc20ee4f0) 00010000:00010000:0.0:1789366746.603648:0:14371:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96388148e200/0x8da3486b955f4633 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 15782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366746.603652:0:14371:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96388148e200/0x8da3486b955f4633 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 15782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366746.603660:0:14371:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff96389a30fb00) 00010000:00010000:0.0:1789366746.603663:0:14371:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1789366746.603669:0:14371:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720ca00/0x8da3486b955f463a lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.23@tcp remote: 0xda917a494d06c49e expref: 18 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366746.603680:0:14371:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720ca00/0x8da3486b955f463a lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.23@tcp remote: 0xda917a494d06c49e expref: 18 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366746.603689:0:14371:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720ca00/0x8da3486b955f463a lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.23@tcp remote: 0xda917a494d06c49e expref: 18 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366746.603756:0:14371:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720ca00/0x8da3486b955f463a lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.23@tcp remote: 0xda917a494d06c49e expref: 18 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789366746.603768:0:14371:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff963787499500 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14371:1876286758808320:192.168.202.23@tcp:105: 00000100:00100000:0.0:1789366746.603816:0:14371:0:(client.c:2716:ptlrpc_set_wait()) set ffff96388a342b40 going to sleep for 11 seconds 00000100:00100000:0.0:1789366746.608438:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:2.0:1789366746.608486:0:14374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751496960 00000100:00100000:2.0:1789366746.608493:0:14374:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751496960 00000100:00100000:2.0:1789366746.608539:0:14374:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 10 00000100:00100000:2.0:1789366746.608547:0:14374:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963887006c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5e91e95c-c49d-475c-a425-33e1a73fefb4+19:14472:x1876286751496960:12345-192.168.202.23@tcp:49:dd.0 00000100:00100000:3.0:1789366746.608576:0:14371:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff963787499500 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14371:1876286758808320:192.168.202.23@tcp:105: 00010000:00010000:3.0:1789366746.608601:0:14371:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96388148e200/0x8da3486b955f4633 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 15782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366746.608613:0:14371:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96388148e200/0x8da3486b955f4633 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 15782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366746.608645:0:14371:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff96388148e000/0x8da3486b955f46db lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14371 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789366746.608667:0:14374:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963887006c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5e91e95c-c49d-475c-a425-33e1a73fefb4+19:14472:x1876286751496960:12345-192.168.202.23@tcp:49:dd.0 Request processed in 119us (235us total) trans 0 rc 0/0 00000100:00100000:2.0:1789366746.608677:0:14374:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 10 00010000:00010000:3.0:1789366746.608679:0:14371:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96388148e000/0x8da3486b955f46db lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14371 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366746.608693:0:14371:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96388148e000/0x8da3486b955f46db lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14371 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366746.608703:0:14371:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff96388148e000/0x8da3486b955f46db lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14371 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366746.608709:0:14371:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96388148e000/0x8da3486b955f46db lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14371 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366746.608781:0:14371:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96388148e000/0x8da3486b955f46db lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14371 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366746.608788:0:14371:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96388148e000 already unused, calling callback (ffffffffc20ee4f0) 00010000:00010000:3.0:1789366746.608792:0:14371:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96388148e000/0x8da3486b955f46db lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14371 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366746.608800:0:14371:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96388148e000/0x8da3486b955f46db lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14371 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366746.608872:0:14371:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff96389a30fb00) 00010000:00010000:3.0:1789366746.608877:0:14371:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789366746.608881:0:14371:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96388148e000/0x8da3486b955f46db lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14371 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366746.609064:0:14371:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96388148e000/0x8da3486b955f46db lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14371 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366746.609075:0:14371:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c8600/0x8da3486b955f46cd lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14371 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366746.609083:0:14371:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c8600/0x8da3486b955f46cd lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14371 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366746.609089:0:14371:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c8600/0x8da3486b955f46cd lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14371 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366746.609094:0:14371:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9638902c8600 already unused, calling callback (ffffffffc20ee4f0) 00010000:00010000:3.0:1789366746.609098:0:14371:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c8600/0x8da3486b955f46cd lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14371 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366746.609103:0:14371:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c8600/0x8da3486b955f46cd lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14371 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366746.609112:0:14371:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff96389a30fb00) 00010000:00010000:3.0:1789366746.609115:0:14371:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1789366746.609118:0:14371:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c8600/0x8da3486b955f46cd lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14371 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366746.609124:0:14371:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9638902c8600/0x8da3486b955f46cd lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14371 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789366746.609510:0:14371:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96378749ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5e91e95c-c49d-475c-a425-33e1a73fefb4+18:14474:x1876286751496704:12345-192.168.202.23@tcp:57:lhsmtool_posix.0 Request processed in 11810us (12099us total) trans 8589934620 rc 0/0 00000100:00100000:2.0:1789366746.609519:0:14371:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 52 00000020:00080000:2.0:1789366746.609524:0:14371:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:3.0:1789366746.610784:0:14406:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1789366746.610788:0:14406:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1789366746.610824:0:14406:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:3.0:1789366746.610829:0:14406:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:0.0:1789366746.610959:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:2.0:1789366746.611160:0:14374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751497216 00000100:00100000:2.0:1789366746.611175:0:14374:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751497216 00000100:00100000:0.0:1789366746.611267:0:14373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 11 00000100:00100000:0.0:1789366746.611277:0:14373:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963787499880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5e91e95c-c49d-475c-a425-33e1a73fefb4+18:14474:x1876286751497216:12345-192.168.202.23@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1789366746.611626:0:14374:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 2 min 2 max 80 00000100:00100000:2.0:1789366746.611636:0:14374:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_002' 00000004:00080000:0.0:1789366746.612177:0:14373:0:(mdd_object.c:4014:mdd_close()) Object [0x200000bd1:0x3:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:0.0:1789366746.612275:0:14373:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934621 00010000:00010000:0.0:1789366746.612313:0:14373:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720d400/0x8da3486b955f46e2 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14373 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366746.612327:0:14373:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720d400/0x8da3486b955f46e2 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 14373 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366746.612337:0:14373:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720d400/0x8da3486b955f46e2 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 14373 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366746.612344:0:14373:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720d400/0x8da3486b955f46e2 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 14373 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366746.612350:0:14373:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720d400/0x8da3486b955f46e2 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 14373 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366746.612356:0:14373:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720d400/0x8da3486b955f46e2 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 14373 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366746.612402:0:14373:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789366746.612658:0:14358:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789366746.612666:0:14358:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720d400/0x8da3486b955f46e2 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 14373 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366746.612672:0:14358:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9638b720d400 already unused, calling callback (ffffffffc16df520) 00010000:00010000:1.0:1789366746.612677:0:14358:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720d400/0x8da3486b955f46e2 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 14373 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366746.612684:0:14358:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720d400/0x8da3486b955f46e2 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 14373 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366746.612696:0:14358:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9638a7404400) 00010000:00010000:1.0:1789366746.612699:0:14358:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1789366746.612715:0:14358:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720d400/0x8da3486b955f46e2 lrc: 1/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 14373 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366746.612788:0:14358:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9638b720d400/0x8da3486b955f46e2 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 14373 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366746.612799:0:14358:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789366746.612800:0:14358:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789366746.612802:0:14358:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789366746.613599:0:14373:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963787499880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5e91e95c-c49d-475c-a425-33e1a73fefb4+20:14474:x1876286751497216:12345-192.168.202.23@tcp:35:lhsmtool_posix.0 Request processed in 2320us (2637us total) trans 8589934622 rc 0/0 00000100:00100000:0.0:1789366746.613608:0:14373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 11 00000020:00080000:0.0:1789366746.613613:0:14373:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1789366746.686328:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:3.0:1789366746.686419:0:15060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751497344 00000100:00100000:0.0:1789366746.686430:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:3.0:1789366746.686432:0:15060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751497344 00000100:00100000:3.0:1789366746.686499:0:15060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751497472 00000100:00100000:3.0:1789366746.686504:0:15060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751497472 00000100:00100000:3.0:1789366746.686637:0:15060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 0 00000100:00100000:3.0:1789366746.686653:0:15060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963787499500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:5e91e95c-c49d-475c-a425-33e1a73fefb4+9:2355:x1876286751497344:12345-192.168.202.23@tcp:4:dd.0 00010000:00010000:3.0:1789366746.686700:0:15060:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000202a59de/0x8da3486b955f46e9 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366746.686750:0:15060:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000002b616cf5/0x8da3486b955f46b8 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.23@tcp remote: 0xda917a494d06c4c8 expref: 9 pid: 15057 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366746.686760:0:15060:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789366746.686765:0:15060:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789366746.686770:0:15060:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000202a59de/0x8da3486b955f46e9 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366746.686806:0:15060:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000002b616cf5/0x8da3486b955f46b8 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.23@tcp remote: 0xda917a494d06c4c8 expref: 9 pid: 15057 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366746.686820:0:15060:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000002b616cf5/0x8da3486b955f46b8 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.23@tcp remote: 0xda917a494d06c4c8 expref: 9 pid: 15057 timeout: 422 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789366746.686849:0:15060:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9638b7038a80 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_000:lustre-OST0001_UUID:15060:1876286758808448:192.168.202.23@tcp:104: 00000100:00100000:1.0:1789366746.686952:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:3.0:1789366746.686961:0:15060:0:(client.c:2716:ptlrpc_set_wait()) set ffff96388524b6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789366746.686977:0:15062:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:0.0:1789366746.686987:0:15062:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_003' 00000100:00100000:0.0:1789366746.687759:0:15062:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751497600 00000100:00100000:0.0:1789366746.687764:0:15062:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751497600 00000100:00100000:2.0:1789366746.688246:0:15061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 1 00000100:00100000:3.0:1789366746.688250:0:15060:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9638b7038a80 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_000:lustre-OST0001_UUID:15060:1876286758808448:192.168.202.23@tcp:104: 00000100:00100000:2.0:1789366746.688263:0:15061:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638b6d56300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:5e91e95c-c49d-475c-a425-33e1a73fefb4+10:2355:x1876286751497472:12345-192.168.202.23@tcp:4:dd.0 00010000:00010000:3.0:1789366746.688276:0:15060:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000202a59de/0x8da3486b955f46e9 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366746.688292:0:15061:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000057441913/0x8da3486b955f46f0 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366746.688307:0:15061:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789366746.688312:0:15061:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789366746.688317:0:15061:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000057441913/0x8da3486b955f46f0 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366746.688327:0:15061:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000057441913/0x8da3486b955f46f0 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789366746.689000:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:2.0:1789366746.689226:0:14356:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751497728 00000100:00100000:2.0:1789366746.689232:0:14356:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751497728 00010000:00010000:2.0:1789366746.689256:0:14356:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000002b616cf5/0x8da3486b955f46b8 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.23@tcp remote: 0xda917a494d06c4c8 expref: 11 pid: 15057 timeout: 422 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789366746.689285:0:14356:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 14 00000100:00100000:2.0:1789366746.689297:0:14356:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638af331180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5e91e95c-c49d-475c-a425-33e1a73fefb4+11:2354:x1876286751497728:12345-192.168.202.23@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789366746.689309:0:14356:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789366746.689329:0:14356:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000002b616cf5/0x8da3486b955f46b8 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.23@tcp remote: 0xda917a494d06c4c8 expref: 11 pid: 15057 timeout: 422 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366746.689356:0:14356:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000002b616cf5/0x8da3486b955f46b8 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.23@tcp remote: 0xda917a494d06c4c8 expref: 11 pid: 15057 timeout: 422 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366746.689390:0:14356:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002b616cf5/0x8da3486b955f46b8 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.23@tcp remote: 0xda917a494d06c4c8 expref: 11 pid: 15057 timeout: 422 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366746.689404:0:14356:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789366746.689407:0:14356:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789366746.689412:0:14356:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000202a59de/0x8da3486b955f46e9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366746.689420:0:14356:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000202a59de/0x8da3486b955f46e9 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366746.689428:0:14356:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789366746.689431:0:14356:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789366746.689434:0:14356:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000057441913/0x8da3486b955f46f0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366746.689441:0:14356:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000057441913/0x8da3486b955f46f0 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366746.689478:0:14356:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789366746.689524:0:14356:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638af331180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5e91e95c-c49d-475c-a425-33e1a73fefb4+10:2354:x1876286751497728:12345-192.168.202.23@tcp:103:ldlm_bl.0 Request processed in 231us (525us total) trans 0 rc 0/0 00000100:00100000:2.0:1789366746.689538:0:14356:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 14 00010000:00010000:0.0:1789366746.689591:0:15060:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000202a59de/0x8da3486b955f46e9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366746.689600:0:15060:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000202a59de/0x8da3486b955f46e9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366746.689947:0:15061:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000057441913/0x8da3486b955f46f0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366746.689972:0:15061:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000057441913/0x8da3486b955f46f0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789366746.763997:0:7617:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934596 is committed 00000001:00080000:1.0:1789366746.764012:0:7617:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934595 is committed 00000001:00080000:1.0:1789366746.764023:0:7617:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934598 is committed 00000001:00080000:1.0:1789366746.764033:0:7617:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934597 is committed 00002000:00010000:3.0:1789366746.764135:0:15060:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb size from disk: 0 -> 2097152 00002000:00010000:3.0:1789366746.764140:0:15060:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 1 -> 2051 00010000:00010000:3.0:1789366746.764154:0:15060:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000202a59de/0x8da3486b955f46e9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366746.764165:0:15060:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000202a59de/0x8da3486b955f46e9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366746.764171:0:15060:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000202a59de/0x8da3486b955f46e9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366746.764176:0:15060:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96388148e000 already unused, calling callback (ffffffffc16df520) 00010000:00010000:3.0:1789366746.764179:0:15060:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000202a59de/0x8da3486b955f46e9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366746.764185:0:15060:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000202a59de/0x8da3486b955f46e9 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366746.764199:0:15060:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000202a59de/0x8da3486b955f46e9 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366746.764204:0:15060:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000202a59de/0x8da3486b955f46e9 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789366746.764291:0:15060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963787499500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:5e91e95c-c49d-475c-a425-33e1a73fefb4+10:2355:x1876286751497344:12345-192.168.202.23@tcp:4:dd.0 Request processed in 77640us (77970us total) trans 8589934598 rc 0/0 00000100:00100000:3.0:1789366746.764302:0:15060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 0 00000100:00100000:3.0:1789366746.764335:0:15060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 2 00000100:00100000:3.0:1789366746.764346:0:15060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638af332a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:5e91e95c-c49d-475c-a425-33e1a73fefb4+9:2355:x1876286751497600:12345-192.168.202.23@tcp:4:dd.0 00010000:00010000:3.0:1789366746.764387:0:15060:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001f76138e/0x8da3486b955f46f7 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366746.764399:0:15060:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789366746.764403:0:15060:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789366746.764409:0:15060:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001f76138e/0x8da3486b955f46f7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366746.764421:0:15060:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001f76138e/0x8da3486b955f46f7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789366746.792344:0:7617:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934599 is committed 00002000:00010000:1.0:1789366746.792375:0:15061:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb size from disk: 2097152 -> 3145728 00002000:00010000:1.0:1789366746.792380:0:15061:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 2051 -> 4103 00010000:00010000:1.0:1789366746.792394:0:15061:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000057441913/0x8da3486b955f46f0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366746.792408:0:15061:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000057441913/0x8da3486b955f46f0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366746.792418:0:15061:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000057441913/0x8da3486b955f46f0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366746.792425:0:15061:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9638902c8e00 already unused, calling callback (ffffffffc16df520) 00010000:00010000:1.0:1789366746.792431:0:15061:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000057441913/0x8da3486b955f46f0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366746.792459:0:15061:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000057441913/0x8da3486b955f46f0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366746.792481:0:15061:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000057441913/0x8da3486b955f46f0 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366746.792488:0:15061:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000057441913/0x8da3486b955f46f0 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789366746.792578:0:15061:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638b6d56300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:5e91e95c-c49d-475c-a425-33e1a73fefb4+9:2355:x1876286751497472:12345-192.168.202.23@tcp:4:dd.0 Request processed in 104318us (106145us total) trans 8589934599 rc 0/0 00000100:00100000:1.0:1789366746.792590:0:15061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 1 00000001:00080000:3.0:1789366746.813441:0:7617:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934600 is committed 00002000:00010000:1.0:1789366746.813617:0:15060:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 4103 -> 6151 00010000:00010000:1.0:1789366746.813633:0:15060:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001f76138e/0x8da3486b955f46f7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366746.813646:0:15060:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001f76138e/0x8da3486b955f46f7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366746.813655:0:15060:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001f76138e/0x8da3486b955f46f7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366746.813663:0:15060:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96388148e200 already unused, calling callback (ffffffffc16df520) 00010000:00010000:1.0:1789366746.813668:0:15060:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001f76138e/0x8da3486b955f46f7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366746.813697:0:15060:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001f76138e/0x8da3486b955f46f7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366746.813750:0:15060:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001f76138e/0x8da3486b955f46f7 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366746.813759:0:15060:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001f76138e/0x8da3486b955f46f7 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789366746.813845:0:15060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638af332a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:5e91e95c-c49d-475c-a425-33e1a73fefb4+5:2355:x1876286751497600:12345-192.168.202.23@tcp:4:dd.0 Request processed in 49498us (126891us total) trans 8589934600 rc 0/0 00000100:00100000:1.0:1789366746.813856:0:15060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 2 00000100:00100000:0.0:1789366746.820306:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:0.0:1789366746.820438:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:0.0:1789366746.820590:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:3.0:1789366746.820678:0:15062:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751497856 00000100:00100000:3.0:1789366746.820687:0:15062:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751497856 00000100:00100000:3.0:1789366746.820776:0:15062:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751497984 00000100:00100000:3.0:1789366746.820780:0:15062:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751497984 00000100:00100000:3.0:1789366746.820814:0:15062:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 3 00000100:00100000:2.0:1789366746.820825:0:15061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 4 00000100:00100000:3.0:1789366746.820827:0:15062:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638b6d56d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:5e91e95c-c49d-475c-a425-33e1a73fefb4+6:2357:x1876286751497856:12345-192.168.202.23@tcp:4:dd.0 00000100:00100000:2.0:1789366746.820843:0:15061:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638b7215180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:5e91e95c-c49d-475c-a425-33e1a73fefb4+6:2356:x1876286751497984:12345-192.168.202.23@tcp:4:dd.0 00002000:00010000:3.0:1789366746.820891:0:15062:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x22:0x0] initial LVB size: 3145728, mtime: 0x6aa791da, atime: 0x6aa791da, ctime: 0x0, blocks: 0x1807 00010000:00010000:3.0:1789366746.820904:0:15062:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000202a59de/0x8da3486b955f46fe lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366746.820904:0:15061:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d2521def/0x8da3486b955f4705 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366746.820922:0:15061:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=322s v=(0 0) 00010000:00010000:2.0:1789366746.820930:0:15061:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789366746.820937:0:15061:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d2521def/0x8da3486b955f4705 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366746.820951:0:15061:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d2521def/0x8da3486b955f4705 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789366746.821196:0:16591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751498112 00000100:00100000:1.0:1789366746.821202:0:16591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751498112 00010000:00010000:3.0:1789366746.821304:0:15062:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789366746.821309:0:15062:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789366746.821313:0:15062:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000202a59de/0x8da3486b955f46fe lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366746.821324:0:15062:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000202a59de/0x8da3486b955f46fe lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789366746.821843:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:0.0:1789366746.821911:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.23@tcp (source: 12345-192.168.202.23@tcp) 00000100:00100000:1.0:1789366746.821936:0:16591:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 4 min 3 max 116 00000100:00100000:1.0:1789366746.822003:0:16591:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_004' 00000100:00100000:3.0:1789366746.822024:0:15060:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 4 min 3 max 116 00000100:00100000:3.0:1789366746.822035:0:15060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751498368 00000100:00100000:3.0:1789366746.822040:0:15060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751498368 00000100:00100000:3.0:1789366746.822069:0:15060:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 4 min 3 max 116 00000100:00100000:1.0:1789366746.822186:0:16591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286751498240 00000100:00100000:1.0:1789366746.822191:0:16591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286751498240 00000100:00100000:2.0:1789366746.822600:0:16592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 5 00000100:00100000:2.0:1789366746.822611:0:16592:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638b7215c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:5e91e95c-c49d-475c-a425-33e1a73fefb4+11:2357:x1876286751498112:12345-192.168.202.23@tcp:4:dd.0 00010000:00010000:2.0:1789366746.822639:0:16592:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000057441913/0x8da3486b955f470c lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366746.822652:0:16592:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789366746.822656:0:16592:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789366746.822660:0:16592:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000057441913/0x8da3486b955f470c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789366746.822673:0:16592:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000057441913/0x8da3486b955f470c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789366746.846366:0:7617:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934601 is committed 00002000:00010000:1.0:1789366746.848877:0:15061:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb size from disk: 3145728 -> 6291456 00002000:00010000:1.0:1789366746.848890:0:15061:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb mtime from disk: 1789366746 -> 1789366747 00002000:00010000:1.0:1789366746.848893:0:15061:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb ctime from disk: 0 -> 1789366747 00002000:00010000:1.0:1789366746.848896:0:15061:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 6151 -> 12295 00010000:00010000:1.0:1789366746.848911:0:15061:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d2521def/0x8da3486b955f4705 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366746.848924:0:15061:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d2521def/0x8da3486b955f4705 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366746.848947:0:15061:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d2521def/0x8da3486b955f4705 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366746.848956:0:15061:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9638902c8600 already unused, calling callback (ffffffffc16df520) 00010000:00010000:1.0:1789366746.848967:0:15061:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d2521def/0x8da3486b955f4705 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366746.848978:0:15061:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d2521def/0x8da3486b955f4705 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366746.849001:0:15061:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d2521def/0x8da3486b955f4705 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366746.849010:0:15061:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d2521def/0x8da3486b955f4705 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789366746.849101:0:15061:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638b7215180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:5e91e95c-c49d-475c-a425-33e1a73fefb4+15:2356:x1876286751497984:12345-192.168.202.23@tcp:4:dd.0 Request processed in 28258us (28656us total) trans 8589934601 rc 0/0 00000100:00100000:1.0:1789366746.849112:0:15061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 4 00000100:00100000:1.0:1789366746.849151:0:15061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 6 00000100:00100000:1.0:1789366746.849164:0:15061:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638b7214000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:5e91e95c-c49d-475c-a425-33e1a73fefb4+14:2357:x1876286751498368:12345-192.168.202.23@tcp:4:dd.0 00010000:00010000:1.0:1789366746.849197:0:15061:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c9481c92/0x8da3486b955f4713 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366746.849209:0:15061:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789366746.849220:0:15061:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789366746.849227:0:15061:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c9481c92/0x8da3486b955f4713 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366746.849240:0:15061:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c9481c92/0x8da3486b955f4713 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789366746.868775:0:7617:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934603 is committed 00002000:00010000:1.0:1789366746.868794:0:16592:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb size from disk: 6291456 -> 7654321 00010000:00010000:1.0:1789366746.868813:0:16592:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000057441913/0x8da3486b955f470c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366746.868827:0:16592:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000057441913/0x8da3486b955f470c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366746.868836:0:16592:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000057441913/0x8da3486b955f470c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366746.870935:0:16592:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9638902c8e00 already unused, calling callback (ffffffffc16df520) 00010000:00010000:3.0:1789366746.870944:0:15062:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000202a59de/0x8da3486b955f46fe lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366746.870960:0:15062:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000202a59de/0x8da3486b955f46fe lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366746.871025:0:15062:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000202a59de/0x8da3486b955f46fe lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366746.871026:0:16592:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000057441913/0x8da3486b955f470c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366746.871043:0:15062:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96388148e000 already unused, calling callback (ffffffffc16df520) 00010000:00010000:3.0:1789366746.871048:0:15062:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000202a59de/0x8da3486b955f46fe lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366746.871050:0:16592:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000057441913/0x8da3486b955f470c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366746.871056:0:15062:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000202a59de/0x8da3486b955f46fe lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366746.871079:0:16592:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000057441913/0x8da3486b955f470c lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366746.871101:0:16592:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000057441913/0x8da3486b955f470c lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789366746.871204:0:16592:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638b7215c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:5e91e95c-c49d-475c-a425-33e1a73fefb4+12:2357:x1876286751498112:12345-192.168.202.23@tcp:4:dd.0 Request processed in 48590us (50620us total) trans 8589934603 rc 0/0 00000100:00100000:1.0:1789366746.871213:0:16592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 5 00000100:00100000:1.0:1789366746.871248:0:16592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.23@tcp, seq: 7 00000100:00100000:1.0:1789366746.871259:0:16592:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638b7216680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:5e91e95c-c49d-475c-a425-33e1a73fefb4+11:2357:x1876286751498240:12345-192.168.202.23@tcp:4:dd.0 00010000:00010000:1.0:1789366746.871300:0:16592:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cdeb998c/0x8da3486b955f471a lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366746.871313:0:16592:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789366746.871318:0:16592:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789366746.871325:0:16592:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cdeb998c/0x8da3486b955f471a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366746.871338:0:16592:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000cdeb998c/0x8da3486b955f471a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366746.871918:0:15062:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000202a59de/0x8da3486b955f46fe lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789366746.871928:0:15062:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000202a59de/0x8da3486b955f46fe lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789366746.873058:0:15062:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638b6d56d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:5e91e95c-c49d-475c-a425-33e1a73fefb4+10:2357:x1876286751497856:12345-192.168.202.23@tcp:4:dd.0 Request processed in 52231us (52756us total) trans 8589934602 rc 0/0 00000100:00100000:3.0:1789366746.873070:0:15062:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 3 00000001:00080000:0.0:1789366746.911078:0:7617:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934604 is committed 00002000:00010000:1.0:1789366746.911572:0:15061:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 12295 -> 14343 00010000:00010000:1.0:1789366746.911589:0:15061:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c9481c92/0x8da3486b955f4713 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366746.911603:0:15061:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c9481c92/0x8da3486b955f4713 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366746.911612:0:15061:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c9481c92/0x8da3486b955f4713 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366746.911634:0:15061:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9638c142d400 already unused, calling callback (ffffffffc16df520) 00010000:00010000:1.0:1789366746.911639:0:15061:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c9481c92/0x8da3486b955f4713 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366746.911648:0:15061:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c9481c92/0x8da3486b955f4713 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366746.911677:0:15061:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c9481c92/0x8da3486b955f4713 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789366746.911685:0:15061:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c9481c92/0x8da3486b955f4713 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789366746.913548:0:15061:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638b7214000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:5e91e95c-c49d-475c-a425-33e1a73fefb4+9:2357:x1876286751498368:12345-192.168.202.23@tcp:4:dd.0 Request processed in 64374us (91691us total) trans 8589934604 rc 0/0 00000100:00100000:1.0:1789366746.913572:0:15061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 6 00000001:00080000:3.0:1789366746.939619:0:7617:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934605 is committed 00002000:00010000:0.0:1789366746.939768:0:16592:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 14343 -> 16391 00010000:00010000:0.0:1789366746.939782:0:16592:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cdeb998c/0x8da3486b955f471a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366746.939814:0:16592:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000cdeb998c/0x8da3486b955f471a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366746.939822:0:16592:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000cdeb998c/0x8da3486b955f471a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366746.939830:0:16592:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9638c142da00 already unused, calling callback (ffffffffc16df520) 00010000:00010000:0.0:1789366746.939835:0:16592:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000cdeb998c/0x8da3486b955f471a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366746.939846:0:16592:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000cdeb998c/0x8da3486b955f471a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366746.939866:0:16592:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000cdeb998c/0x8da3486b955f471a lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789366746.939871:0:16592:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000cdeb998c/0x8da3486b955f471a lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789366746.939959:0:16592:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638b7216680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:5e91e95c-c49d-475c-a425-33e1a73fefb4+5:2357:x1876286751498240:12345-192.168.202.23@tcp:4:dd.0 Request processed in 68699us (118042us total) trans 8589934605 rc 0/0 00000100:00100000:0.0:1789366746.939965:0:16592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.23@tcp, seq: 7 00010000:00010000:0.0:1789366747.319933:0:14359:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789366747.579571:0:3287:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789366747.579594:0:3287:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9638b7217100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3287:1876286758808576:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789366747.579664:0:3287:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789366747.582053:0:15059:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876286758808576 00000100:00100000:0.0:1789366747.582064:0:15059:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876286758808576 00000100:00100000:0.0:1789366747.582145:0:15059:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1789366747.582169:0:15059:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9638af331500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3287:x1876286758808576:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789366747.582209:0:15059:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00080000:1.0:1789366747.582233:0:14366:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789366747.582289:0:15059:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9638af331500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3287:x1876286758808576:12345-0@lo:13:osp-pre-0-0.0 Request processed in 123us (2624us total) trans 0 rc 0/0 00000100:00100000:0.0:1789366747.582298:0:15059:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1789366747.582328:0:3287:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9638b7217100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3287:1876286758808576:0@lo:13:osp-pre-0-0.0 00000001:02000400:1.0:1789366747.801925:0:16629:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity-pcc test_1c: @@@@@@ FAIL: expected /mnt/pcc.d1c.sanity-pcc/d1c.sanity-pcc/0bd3/0x200000bd1:0x2:0x0 size: 7654321 got: 0 00010000:00010000:2.0:1789366748.348610:0:16242:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) Debug log: 27717 lines, 27717 kept, 0 dropped, 0 bad.